Apr 17 11:13:37.974777 ip-10-0-130-188 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Apr 17 11:13:37.974786 ip-10-0-130-188 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Apr 17 11:13:37.974792 ip-10-0-130-188 systemd[1]: kubelet.service: Failed with result 'resources'. Apr 17 11:13:37.975014 ip-10-0-130-188 systemd[1]: Failed to start Kubernetes Kubelet. Apr 17 11:13:48.096386 ip-10-0-130-188 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Apr 17 11:13:48.096403 ip-10-0-130-188 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 57fe2a2b73224d5186ee4ba20f489cd0 -- Apr 17 11:16:15.052876 ip-10-0-130-188 systemd[1]: Starting Kubernetes Kubelet... Apr 17 11:16:15.522252 ip-10-0-130-188 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 11:16:15.522252 ip-10-0-130-188 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 17 11:16:15.522252 ip-10-0-130-188 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 11:16:15.522252 ip-10-0-130-188 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 17 11:16:15.522252 ip-10-0-130-188 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 11:16:15.525689 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.525602 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 17 11:16:15.529560 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529546 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 11:16:15.529560 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529560 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529564 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529567 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529570 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529573 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529576 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529592 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529595 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529598 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529600 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529604 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529607 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529610 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529613 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529616 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529618 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529621 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529624 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529626 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529629 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 11:16:15.529634 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529632 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529634 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529637 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529643 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529646 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529649 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529651 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529654 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529656 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529659 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529661 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529664 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529666 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529670 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529672 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529675 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529677 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529680 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529682 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 11:16:15.530083 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529685 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529687 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529690 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529692 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529694 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529697 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529699 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529702 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529704 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529706 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529709 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529711 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529714 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529716 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529719 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529722 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529724 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529727 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529729 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529732 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 11:16:15.530616 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529734 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529737 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529739 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529742 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529744 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529746 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529749 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529752 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529754 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529758 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529761 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529765 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529769 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529773 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529776 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529778 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529781 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529784 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529786 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 11:16:15.531085 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529788 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529791 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529794 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529796 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529799 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.529801 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530165 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530172 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530175 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530178 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530180 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530183 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530186 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530189 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530191 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530194 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530198 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530201 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530204 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530207 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 11:16:15.531523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530210 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530212 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530215 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530218 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530220 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530222 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530225 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530228 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530231 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530234 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530236 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530239 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530241 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530243 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530246 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530248 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530251 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530253 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530256 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530259 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 11:16:15.532006 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530262 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530264 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530268 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530270 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530273 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530275 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530278 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530281 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530283 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530286 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530288 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530290 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530293 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530295 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530298 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530300 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530303 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530305 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530307 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 11:16:15.532473 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530310 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530314 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530316 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530318 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530321 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530323 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530325 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530328 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530330 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530333 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530335 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530338 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530341 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530344 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530347 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530349 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530352 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530354 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530356 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530359 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 11:16:15.532934 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530361 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530364 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530366 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530369 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530371 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530373 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530376 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530378 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530380 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530383 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530385 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530387 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.530390 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531914 2576 flags.go:64] FLAG: --address="0.0.0.0" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531925 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531931 2576 flags.go:64] FLAG: --anonymous-auth="true" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531936 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531940 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531943 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531948 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531952 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 17 11:16:15.533406 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531955 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531958 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531961 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531965 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531968 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531972 2576 flags.go:64] FLAG: --cgroup-root="" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531975 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531978 2576 flags.go:64] FLAG: --client-ca-file="" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531980 2576 flags.go:64] FLAG: --cloud-config="" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531983 2576 flags.go:64] FLAG: --cloud-provider="external" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531986 2576 flags.go:64] FLAG: --cluster-dns="[]" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531992 2576 flags.go:64] FLAG: --cluster-domain="" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531995 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.531998 2576 flags.go:64] FLAG: --config-dir="" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532001 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532004 2576 flags.go:64] FLAG: --container-log-max-files="5" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532008 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532012 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532015 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532018 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532021 2576 flags.go:64] FLAG: --contention-profiling="false" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532024 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532027 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532030 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532033 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 17 11:16:15.533912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532038 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532041 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532044 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532046 2576 flags.go:64] FLAG: --enable-load-reader="false" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532049 2576 flags.go:64] FLAG: --enable-server="true" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532052 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532056 2576 flags.go:64] FLAG: --event-burst="100" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532059 2576 flags.go:64] FLAG: --event-qps="50" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532062 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532065 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532068 2576 flags.go:64] FLAG: --eviction-hard="" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532072 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532075 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532078 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532081 2576 flags.go:64] FLAG: --eviction-soft="" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532084 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532087 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532089 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532092 2576 flags.go:64] FLAG: --experimental-mounter-path="" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532095 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532098 2576 flags.go:64] FLAG: --fail-swap-on="true" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532101 2576 flags.go:64] FLAG: --feature-gates="" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532105 2576 flags.go:64] FLAG: --file-check-frequency="20s" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532108 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532111 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 17 11:16:15.534501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532114 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532117 2576 flags.go:64] FLAG: --healthz-port="10248" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532119 2576 flags.go:64] FLAG: --help="false" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532122 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532125 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532128 2576 flags.go:64] FLAG: --http-check-frequency="20s" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532131 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532134 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532138 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532140 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532144 2576 flags.go:64] FLAG: --image-service-endpoint="" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532147 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532149 2576 flags.go:64] FLAG: --kube-api-burst="100" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532152 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532156 2576 flags.go:64] FLAG: --kube-api-qps="50" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532158 2576 flags.go:64] FLAG: --kube-reserved="" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532161 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532164 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532168 2576 flags.go:64] FLAG: --kubelet-cgroups="" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532170 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532173 2576 flags.go:64] FLAG: --lock-file="" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532176 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532179 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532182 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 17 11:16:15.535095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532187 2576 flags.go:64] FLAG: --log-json-split-stream="false" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532190 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532193 2576 flags.go:64] FLAG: --log-text-split-stream="false" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532196 2576 flags.go:64] FLAG: --logging-format="text" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532199 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532202 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532204 2576 flags.go:64] FLAG: --manifest-url="" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532207 2576 flags.go:64] FLAG: --manifest-url-header="" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532211 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532214 2576 flags.go:64] FLAG: --max-open-files="1000000" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532218 2576 flags.go:64] FLAG: --max-pods="110" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532222 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532225 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532227 2576 flags.go:64] FLAG: --memory-manager-policy="None" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532230 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532233 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532236 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532239 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532246 2576 flags.go:64] FLAG: --node-status-max-images="50" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532249 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532252 2576 flags.go:64] FLAG: --oom-score-adj="-999" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532254 2576 flags.go:64] FLAG: --pod-cidr="" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532257 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 17 11:16:15.535768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532263 2576 flags.go:64] FLAG: --pod-manifest-path="" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532265 2576 flags.go:64] FLAG: --pod-max-pids="-1" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532268 2576 flags.go:64] FLAG: --pods-per-core="0" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532271 2576 flags.go:64] FLAG: --port="10250" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532274 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532277 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0145a7285785088ee" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532280 2576 flags.go:64] FLAG: --qos-reserved="" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532283 2576 flags.go:64] FLAG: --read-only-port="10255" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532286 2576 flags.go:64] FLAG: --register-node="true" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532288 2576 flags.go:64] FLAG: --register-schedulable="true" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532291 2576 flags.go:64] FLAG: --register-with-taints="" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532295 2576 flags.go:64] FLAG: --registry-burst="10" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532297 2576 flags.go:64] FLAG: --registry-qps="5" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532300 2576 flags.go:64] FLAG: --reserved-cpus="" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532303 2576 flags.go:64] FLAG: --reserved-memory="" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532309 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532312 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532315 2576 flags.go:64] FLAG: --rotate-certificates="false" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532317 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532320 2576 flags.go:64] FLAG: --runonce="false" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532323 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532326 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532328 2576 flags.go:64] FLAG: --seccomp-default="false" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532331 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532334 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532336 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 17 11:16:15.536352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532339 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532343 2576 flags.go:64] FLAG: --storage-driver-password="root" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532346 2576 flags.go:64] FLAG: --storage-driver-secure="false" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532349 2576 flags.go:64] FLAG: --storage-driver-table="stats" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532351 2576 flags.go:64] FLAG: --storage-driver-user="root" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532354 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532357 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532359 2576 flags.go:64] FLAG: --system-cgroups="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532362 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532368 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532370 2576 flags.go:64] FLAG: --tls-cert-file="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532373 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532377 2576 flags.go:64] FLAG: --tls-min-version="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532380 2576 flags.go:64] FLAG: --tls-private-key-file="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532383 2576 flags.go:64] FLAG: --topology-manager-policy="none" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532386 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532388 2576 flags.go:64] FLAG: --topology-manager-scope="container" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532392 2576 flags.go:64] FLAG: --v="2" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532395 2576 flags.go:64] FLAG: --version="false" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532399 2576 flags.go:64] FLAG: --vmodule="" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532403 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.532406 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532507 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532512 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 11:16:15.536964 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532515 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532518 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532520 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532523 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532526 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532529 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532531 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532534 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532537 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532539 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532542 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532545 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532547 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532550 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532552 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532555 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532560 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532562 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532565 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532567 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 11:16:15.537513 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532570 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532572 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532574 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532592 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532594 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532597 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532599 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532602 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532605 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532607 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532609 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532612 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532615 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532617 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532621 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532625 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532627 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532630 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532632 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532635 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 11:16:15.538015 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532637 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532640 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532643 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532646 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532649 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532651 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532653 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532657 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532661 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532664 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532667 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532669 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532672 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532674 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532676 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532679 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532681 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532684 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532686 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532688 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 11:16:15.538489 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532691 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532693 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532696 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532698 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532701 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532703 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532706 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532708 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532711 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532713 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532716 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532718 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532723 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532726 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532731 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532734 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532736 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532739 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532741 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 11:16:15.539013 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532748 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 11:16:15.539505 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532751 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 11:16:15.539505 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532753 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 11:16:15.539505 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.532756 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 11:16:15.539505 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.533427 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 11:16:15.541983 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.541961 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 17 11:16:15.541983 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.541980 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542026 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542031 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542035 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542038 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542041 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542044 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542047 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542050 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542052 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542055 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542057 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542061 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542067 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542070 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542073 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542076 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542079 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542082 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 11:16:15.542110 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542085 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542088 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542090 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542094 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542096 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542099 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542102 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542105 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542107 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542110 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542112 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542115 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542118 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542121 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542124 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542127 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542129 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542131 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542134 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542137 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 11:16:15.542565 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542139 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542141 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542144 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542146 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542148 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542151 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542153 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542156 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542158 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542161 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542164 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542166 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542169 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542171 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542174 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542177 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542179 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542182 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542184 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542187 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 11:16:15.543059 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542190 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542195 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542197 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542200 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542203 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542205 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542208 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542210 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542213 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542215 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542218 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542220 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542223 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542225 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542228 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542230 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542233 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542235 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542239 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 11:16:15.543536 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542241 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542244 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542246 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542249 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542251 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542254 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542256 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542259 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542262 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.542266 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542355 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542360 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542364 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542367 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542370 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 11:16:15.544138 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542373 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542376 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542379 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542381 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542384 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542387 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542389 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542392 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542395 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542397 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542400 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542403 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542405 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542408 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542410 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542413 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542415 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542418 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542421 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542423 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 11:16:15.544500 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542426 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542429 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542431 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542434 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542436 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542439 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542441 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542444 2576 feature_gate.go:328] unrecognized feature gate: Example Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542447 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542449 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542452 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542454 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542457 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542459 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542461 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542464 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542466 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542469 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542471 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542474 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 11:16:15.544995 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542476 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542479 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542481 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542484 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542486 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542488 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542491 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542493 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542496 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542499 2576 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542502 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542504 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542507 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542510 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542513 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542515 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542518 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542520 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542522 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542525 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 11:16:15.545465 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542527 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542530 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542534 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542536 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542539 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542542 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542544 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542547 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542549 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542552 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542554 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542557 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542559 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542561 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542564 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542566 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542569 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542571 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542574 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 11:16:15.545957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542576 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 11:16:15.546405 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:15.542600 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 11:16:15.546405 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.542605 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 11:16:15.546405 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.543349 2576 server.go:962] "Client rotation is on, will bootstrap in background" Apr 17 11:16:15.547770 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.547756 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 17 11:16:15.549319 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.549307 2576 server.go:1019] "Starting client certificate rotation" Apr 17 11:16:15.549427 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.549409 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 11:16:15.549463 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.549454 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 11:16:15.576674 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.576658 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 11:16:15.579603 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.579570 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 11:16:15.595328 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.595311 2576 log.go:25] "Validated CRI v1 runtime API" Apr 17 11:16:15.600986 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.600971 2576 log.go:25] "Validated CRI v1 image API" Apr 17 11:16:15.602125 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.602101 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 17 11:16:15.606705 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.606681 2576 fs.go:135] Filesystem UUIDs: map[0ba87ec1-ec0d-4e19-bba9-d86f687b2edf:/dev/nvme0n1p3 5deea15b-6207-4b0b-ad25-2ad3b38294fe:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Apr 17 11:16:15.606764 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.606704 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 17 11:16:15.612023 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.611896 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 11:16:15.613968 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.613861 2576 manager.go:217] Machine: {Timestamp:2026-04-17 11:16:15.611199629 +0000 UTC m=+0.434963501 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200477 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27499ee96a79484749537276621f10 SystemUUID:ec27499e-e96a-7948-4749-537276621f10 BootID:57fe2a2b-7322-4d51-86ee-4ba20f489cd0 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:aa:a7:0d:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:aa:a7:0d:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:59:79:1e:86:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 17 11:16:15.613968 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.613968 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 17 11:16:15.614097 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.614083 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 17 11:16:15.614427 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.614410 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 17 11:16:15.614869 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.614429 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 17 11:16:15.614988 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.614879 2576 topology_manager.go:138] "Creating topology manager with none policy" Apr 17 11:16:15.614988 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.614895 2576 container_manager_linux.go:306] "Creating device plugin manager" Apr 17 11:16:15.614988 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.614912 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 11:16:15.616472 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.616439 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 11:16:15.618240 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.618229 2576 state_mem.go:36] "Initialized new in-memory state store" Apr 17 11:16:15.618366 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.618357 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 17 11:16:15.622140 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.622130 2576 kubelet.go:491] "Attempting to sync node with API server" Apr 17 11:16:15.622179 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.622144 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 17 11:16:15.622179 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.622159 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 17 11:16:15.622179 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.622168 2576 kubelet.go:397] "Adding apiserver pod source" Apr 17 11:16:15.622179 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.622176 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 17 11:16:15.623332 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.623320 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 11:16:15.623376 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.623338 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 11:16:15.626608 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.626576 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 17 11:16:15.627987 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.627974 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 17 11:16:15.630026 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630008 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 17 11:16:15.630101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630038 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 17 11:16:15.630101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630053 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 17 11:16:15.630101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630065 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 17 11:16:15.630101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630077 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 17 11:16:15.630101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630087 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 17 11:16:15.630101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630099 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 17 11:16:15.630350 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630111 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 17 11:16:15.630350 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630124 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 17 11:16:15.630350 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630131 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 17 11:16:15.630350 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630139 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 17 11:16:15.630350 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.630147 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 17 11:16:15.632063 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.632049 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 17 11:16:15.632063 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.632062 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 17 11:16:15.632978 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.632960 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pcm52" Apr 17 11:16:15.633731 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.633695 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 17 11:16:15.633814 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.633737 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Apr 17 11:16:15.635886 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.635869 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 17 11:16:15.635938 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.635907 2576 server.go:1295] "Started kubelet" Apr 17 11:16:15.635991 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.635967 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 17 11:16:15.636042 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.635997 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 17 11:16:15.636085 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.636068 2576 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 17 11:16:15.636673 ip-10-0-130-188 systemd[1]: Started Kubernetes Kubelet. Apr 17 11:16:15.637286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.637273 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 17 11:16:15.638908 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.638888 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pcm52" Apr 17 11:16:15.638995 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.638981 2576 server.go:317] "Adding debug handlers to kubelet server" Apr 17 11:16:15.645038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.645022 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 17 11:16:15.645668 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.645652 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646576 2576 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646613 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.646549 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646627 2576 factory.go:55] Registering systemd factory Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646642 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646698 2576 reconstruct.go:97] "Volume reconstruction finished" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646710 2576 reconciler.go:26] "Reconciler: start to sync state" Apr 17 11:16:15.646749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.646734 2576 factory.go:223] Registration of the systemd container factory successfully Apr 17 11:16:15.647138 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.646854 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 17 11:16:15.647185 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.647165 2576 factory.go:153] Registering CRI-O factory Apr 17 11:16:15.647185 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.647177 2576 factory.go:223] Registration of the crio container factory successfully Apr 17 11:16:15.647243 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.647221 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 17 11:16:15.647243 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.647240 2576 factory.go:103] Registering Raw factory Apr 17 11:16:15.647313 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.647263 2576 manager.go:1196] Started watching for new ooms in manager Apr 17 11:16:15.647967 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.647950 2576 manager.go:319] Starting recovery of all containers Apr 17 11:16:15.648705 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.648688 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:15.653764 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.653740 2576 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-188.ec2.internal" not found Apr 17 11:16:15.653873 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.653822 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-188.ec2.internal\" not found" node="ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.654249 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.654207 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 17 11:16:15.659873 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.659858 2576 manager.go:324] Recovery completed Apr 17 11:16:15.663983 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.663967 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 11:16:15.666734 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.666714 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientMemory" Apr 17 11:16:15.666805 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.666749 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 11:16:15.666805 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.666762 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientPID" Apr 17 11:16:15.667213 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.667200 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 17 11:16:15.667213 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.667212 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 17 11:16:15.667289 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.667227 2576 state_mem.go:36] "Initialized new in-memory state store" Apr 17 11:16:15.669800 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.669784 2576 policy_none.go:49] "None policy: Start" Apr 17 11:16:15.669800 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.669799 2576 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 17 11:16:15.669937 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.669809 2576 state_mem.go:35] "Initializing new in-memory state store" Apr 17 11:16:15.670295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.670279 2576 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-188.ec2.internal" not found Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.706673 2576 manager.go:341] "Starting Device Plugin manager" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.706699 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.706709 2576 server.go:85] "Starting device plugin registration server" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.706949 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.706972 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.707059 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.707131 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.707140 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.707868 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 17 11:16:15.717000 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.707905 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:15.731196 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.731179 2576 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-188.ec2.internal" not found Apr 17 11:16:15.793574 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.793515 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 17 11:16:15.793574 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.793545 2576 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 17 11:16:15.793574 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.793563 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 17 11:16:15.793574 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.793569 2576 kubelet.go:2451] "Starting kubelet main sync loop" Apr 17 11:16:15.793772 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.793619 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 17 11:16:15.796083 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.796065 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:15.808075 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.808063 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 11:16:15.808989 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.808976 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientMemory" Apr 17 11:16:15.809070 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.809005 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 11:16:15.809070 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.809017 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientPID" Apr 17 11:16:15.809070 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.809038 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.816239 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.816225 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.816282 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.816245 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-188.ec2.internal\": node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:15.831793 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.831770 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:15.894101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.894063 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal"] Apr 17 11:16:15.894187 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.894144 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 11:16:15.895751 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.895736 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientMemory" Apr 17 11:16:15.895824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.895763 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 11:16:15.895824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.895773 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientPID" Apr 17 11:16:15.897905 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.897892 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 11:16:15.898062 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898048 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.898097 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898077 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 11:16:15.898627 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898611 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientMemory" Apr 17 11:16:15.898702 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898641 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 11:16:15.898702 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898654 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientPID" Apr 17 11:16:15.898702 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898617 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientMemory" Apr 17 11:16:15.898797 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898716 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 11:16:15.898797 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.898727 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientPID" Apr 17 11:16:15.900813 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.900797 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.900891 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.900825 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 11:16:15.901560 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.901546 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientMemory" Apr 17 11:16:15.901631 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.901573 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 11:16:15.901631 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.901600 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeHasSufficientPID" Apr 17 11:16:15.927081 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.927067 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-188.ec2.internal\" not found" node="ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.931136 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.931119 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-188.ec2.internal\" not found" node="ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.932117 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:15.932104 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:15.948121 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.948100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c94f84787f30fa393199c7cbd48cbbc-config\") pod \"kube-apiserver-proxy-ip-10-0-130-188.ec2.internal\" (UID: \"8c94f84787f30fa393199c7cbd48cbbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.948186 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.948126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f45d2f30dc1d7411364cb73a6c4d3be0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal\" (UID: \"f45d2f30dc1d7411364cb73a6c4d3be0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:15.948186 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:15.948144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f45d2f30dc1d7411364cb73a6c4d3be0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal\" (UID: \"f45d2f30dc1d7411364cb73a6c4d3be0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.033149 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.033121 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:16.048493 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.048444 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f45d2f30dc1d7411364cb73a6c4d3be0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal\" (UID: \"f45d2f30dc1d7411364cb73a6c4d3be0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.048493 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.048470 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f45d2f30dc1d7411364cb73a6c4d3be0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal\" (UID: \"f45d2f30dc1d7411364cb73a6c4d3be0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.048493 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.048488 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c94f84787f30fa393199c7cbd48cbbc-config\") pod \"kube-apiserver-proxy-ip-10-0-130-188.ec2.internal\" (UID: \"8c94f84787f30fa393199c7cbd48cbbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.048647 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.048513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c94f84787f30fa393199c7cbd48cbbc-config\") pod \"kube-apiserver-proxy-ip-10-0-130-188.ec2.internal\" (UID: \"8c94f84787f30fa393199c7cbd48cbbc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.048647 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.048539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f45d2f30dc1d7411364cb73a6c4d3be0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal\" (UID: \"f45d2f30dc1d7411364cb73a6c4d3be0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.048647 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.048539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f45d2f30dc1d7411364cb73a6c4d3be0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal\" (UID: \"f45d2f30dc1d7411364cb73a6c4d3be0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.133826 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.133785 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:16.229333 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.229293 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.234054 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.234031 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:16.234054 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.234033 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.334421 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.334332 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:16.434902 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.434869 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-188.ec2.internal\" not found" Apr 17 11:16:16.444667 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.444645 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:16.446532 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.446518 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.446839 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.446823 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:16.457015 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.456998 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 11:16:16.457828 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.457812 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" Apr 17 11:16:16.475082 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.475059 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 11:16:16.550340 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.550309 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 17 11:16:16.551091 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.550479 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 11:16:16.551091 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.550497 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 11:16:16.551091 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.550507 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 11:16:16.623093 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.623000 2576 apiserver.go:52] "Watching apiserver" Apr 17 11:16:16.629092 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.629063 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 17 11:16:16.629395 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.629375 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6","openshift-dns/node-resolver-bltmr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal","openshift-multus/multus-additional-cni-plugins-5x2cw","openshift-multus/network-metrics-daemon-47s58","openshift-network-operator/iptables-alerter-6268l","kube-system/konnectivity-agent-bkvlp","openshift-cluster-node-tuning-operator/tuned-dtdmf","openshift-image-registry/node-ca-mh2fr","openshift-multus/multus-xlg6c","openshift-network-diagnostics/network-check-target-j9jfg","openshift-ovn-kubernetes/ovnkube-node-tmxqh"] Apr 17 11:16:16.634546 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.634527 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.636622 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.636580 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gq95b\"" Apr 17 11:16:16.636760 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.636743 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.636831 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.636796 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.636887 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.636826 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.636887 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.636878 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.637534 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.637514 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 17 11:16:16.638790 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.638774 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7pfnk\"" Apr 17 11:16:16.638921 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.638910 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.638984 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.638931 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.639042 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.638931 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96w8j\"" Apr 17 11:16:16.639244 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.639226 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.639312 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.639227 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.639364 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.639354 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.639409 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.639396 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 17 11:16:16.640470 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.640448 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-16 11:11:15 +0000 UTC" deadline="2027-11-24 04:32:42.899711252 +0000 UTC" Apr 17 11:16:16.640470 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.640468 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14057h16m26.259244983s" Apr 17 11:16:16.640561 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.640529 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 17 11:16:16.641096 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.641081 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rf766\"" Apr 17 11:16:16.641235 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.641223 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.641309 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.641296 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 17 11:16:16.641364 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.641307 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 17 11:16:16.641364 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.641312 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.641670 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.641655 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.643021 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.643006 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 17 11:16:16.643094 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.643080 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qhhfc\"" Apr 17 11:16:16.643295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.643280 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 17 11:16:16.643366 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.643345 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.643471 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.643388 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.644511 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.644498 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.645793 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.645778 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 17 11:16:16.646042 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.646027 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qwnw4\"" Apr 17 11:16:16.646161 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.646140 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 17 11:16:16.646257 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.646203 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 17 11:16:16.646257 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.646238 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.646354 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.646240 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 17 11:16:16.646354 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.646328 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.647044 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.647028 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:16.647133 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.647109 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:16.649516 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.649500 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.650643 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-socket-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.650736 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q22xl\" (UniqueName: \"kubernetes.io/projected/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-kube-api-access-q22xl\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.650736 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-ovn\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.650736 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-log-socket\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.650736 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-cni-bin\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbfk\" (UniqueName: \"kubernetes.io/projected/87c84598-6174-4e54-9961-2dc53effa865-kube-api-access-gfbfk\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-system-cni-dir\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ab650d2-2c24-4fe2-a077-de6d2b170818-agent-certs\") pod \"konnectivity-agent-bkvlp\" (UID: \"4ab650d2-2c24-4fe2-a077-de6d2b170818\") " pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ab650d2-2c24-4fe2-a077-de6d2b170818-konnectivity-ca\") pod \"konnectivity-agent-bkvlp\" (UID: \"4ab650d2-2c24-4fe2-a077-de6d2b170818\") " pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7d8q\" (UniqueName: \"kubernetes.io/projected/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-kube-api-access-l7d8q\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.650901 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-var-lib-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czd99\" (UniqueName: \"kubernetes.io/projected/d4216bf0-aee8-41ef-9cd7-4faf142a0459-kube-api-access-czd99\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-device-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.650976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvbp\" (UniqueName: \"kubernetes.io/projected/1f736420-e15c-4069-947e-5fba427835fb-kube-api-access-vzvbp\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-host\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-kubelet\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-registration-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651117 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x47ml\"" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-systemd\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-cni-netd\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a4672b1-7b40-4c9b-824a-8a50e03d7175-hosts-file\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4672b1-7b40-4c9b-824a-8a50e03d7175-tmp-dir\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651247 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 17 11:16:16.651250 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-cnibin\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651339 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-serviceca\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-slash\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-run-netns\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-etc-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqvpj\" (UniqueName: \"kubernetes.io/projected/0a4672b1-7b40-4c9b-824a-8a50e03d7175-kube-api-access-gqvpj\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-iptables-alerter-script\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-host-slash\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-systemd-units\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-node-log\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-env-overrides\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.651824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovn-node-metrics-cert\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.651973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-sys-fs\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.652014 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89psd\" (UniqueName: \"kubernetes.io/projected/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-kube-api-access-89psd\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.652100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-os-release\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.652141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.652190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovnkube-config\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.652403 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.652313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovnkube-script-lib\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.654984 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.654939 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.655122 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.655039 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.656501 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.656481 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 17 11:16:16.656643 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.656550 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kkrpp\"" Apr 17 11:16:16.656643 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.656559 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 17 11:16:16.656750 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.656709 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sv9hn\"" Apr 17 11:16:16.656935 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.656919 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 17 11:16:16.657452 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.657435 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:16.657523 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.657490 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:16.658633 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.658612 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 11:16:16.687201 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.687174 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jhtvm" Apr 17 11:16:16.696940 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.696915 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jhtvm" Apr 17 11:16:16.748292 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.748272 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 17 11:16:16.752696 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752674 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-node-log\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.752798 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752706 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovnkube-script-lib\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.752798 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-host\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.752798 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-cni-multus\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.752798 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-kubelet\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.752971 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-node-log\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.752971 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752877 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.752971 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.752971 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752923 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovnkube-config\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.752971 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-var-lib-kubelet\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.753151 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.752999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40c29d71-2d2c-4206-8b69-7023028bc594-tmp\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.753151 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-netns\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.753151 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753142 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-socket-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.753304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40c29d71-2d2c-4206-8b69-7023028bc594-etc-tuned\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.753304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-cnibin\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.753304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-conf-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.753304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-multus-certs\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.753304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753291 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovnkube-script-lib\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753297 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-hostroot\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753351 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ab650d2-2c24-4fe2-a077-de6d2b170818-agent-certs\") pod \"konnectivity-agent-bkvlp\" (UID: \"4ab650d2-2c24-4fe2-a077-de6d2b170818\") " pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753389 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7d8q\" (UniqueName: \"kubernetes.io/projected/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-kube-api-access-l7d8q\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753433 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-var-lib-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753450 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czd99\" (UniqueName: \"kubernetes.io/projected/d4216bf0-aee8-41ef-9cd7-4faf142a0459-kube-api-access-czd99\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-run\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovnkube-config\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-var-lib-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-cni-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753606 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-device-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753625 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvbp\" (UniqueName: \"kubernetes.io/projected/1f736420-e15c-4069-947e-5fba427835fb-kube-api-access-vzvbp\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753640 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-host\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.753663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753661 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-kubelet\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysctl-conf\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-device-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-kubelet\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753782 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-registration-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-host\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753823 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753849 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-cni-netd\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-registration-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-os-release\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-daemon-config\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-cni-netd\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753947 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a4672b1-7b40-4c9b-824a-8a50e03d7175-hosts-file\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753964 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753979 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-slash\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.753995 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-run-netns\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754009 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754139 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754038 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbfk\" (UniqueName: \"kubernetes.io/projected/87c84598-6174-4e54-9961-2dc53effa865-kube-api-access-gfbfk\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-slash\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-sys\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-system-cni-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754112 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-iptables-alerter-script\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754127 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-host-slash\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754141 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-systemd-units\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754161 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-sys-fs\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a4672b1-7b40-4c9b-824a-8a50e03d7175-hosts-file\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754192 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89psd\" (UniqueName: \"kubernetes.io/projected/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-kube-api-access-89psd\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754218 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-os-release\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754043 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-run-netns\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754233 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754259 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-lib-modules\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysctl-d\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.754731 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754350 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q22xl\" (UniqueName: \"kubernetes.io/projected/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-kube-api-access-q22xl\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754378 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-ovn\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754402 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-log-socket\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754423 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-cni-bin\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754464 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-socket-dir\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.754538 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-sys-fs\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-host-slash\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.754977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-log-socket\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755018 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-systemd-units\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-ovn\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-host-cni-bin\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.755460 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.755312 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:17.255280254 +0000 UTC m=+2.079044121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755375 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-system-cni-dir\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-iptables-alerter-script\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-os-release\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-systemd\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-system-cni-dir\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-k8s-cni-cncf-io\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-etc-kubernetes\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755637 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755671 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ab650d2-2c24-4fe2-a077-de6d2b170818-konnectivity-ca\") pod \"konnectivity-agent-bkvlp\" (UID: \"4ab650d2-2c24-4fe2-a077-de6d2b170818\") " pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26288be6-4e7e-4bc3-b559-1a6808a040ac-cni-binary-copy\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755729 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755760 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-modprobe-d\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysconfig\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-kubernetes\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ghm\" (UniqueName: \"kubernetes.io/projected/40c29d71-2d2c-4206-8b69-7023028bc594-kube-api-access-j2ghm\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.756286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jcxr\" (UniqueName: \"kubernetes.io/projected/26288be6-4e7e-4bc3-b559-1a6808a040ac-kube-api-access-5jcxr\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755927 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-systemd\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755954 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4672b1-7b40-4c9b-824a-8a50e03d7175-tmp-dir\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.755982 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-cnibin\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756005 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-serviceca\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756049 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-etc-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756079 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-env-overrides\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756110 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovn-node-metrics-cert\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-socket-dir-parent\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-cni-bin\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756195 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvpj\" (UniqueName: \"kubernetes.io/projected/0a4672b1-7b40-4c9b-824a-8a50e03d7175-kube-api-access-gqvpj\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756547 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-run-systemd\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a4672b1-7b40-4c9b-824a-8a50e03d7175-tmp-dir\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.757038 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.756949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-cnibin\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.757570 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.757219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4ab650d2-2c24-4fe2-a077-de6d2b170818-konnectivity-ca\") pod \"konnectivity-agent-bkvlp\" (UID: \"4ab650d2-2c24-4fe2-a077-de6d2b170818\") " pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.757570 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.757298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-serviceca\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.757570 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.757308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.757570 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.757352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4216bf0-aee8-41ef-9cd7-4faf142a0459-etc-openvswitch\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757773 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.757728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4216bf0-aee8-41ef-9cd7-4faf142a0459-env-overrides\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.757773 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.757751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f736420-e15c-4069-947e-5fba427835fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.758217 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.758193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f736420-e15c-4069-947e-5fba427835fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.759082 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.759045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4ab650d2-2c24-4fe2-a077-de6d2b170818-agent-certs\") pod \"konnectivity-agent-bkvlp\" (UID: \"4ab650d2-2c24-4fe2-a077-de6d2b170818\") " pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.759849 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.759826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4216bf0-aee8-41ef-9cd7-4faf142a0459-ovn-node-metrics-cert\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.761396 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.761370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czd99\" (UniqueName: \"kubernetes.io/projected/d4216bf0-aee8-41ef-9cd7-4faf142a0459-kube-api-access-czd99\") pod \"ovnkube-node-tmxqh\" (UID: \"d4216bf0-aee8-41ef-9cd7-4faf142a0459\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:16.762031 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.761914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7d8q\" (UniqueName: \"kubernetes.io/projected/9f1db6e3-ccc9-4ae6-90b9-340c0db5f049-kube-api-access-l7d8q\") pod \"iptables-alerter-6268l\" (UID: \"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049\") " pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:16.762031 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.761978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvbp\" (UniqueName: \"kubernetes.io/projected/1f736420-e15c-4069-947e-5fba427835fb-kube-api-access-vzvbp\") pod \"multus-additional-cni-plugins-5x2cw\" (UID: \"1f736420-e15c-4069-947e-5fba427835fb\") " pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.763010 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.762987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q22xl\" (UniqueName: \"kubernetes.io/projected/f0998c63-b88c-4e5d-b5f5-4d1e823dda43-kube-api-access-q22xl\") pod \"node-ca-mh2fr\" (UID: \"f0998c63-b88c-4e5d-b5f5-4d1e823dda43\") " pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.763273 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.763247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbfk\" (UniqueName: \"kubernetes.io/projected/87c84598-6174-4e54-9961-2dc53effa865-kube-api-access-gfbfk\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:16.763639 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.763621 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqvpj\" (UniqueName: \"kubernetes.io/projected/0a4672b1-7b40-4c9b-824a-8a50e03d7175-kube-api-access-gqvpj\") pod \"node-resolver-bltmr\" (UID: \"0a4672b1-7b40-4c9b-824a-8a50e03d7175\") " pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:16.764045 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.764028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89psd\" (UniqueName: \"kubernetes.io/projected/041f21a4-6d6f-4c96-b0d3-6fa79b44ba99-kube-api-access-89psd\") pod \"aws-ebs-csi-driver-node-q2ts6\" (UID: \"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:16.771804 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.771787 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" Apr 17 11:16:16.787294 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.787278 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:16.811265 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:16.811230 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c94f84787f30fa393199c7cbd48cbbc.slice/crio-ff2763167c95166fcca78e6f868a4309e0e9d4c228448ee0f4b3f49f76834db3 WatchSource:0}: Error finding container ff2763167c95166fcca78e6f868a4309e0e9d4c228448ee0f4b3f49f76834db3: Status 404 returned error can't find the container with id ff2763167c95166fcca78e6f868a4309e0e9d4c228448ee0f4b3f49f76834db3 Apr 17 11:16:16.812019 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:16.811999 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45d2f30dc1d7411364cb73a6c4d3be0.slice/crio-c3c6cbc1ce06f33389422a88bbf2cbaa5310bd98439f6ab31c760d6e7544701b WatchSource:0}: Error finding container c3c6cbc1ce06f33389422a88bbf2cbaa5310bd98439f6ab31c760d6e7544701b: Status 404 returned error can't find the container with id c3c6cbc1ce06f33389422a88bbf2cbaa5310bd98439f6ab31c760d6e7544701b Apr 17 11:16:16.813144 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:16.813126 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab650d2_2c24_4fe2_a077_de6d2b170818.slice/crio-276902a8faf3c7e36d074f34d7aaee89c14e8b041ba12ebf168224b07fbaf690 WatchSource:0}: Error finding container 276902a8faf3c7e36d074f34d7aaee89c14e8b041ba12ebf168224b07fbaf690: Status 404 returned error can't find the container with id 276902a8faf3c7e36d074f34d7aaee89c14e8b041ba12ebf168224b07fbaf690 Apr 17 11:16:16.816829 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.816808 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 11:16:16.856737 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856713 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-os-release\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.856737 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856738 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-daemon-config\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.856880 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856765 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-sys\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.856880 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856786 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-system-cni-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.856880 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-os-release\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.856880 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-system-cni-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.856880 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856840 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-lib-modules\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.856880 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-sys\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856890 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysctl-d\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-lib-modules\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856931 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856970 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-systemd\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.856995 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-k8s-cni-cncf-io\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysctl-d\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857020 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-etc-kubernetes\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857029 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-systemd\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-k8s-cni-cncf-io\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857067 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26288be6-4e7e-4bc3-b559-1a6808a040ac-cni-binary-copy\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857108 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-modprobe-d\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857136 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysconfig\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857160 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-kubernetes\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-etc-kubernetes\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857183 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ghm\" (UniqueName: \"kubernetes.io/projected/40c29d71-2d2c-4206-8b69-7023028bc594-kube-api-access-j2ghm\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857205 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jcxr\" (UniqueName: \"kubernetes.io/projected/26288be6-4e7e-4bc3-b559-1a6808a040ac-kube-api-access-5jcxr\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857235 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-socket-dir-parent\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysconfig\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857251 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-modprobe-d\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857259 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-cni-bin\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-socket-dir-parent\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-daemon-config\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857329 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-host\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-host\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-kubernetes\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857370 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-cni-multus\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-cni-bin\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857395 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-kubelet\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.857535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-cni-multus\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857460 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-var-lib-kubelet\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-var-lib-kubelet\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-var-lib-kubelet\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857504 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40c29d71-2d2c-4206-8b69-7023028bc594-tmp\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-netns\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857576 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40c29d71-2d2c-4206-8b69-7023028bc594-etc-tuned\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-netns\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857620 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-cnibin\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-cnibin\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26288be6-4e7e-4bc3-b559-1a6808a040ac-cni-binary-copy\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857676 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-conf-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857698 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-multus-certs\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857714 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-hostroot\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857720 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-conf-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857744 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-run\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-host-run-multus-certs\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-run\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-hostroot\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858203 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857812 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-cni-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858755 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857848 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysctl-conf\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.858755 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26288be6-4e7e-4bc3-b559-1a6808a040ac-multus-cni-dir\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.858755 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.857959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40c29d71-2d2c-4206-8b69-7023028bc594-etc-sysctl-conf\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.859781 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.859763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40c29d71-2d2c-4206-8b69-7023028bc594-tmp\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.859844 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.859801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40c29d71-2d2c-4206-8b69-7023028bc594-etc-tuned\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.865346 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.865330 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:16.865346 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.865346 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:16.865462 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.865357 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:16.865462 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:16.865399 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:16:17.36538684 +0000 UTC m=+2.189150702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:16.867059 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.867041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ghm\" (UniqueName: \"kubernetes.io/projected/40c29d71-2d2c-4206-8b69-7023028bc594-kube-api-access-j2ghm\") pod \"tuned-dtdmf\" (UID: \"40c29d71-2d2c-4206-8b69-7023028bc594\") " pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:16.871762 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.871746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jcxr\" (UniqueName: \"kubernetes.io/projected/26288be6-4e7e-4bc3-b559-1a6808a040ac-kube-api-access-5jcxr\") pod \"multus-xlg6c\" (UID: \"26288be6-4e7e-4bc3-b559-1a6808a040ac\") " pod="openshift-multus/multus-xlg6c" Apr 17 11:16:16.979520 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:16.979441 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mh2fr" Apr 17 11:16:16.985788 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:16.985766 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0998c63_b88c_4e5d_b5f5_4d1e823dda43.slice/crio-9a4459e48af5ddb5a59fa1d037361e107a21f7506f5a88a511146039b17a5a31 WatchSource:0}: Error finding container 9a4459e48af5ddb5a59fa1d037361e107a21f7506f5a88a511146039b17a5a31: Status 404 returned error can't find the container with id 9a4459e48af5ddb5a59fa1d037361e107a21f7506f5a88a511146039b17a5a31 Apr 17 11:16:17.003717 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.003696 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bltmr" Apr 17 11:16:17.009042 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.009020 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4672b1_7b40_4c9b_824a_8a50e03d7175.slice/crio-1633dc736ca3127b161250a308dce3c385ed45c1dee3bc667f6686614c171652 WatchSource:0}: Error finding container 1633dc736ca3127b161250a308dce3c385ed45c1dee3bc667f6686614c171652: Status 404 returned error can't find the container with id 1633dc736ca3127b161250a308dce3c385ed45c1dee3bc667f6686614c171652 Apr 17 11:16:17.020883 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.020865 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6268l" Apr 17 11:16:17.026848 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.026825 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1db6e3_ccc9_4ae6_90b9_340c0db5f049.slice/crio-4b9f08988a3ae030d82ad15a40f64de0d3606fc2f93293b4a7406a35044779db WatchSource:0}: Error finding container 4b9f08988a3ae030d82ad15a40f64de0d3606fc2f93293b4a7406a35044779db: Status 404 returned error can't find the container with id 4b9f08988a3ae030d82ad15a40f64de0d3606fc2f93293b4a7406a35044779db Apr 17 11:16:17.041960 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.041940 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:17.046700 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.046684 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" Apr 17 11:16:17.047475 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.047380 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4216bf0_aee8_41ef_9cd7_4faf142a0459.slice/crio-c766730d7f7b3cc9a5cbb4f3d421a8ef89af623dc5f827e1f6a29461477196d6 WatchSource:0}: Error finding container c766730d7f7b3cc9a5cbb4f3d421a8ef89af623dc5f827e1f6a29461477196d6: Status 404 returned error can't find the container with id c766730d7f7b3cc9a5cbb4f3d421a8ef89af623dc5f827e1f6a29461477196d6 Apr 17 11:16:17.053376 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.053336 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041f21a4_6d6f_4c96_b0d3_6fa79b44ba99.slice/crio-ab526d4545a09424bdd8de91c772ea71fdd4c480260c63e08da30d63bb15758c WatchSource:0}: Error finding container ab526d4545a09424bdd8de91c772ea71fdd4c480260c63e08da30d63bb15758c: Status 404 returned error can't find the container with id ab526d4545a09424bdd8de91c772ea71fdd4c480260c63e08da30d63bb15758c Apr 17 11:16:17.102608 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.102573 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" Apr 17 11:16:17.107168 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.107148 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlg6c" Apr 17 11:16:17.108372 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.108354 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c29d71_2d2c_4206_8b69_7023028bc594.slice/crio-e8a4b0a4cf4c7ba97d753c3f107dadba7c89b6683a481b936a112402b9d5755b WatchSource:0}: Error finding container e8a4b0a4cf4c7ba97d753c3f107dadba7c89b6683a481b936a112402b9d5755b: Status 404 returned error can't find the container with id e8a4b0a4cf4c7ba97d753c3f107dadba7c89b6683a481b936a112402b9d5755b Apr 17 11:16:17.113145 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.113127 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26288be6_4e7e_4bc3_b559_1a6808a040ac.slice/crio-1f3b31e6c1bc4d7eb00b53915bbdbefdd7dbd3aa75c124fbe9149b57288fddb6 WatchSource:0}: Error finding container 1f3b31e6c1bc4d7eb00b53915bbdbefdd7dbd3aa75c124fbe9149b57288fddb6: Status 404 returned error can't find the container with id 1f3b31e6c1bc4d7eb00b53915bbdbefdd7dbd3aa75c124fbe9149b57288fddb6 Apr 17 11:16:17.230757 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:17.230670 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f736420_e15c_4069_947e_5fba427835fb.slice/crio-3bc4c126bbdaf6e163c3b1227ada7bae2b4014388cf2ff8d78d51c064669bb3a WatchSource:0}: Error finding container 3bc4c126bbdaf6e163c3b1227ada7bae2b4014388cf2ff8d78d51c064669bb3a: Status 404 returned error can't find the container with id 3bc4c126bbdaf6e163c3b1227ada7bae2b4014388cf2ff8d78d51c064669bb3a Apr 17 11:16:17.260856 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.260626 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:17.263192 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:17.263166 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:17.263290 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:17.263259 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:18.263236346 +0000 UTC m=+3.087000206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:17.462576 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.462002 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:17.462576 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:17.462156 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:17.462576 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:17.462174 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:17.462576 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:17.462187 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:17.462576 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:17.462243 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:16:18.46222489 +0000 UTC m=+3.285988762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:17.698769 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.698671 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 11:11:16 +0000 UTC" deadline="2027-09-16 11:41:21.123310396 +0000 UTC" Apr 17 11:16:17.698769 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.698716 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12408h25m3.424598695s" Apr 17 11:16:17.797635 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.797609 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:17.815978 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.815895 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerStarted","Data":"3bc4c126bbdaf6e163c3b1227ada7bae2b4014388cf2ff8d78d51c064669bb3a"} Apr 17 11:16:17.820107 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.820069 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlg6c" event={"ID":"26288be6-4e7e-4bc3-b559-1a6808a040ac","Type":"ContainerStarted","Data":"1f3b31e6c1bc4d7eb00b53915bbdbefdd7dbd3aa75c124fbe9149b57288fddb6"} Apr 17 11:16:17.827283 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.827105 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" event={"ID":"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99","Type":"ContainerStarted","Data":"ab526d4545a09424bdd8de91c772ea71fdd4c480260c63e08da30d63bb15758c"} Apr 17 11:16:17.840256 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.840227 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"c766730d7f7b3cc9a5cbb4f3d421a8ef89af623dc5f827e1f6a29461477196d6"} Apr 17 11:16:17.847048 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.847018 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6268l" event={"ID":"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049","Type":"ContainerStarted","Data":"4b9f08988a3ae030d82ad15a40f64de0d3606fc2f93293b4a7406a35044779db"} Apr 17 11:16:17.850021 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.849989 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" event={"ID":"f45d2f30dc1d7411364cb73a6c4d3be0","Type":"ContainerStarted","Data":"c3c6cbc1ce06f33389422a88bbf2cbaa5310bd98439f6ab31c760d6e7544701b"} Apr 17 11:16:17.866176 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.866131 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bkvlp" event={"ID":"4ab650d2-2c24-4fe2-a077-de6d2b170818","Type":"ContainerStarted","Data":"276902a8faf3c7e36d074f34d7aaee89c14e8b041ba12ebf168224b07fbaf690"} Apr 17 11:16:17.888214 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.888183 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" event={"ID":"40c29d71-2d2c-4206-8b69-7023028bc594","Type":"ContainerStarted","Data":"e8a4b0a4cf4c7ba97d753c3f107dadba7c89b6683a481b936a112402b9d5755b"} Apr 17 11:16:17.892840 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.892812 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bltmr" event={"ID":"0a4672b1-7b40-4c9b-824a-8a50e03d7175","Type":"ContainerStarted","Data":"1633dc736ca3127b161250a308dce3c385ed45c1dee3bc667f6686614c171652"} Apr 17 11:16:17.903295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.903264 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mh2fr" event={"ID":"f0998c63-b88c-4e5d-b5f5-4d1e823dda43","Type":"ContainerStarted","Data":"9a4459e48af5ddb5a59fa1d037361e107a21f7506f5a88a511146039b17a5a31"} Apr 17 11:16:17.906400 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.906372 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" event={"ID":"8c94f84787f30fa393199c7cbd48cbbc","Type":"ContainerStarted","Data":"ff2763167c95166fcca78e6f868a4309e0e9d4c228448ee0f4b3f49f76834db3"} Apr 17 11:16:17.936331 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:17.936285 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:18.241868 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.241840 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 11:16:18.268155 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.268123 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:18.268382 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.268267 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:18.268382 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.268326 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:20.268308821 +0000 UTC m=+5.092072680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:18.470129 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.470072 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:18.470281 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.470220 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:18.470281 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.470243 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:18.470281 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.470255 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:18.470485 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.470319 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:16:20.470301612 +0000 UTC m=+5.294065481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:18.699700 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.699597 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 11:11:16 +0000 UTC" deadline="2028-01-26 11:13:15.452250418 +0000 UTC" Apr 17 11:16:18.699700 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.699640 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15575h56m56.752615091s" Apr 17 11:16:18.794809 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.794782 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:18.794981 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.794903 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:18.795348 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:18.795326 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:18.795467 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:18.795428 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:20.285943 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:20.285330 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:20.285943 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.285495 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:20.285943 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.285560 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:24.285542121 +0000 UTC m=+9.109305985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:20.487160 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:20.487119 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:20.487326 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.487274 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:20.487326 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.487294 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:20.487326 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.487306 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:20.487491 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.487362 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:16:24.48734439 +0000 UTC m=+9.311108259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:20.794323 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:20.794291 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:20.794506 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.794417 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:20.794883 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:20.794720 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:20.794883 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:20.794845 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:22.794703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:22.794670 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:22.795139 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:22.794797 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:22.795224 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:22.795207 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:22.795337 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:22.795317 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:24.315943 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:24.315850 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:24.316346 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.315982 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:24.316346 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.316049 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:32.316029622 +0000 UTC m=+17.139793486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:24.517912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:24.517216 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:24.517912 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.517380 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:24.517912 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.517397 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:24.517912 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.517409 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:24.517912 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.517465 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:16:32.517446425 +0000 UTC m=+17.341210291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:24.794120 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:24.794044 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:24.794273 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:24.794043 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:24.794273 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.794192 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:24.794273 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:24.794264 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:26.794849 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:26.794763 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:26.794849 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:26.794812 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:26.795255 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:26.794886 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:26.795255 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:26.794972 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:28.793928 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:28.793897 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:28.794346 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:28.793896 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:28.794346 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:28.794036 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:28.794346 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:28.794116 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:30.794472 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:30.794432 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:30.794912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:30.794434 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:30.794912 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:30.794552 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:30.794912 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:30.794676 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:32.373063 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:32.373017 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:32.373631 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.373173 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:32.373631 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.373246 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:48.373225086 +0000 UTC m=+33.196988966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:32.573839 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:32.573807 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:32.574029 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.573995 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:32.574029 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.574021 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:32.574112 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.574034 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:32.574112 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.574095 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:16:48.57407708 +0000 UTC m=+33.397840940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:32.794663 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:32.794629 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:32.794840 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:32.794633 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:32.794840 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.794752 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:32.794840 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:32.794805 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:34.794278 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.794256 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:34.794606 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.794304 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:34.794606 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:34.794414 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:34.794606 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:34.794504 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:34.947976 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.947766 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" event={"ID":"40c29d71-2d2c-4206-8b69-7023028bc594","Type":"ContainerStarted","Data":"dde9f3f94875dc1fa815c9eefc4f8b557555259647d8a27ae8777ef1d76e4a4f"} Apr 17 11:16:34.949533 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.949505 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" event={"ID":"8c94f84787f30fa393199c7cbd48cbbc","Type":"ContainerStarted","Data":"192311e5808f0e60cc1bad8e8e67066da24ef346c6d19cbe1163a92d1347dbfc"} Apr 17 11:16:34.951891 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.951870 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"cddb7c82bde7497bc22c456be2d062245071e87a53cbc24ee782daa85225a5cc"} Apr 17 11:16:34.951990 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.951896 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"df30326417c5b553cb0860450fdd87783bdae7e61d3dc91eb1b1cd3ba3de3248"} Apr 17 11:16:34.966142 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.966096 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dtdmf" podStartSLOduration=1.6609418969999998 podStartE2EDuration="18.966085774s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.110298456 +0000 UTC m=+1.934062318" lastFinishedPulling="2026-04-17 11:16:34.415442323 +0000 UTC m=+19.239206195" observedRunningTime="2026-04-17 11:16:34.966051095 +0000 UTC m=+19.789814975" watchObservedRunningTime="2026-04-17 11:16:34.966085774 +0000 UTC m=+19.789849653" Apr 17 11:16:34.981466 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:34.981431 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-188.ec2.internal" podStartSLOduration=18.981420573 podStartE2EDuration="18.981420573s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 11:16:34.980607476 +0000 UTC m=+19.804371352" watchObservedRunningTime="2026-04-17 11:16:34.981420573 +0000 UTC m=+19.805184453" Apr 17 11:16:35.956028 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.955787 2576 generic.go:358] "Generic (PLEG): container finished" podID="1f736420-e15c-4069-947e-5fba427835fb" containerID="929d5da2698224615063aa3a6bdcf627dc81fc1f758f0881c0eb34b5bb71f1e3" exitCode=0 Apr 17 11:16:35.956981 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.955883 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerDied","Data":"929d5da2698224615063aa3a6bdcf627dc81fc1f758f0881c0eb34b5bb71f1e3"} Apr 17 11:16:35.957956 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.957479 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlg6c" event={"ID":"26288be6-4e7e-4bc3-b559-1a6808a040ac","Type":"ContainerStarted","Data":"ca238a76fdc17e98f0c19d0d0526d7b2669e492dfb6f5dac0b474a6e87ebf801"} Apr 17 11:16:35.958995 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.958970 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" event={"ID":"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99","Type":"ContainerStarted","Data":"6ce1c75c78b2ef4a0d0264762eed4e0537a039e4f81ce83a8e98c85571c024e6"} Apr 17 11:16:35.961944 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.961925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:16:35.962336 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.962317 2576 generic.go:358] "Generic (PLEG): container finished" podID="d4216bf0-aee8-41ef-9cd7-4faf142a0459" containerID="cddb7c82bde7497bc22c456be2d062245071e87a53cbc24ee782daa85225a5cc" exitCode=1 Apr 17 11:16:35.962413 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.962373 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerDied","Data":"cddb7c82bde7497bc22c456be2d062245071e87a53cbc24ee782daa85225a5cc"} Apr 17 11:16:35.962413 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.962395 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"1ee56309689801f7ea4685eb794c1685e30bb4d4047bd808d983896382beb989"} Apr 17 11:16:35.962413 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.962411 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"55f72de2cd58e23cb022cdf61b7de0573c2414867c3a216ac478845f93c0719a"} Apr 17 11:16:35.962533 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.962420 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"a790f906a5a7f33303425050a8dc30fdc99d34bc1578adc3000ceb4a1297138b"} Apr 17 11:16:35.962533 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.962429 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"cff196191717e92c9f2497be2b79d01436f24fac8cc900d677da1068ce72768d"} Apr 17 11:16:35.963943 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.963924 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6268l" event={"ID":"9f1db6e3-ccc9-4ae6-90b9-340c0db5f049","Type":"ContainerStarted","Data":"87a73222d30d939bec24f67ef3e66ba2c5f56a25ee412fa8f046b4291b0a4023"} Apr 17 11:16:35.965332 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.965302 2576 generic.go:358] "Generic (PLEG): container finished" podID="f45d2f30dc1d7411364cb73a6c4d3be0" containerID="276b8a8d95f23002dd5a6cf678a2b06faf46e9aec4f3197800478769830eeae2" exitCode=0 Apr 17 11:16:35.965423 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.965353 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" event={"ID":"f45d2f30dc1d7411364cb73a6c4d3be0","Type":"ContainerDied","Data":"276b8a8d95f23002dd5a6cf678a2b06faf46e9aec4f3197800478769830eeae2"} Apr 17 11:16:35.966783 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.966764 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bkvlp" event={"ID":"4ab650d2-2c24-4fe2-a077-de6d2b170818","Type":"ContainerStarted","Data":"1da1a2eaa9517cfa36bde8ab92c8841ae1f90dd8b0018e864283863a0299de08"} Apr 17 11:16:35.968429 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.968401 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bltmr" event={"ID":"0a4672b1-7b40-4c9b-824a-8a50e03d7175","Type":"ContainerStarted","Data":"cfc02095c1b12e4795d8a9770b1c69afb4f45b3168a932788d08aed6e6923b77"} Apr 17 11:16:35.969850 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.969795 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mh2fr" event={"ID":"f0998c63-b88c-4e5d-b5f5-4d1e823dda43","Type":"ContainerStarted","Data":"fd6587e86890aeac0409e92bfd8960f1928de370ef350626c8d406c50a0b9e63"} Apr 17 11:16:35.994056 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:35.994016 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xlg6c" podStartSLOduration=2.234094634 podStartE2EDuration="19.994001121s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.114430906 +0000 UTC m=+1.938194764" lastFinishedPulling="2026-04-17 11:16:34.874337388 +0000 UTC m=+19.698101251" observedRunningTime="2026-04-17 11:16:35.993855277 +0000 UTC m=+20.817619169" watchObservedRunningTime="2026-04-17 11:16:35.994001121 +0000 UTC m=+20.817765002" Apr 17 11:16:36.030800 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.030744 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6268l" podStartSLOduration=3.552768378 podStartE2EDuration="21.030726634s" podCreationTimestamp="2026-04-17 11:16:15 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.029399925 +0000 UTC m=+1.853163784" lastFinishedPulling="2026-04-17 11:16:34.507358178 +0000 UTC m=+19.331122040" observedRunningTime="2026-04-17 11:16:36.030281434 +0000 UTC m=+20.854045315" watchObservedRunningTime="2026-04-17 11:16:36.030726634 +0000 UTC m=+20.854490515" Apr 17 11:16:36.031104 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.030968 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mh2fr" podStartSLOduration=3.603086501 podStartE2EDuration="21.030959798s" podCreationTimestamp="2026-04-17 11:16:15 +0000 UTC" firstStartedPulling="2026-04-17 11:16:16.987378267 +0000 UTC m=+1.811142125" lastFinishedPulling="2026-04-17 11:16:34.41525155 +0000 UTC m=+19.239015422" observedRunningTime="2026-04-17 11:16:36.012928636 +0000 UTC m=+20.836692516" watchObservedRunningTime="2026-04-17 11:16:36.030959798 +0000 UTC m=+20.854723680" Apr 17 11:16:36.043671 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.043054 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bkvlp" podStartSLOduration=2.444701271 podStartE2EDuration="20.043036766s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:16:16.817004145 +0000 UTC m=+1.640768003" lastFinishedPulling="2026-04-17 11:16:34.415339635 +0000 UTC m=+19.239103498" observedRunningTime="2026-04-17 11:16:36.042718414 +0000 UTC m=+20.866482308" watchObservedRunningTime="2026-04-17 11:16:36.043036766 +0000 UTC m=+20.866800647" Apr 17 11:16:36.086009 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.085919 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-bltmr" podStartSLOduration=3.596569341 podStartE2EDuration="21.085900436s" podCreationTimestamp="2026-04-17 11:16:15 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.010508036 +0000 UTC m=+1.834271895" lastFinishedPulling="2026-04-17 11:16:34.499839116 +0000 UTC m=+19.323602990" observedRunningTime="2026-04-17 11:16:36.084537536 +0000 UTC m=+20.908301419" watchObservedRunningTime="2026-04-17 11:16:36.085900436 +0000 UTC m=+20.909664315" Apr 17 11:16:36.414169 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.413969 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 17 11:16:36.719400 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.719224 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-17T11:16:36.414166782Z","UUID":"6993802d-1cec-4ffd-8aa2-40dffa21e6ef","Handler":null,"Name":"","Endpoint":""} Apr 17 11:16:36.722618 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.722593 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 17 11:16:36.722618 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.722622 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 17 11:16:36.794648 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.794616 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:36.794822 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:36.794766 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:36.795099 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.794616 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:36.795213 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:36.795179 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:36.974052 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.973974 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" event={"ID":"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99","Type":"ContainerStarted","Data":"2fde303ada10c13c6d4b75f543a0f622317804bc5b9b0bdeb20bc99d9a5b82ff"} Apr 17 11:16:36.976119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.976082 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" event={"ID":"f45d2f30dc1d7411364cb73a6c4d3be0","Type":"ContainerStarted","Data":"ecc0bcde2907cfdecfa1cfc1825c08c4fe14dac7e08a849f3a25d8f50621fcd5"} Apr 17 11:16:36.993617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:36.993554 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-188.ec2.internal" podStartSLOduration=20.993538651 podStartE2EDuration="20.993538651s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 11:16:36.993269685 +0000 UTC m=+21.817033565" watchObservedRunningTime="2026-04-17 11:16:36.993538651 +0000 UTC m=+21.817302532" Apr 17 11:16:37.979476 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:37.979436 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" event={"ID":"041f21a4-6d6f-4c96-b0d3-6fa79b44ba99","Type":"ContainerStarted","Data":"7b8f7fe470bbdc7a9c1f342c5012ed066f00b5fc4591ce3bf2bcca18dcbcec71"} Apr 17 11:16:37.982437 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:37.982415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:16:37.982769 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:37.982746 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"49c2a98228d1dde90cb6fb83e875d42c549bf3938b58c86c8e240531a5df41b6"} Apr 17 11:16:38.004307 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:38.004263 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2ts6" podStartSLOduration=1.895698291 podStartE2EDuration="22.004250756s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.054626534 +0000 UTC m=+1.878390392" lastFinishedPulling="2026-04-17 11:16:37.163178982 +0000 UTC m=+21.986942857" observedRunningTime="2026-04-17 11:16:38.004068191 +0000 UTC m=+22.827832071" watchObservedRunningTime="2026-04-17 11:16:38.004250756 +0000 UTC m=+22.828014635" Apr 17 11:16:38.794060 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:38.794025 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:38.794243 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:38.794026 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:38.794243 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:38.794161 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:38.794243 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:38.794227 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:39.638034 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.637958 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:39.638902 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.638882 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:39.988227 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.988110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:16:39.988561 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.988535 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"1cdc00838a88148189923a0e9ec09a90e940f3effde8ea4a50a4b9fb2341d9c5"} Apr 17 11:16:39.988958 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.988940 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:39.989061 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.988967 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:39.989061 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.988970 2576 scope.go:117] "RemoveContainer" containerID="cddb7c82bde7497bc22c456be2d062245071e87a53cbc24ee782daa85225a5cc" Apr 17 11:16:39.989264 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:39.989247 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bkvlp" Apr 17 11:16:40.004017 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.003982 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:40.272318 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.272296 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:40.794652 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.794628 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:40.795028 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.794667 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:40.795028 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:40.794734 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:40.795028 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:40.794800 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:40.992012 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.991983 2576 generic.go:358] "Generic (PLEG): container finished" podID="1f736420-e15c-4069-947e-5fba427835fb" containerID="abad85f8ce0d12ca6c59b2d0bcd97b2507e53fca178c9ba6d04c4426d728842e" exitCode=0 Apr 17 11:16:40.992136 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.992058 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerDied","Data":"abad85f8ce0d12ca6c59b2d0bcd97b2507e53fca178c9ba6d04c4426d728842e"} Apr 17 11:16:40.995134 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.995115 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:16:40.995481 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.995461 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" event={"ID":"d4216bf0-aee8-41ef-9cd7-4faf142a0459","Type":"ContainerStarted","Data":"0199dcba2efcd97f8d21e308d720515f4f9053e855f18b007bb952680eb2fc07"} Apr 17 11:16:40.995811 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:40.995778 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:41.011198 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:41.011180 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:16:41.042007 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:41.041971 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" podStartSLOduration=8.580391876 podStartE2EDuration="26.041960939s" podCreationTimestamp="2026-04-17 11:16:15 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.048617904 +0000 UTC m=+1.872381766" lastFinishedPulling="2026-04-17 11:16:34.510186971 +0000 UTC m=+19.333950829" observedRunningTime="2026-04-17 11:16:41.041708196 +0000 UTC m=+25.865472076" watchObservedRunningTime="2026-04-17 11:16:41.041960939 +0000 UTC m=+25.865724853" Apr 17 11:16:41.998846 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:41.998817 2576 generic.go:358] "Generic (PLEG): container finished" podID="1f736420-e15c-4069-947e-5fba427835fb" containerID="3bdc49d76bedad438359a54a0da15e92d83d94cc2d7aae2ba89472091245fa11" exitCode=0 Apr 17 11:16:41.999213 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:41.998904 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerDied","Data":"3bdc49d76bedad438359a54a0da15e92d83d94cc2d7aae2ba89472091245fa11"} Apr 17 11:16:42.794657 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:42.794530 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:42.794657 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:42.794530 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:42.794824 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:42.794666 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:42.794824 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:42.794701 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:43.002301 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:43.002129 2576 generic.go:358] "Generic (PLEG): container finished" podID="1f736420-e15c-4069-947e-5fba427835fb" containerID="5696a38da40d4348554dd4006690b2d0d1629b356ca4e22ac45a2dd1439f7bfb" exitCode=0 Apr 17 11:16:43.002704 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:43.002209 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerDied","Data":"5696a38da40d4348554dd4006690b2d0d1629b356ca4e22ac45a2dd1439f7bfb"} Apr 17 11:16:44.733863 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.733832 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8zdsn"] Apr 17 11:16:44.736614 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.736574 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.736715 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:44.736670 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zdsn" podUID="0786bd97-6959-432d-b9d0-e710ab215ae2" Apr 17 11:16:44.794240 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.794201 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:44.794378 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:44.794306 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:44.794435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.794396 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:44.794521 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:44.794503 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:44.879907 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.879873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.880052 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.879992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0786bd97-6959-432d-b9d0-e710ab215ae2-kubelet-config\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.880052 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.880017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0786bd97-6959-432d-b9d0-e710ab215ae2-dbus\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.980700 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.980665 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0786bd97-6959-432d-b9d0-e710ab215ae2-kubelet-config\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.980700 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.980702 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0786bd97-6959-432d-b9d0-e710ab215ae2-dbus\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.980893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.980757 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.980893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.980792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0786bd97-6959-432d-b9d0-e710ab215ae2-kubelet-config\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:44.980893 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:44.980857 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:44.981020 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:44.980909 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret podName:0786bd97-6959-432d-b9d0-e710ab215ae2 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:45.480891375 +0000 UTC m=+30.304655243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret") pod "global-pull-secret-syncer-8zdsn" (UID: "0786bd97-6959-432d-b9d0-e710ab215ae2") : object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:44.981020 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:44.980982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0786bd97-6959-432d-b9d0-e710ab215ae2-dbus\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:45.485052 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:45.485013 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:45.485338 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:45.485147 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:45.485338 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:45.485212 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret podName:0786bd97-6959-432d-b9d0-e710ab215ae2 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:46.48519452 +0000 UTC m=+31.308958379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret") pod "global-pull-secret-syncer-8zdsn" (UID: "0786bd97-6959-432d-b9d0-e710ab215ae2") : object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:46.094815 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.094768 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8zdsn"] Apr 17 11:16:46.095654 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.094907 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:46.095654 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:46.095015 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zdsn" podUID="0786bd97-6959-432d-b9d0-e710ab215ae2" Apr 17 11:16:46.097413 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.097320 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47s58"] Apr 17 11:16:46.097533 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.097439 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:46.097623 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:46.097541 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:46.098146 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.098123 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j9jfg"] Apr 17 11:16:46.098615 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.098229 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:46.098615 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:46.098324 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:46.493087 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:46.493060 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:46.493217 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:46.493188 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:46.493291 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:46.493258 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret podName:0786bd97-6959-432d-b9d0-e710ab215ae2 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:48.493239927 +0000 UTC m=+33.317003804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret") pod "global-pull-secret-syncer-8zdsn" (UID: "0786bd97-6959-432d-b9d0-e710ab215ae2") : object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:47.794124 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:47.794094 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:47.794646 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:47.794223 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:47.794646 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:47.794233 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:47.794646 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:47.794259 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:47.794646 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:47.794329 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:47.794646 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:47.794410 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zdsn" podUID="0786bd97-6959-432d-b9d0-e710ab215ae2" Apr 17 11:16:48.407504 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:48.407341 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:48.407672 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.407475 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:48.407672 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.407578 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs podName:87c84598-6174-4e54-9961-2dc53effa865 nodeName:}" failed. No retries permitted until 2026-04-17 11:17:20.407563912 +0000 UTC m=+65.231327771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs") pod "network-metrics-daemon-47s58" (UID: "87c84598-6174-4e54-9961-2dc53effa865") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 11:16:48.508540 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:48.508508 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:48.508688 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.508632 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:48.508766 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.508698 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret podName:0786bd97-6959-432d-b9d0-e710ab215ae2 nodeName:}" failed. No retries permitted until 2026-04-17 11:16:52.508681457 +0000 UTC m=+37.332445322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret") pod "global-pull-secret-syncer-8zdsn" (UID: "0786bd97-6959-432d-b9d0-e710ab215ae2") : object "kube-system"/"original-pull-secret" not registered Apr 17 11:16:48.609599 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:48.609556 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:48.609701 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.609685 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 11:16:48.609701 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.609699 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 11:16:48.609774 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.609708 2576 projected.go:194] Error preparing data for projected volume kube-api-access-p6qq8 for pod openshift-network-diagnostics/network-check-target-j9jfg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:48.609774 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:48.609744 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8 podName:ce81cfef-ea4a-46be-8482-af5eac179f0b nodeName:}" failed. No retries permitted until 2026-04-17 11:17:20.609734158 +0000 UTC m=+65.433498020 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6qq8" (UniqueName: "kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8") pod "network-check-target-j9jfg" (UID: "ce81cfef-ea4a-46be-8482-af5eac179f0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 11:16:49.014472 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:49.014447 2576 generic.go:358] "Generic (PLEG): container finished" podID="1f736420-e15c-4069-947e-5fba427835fb" containerID="9511307913f359f31aabcff0e5ba1f99c70f48bac54096cf16ee69cc006008a4" exitCode=0 Apr 17 11:16:49.014762 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:49.014497 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerDied","Data":"9511307913f359f31aabcff0e5ba1f99c70f48bac54096cf16ee69cc006008a4"} Apr 17 11:16:49.796266 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:49.796241 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:49.796425 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:49.796244 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:49.796425 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:49.796244 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:49.796526 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:49.796452 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47s58" podUID="87c84598-6174-4e54-9961-2dc53effa865" Apr 17 11:16:49.796526 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:49.796474 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j9jfg" podUID="ce81cfef-ea4a-46be-8482-af5eac179f0b" Apr 17 11:16:49.796526 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:16:49.796333 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zdsn" podUID="0786bd97-6959-432d-b9d0-e710ab215ae2" Apr 17 11:16:50.019083 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.019055 2576 generic.go:358] "Generic (PLEG): container finished" podID="1f736420-e15c-4069-947e-5fba427835fb" containerID="c222f7e5dd63fcbaf7064d5170785c4c9ae49f9aacb6e7d5d91b6ba4cdf593f7" exitCode=0 Apr 17 11:16:50.019477 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.019121 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerDied","Data":"c222f7e5dd63fcbaf7064d5170785c4c9ae49f9aacb6e7d5d91b6ba4cdf593f7"} Apr 17 11:16:50.019526 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.019481 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-188.ec2.internal" event="NodeReady" Apr 17 11:16:50.019599 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.019571 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 17 11:16:50.054353 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.053686 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7664589ff7-rzqsr"] Apr 17 11:16:50.077680 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.077657 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2zxhl"] Apr 17 11:16:50.077846 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.077826 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.082566 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.082538 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Apr 17 11:16:50.082727 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.082704 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Apr 17 11:16:50.082824 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.082710 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Apr 17 11:16:50.084036 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.084004 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7fq9z\"" Apr 17 11:16:50.090462 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.090431 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Apr 17 11:16:50.091711 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.090705 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7664589ff7-rzqsr"] Apr 17 11:16:50.091711 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.090736 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7jc5j"] Apr 17 11:16:50.091711 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.090951 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.093572 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.093551 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 17 11:16:50.093685 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.093575 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 17 11:16:50.093855 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.093835 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lbntp\"" Apr 17 11:16:50.095673 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.095654 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 17 11:16:50.105530 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.105510 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2zxhl"] Apr 17 11:16:50.105626 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.105538 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jc5j"] Apr 17 11:16:50.105676 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.105662 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.110500 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.110470 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 17 11:16:50.110801 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.110779 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 17 11:16:50.110903 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.110853 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr57f\"" Apr 17 11:16:50.111176 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.111157 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 17 11:16:50.111267 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.111190 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 17 11:16:50.174271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.174250 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lqjk4"] Apr 17 11:16:50.193112 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.193091 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqjk4"] Apr 17 11:16:50.193228 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.193216 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.196107 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.196088 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f8bg7\"" Apr 17 11:16:50.196831 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.196816 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 17 11:16:50.197560 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.197546 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 17 11:16:50.218525 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b26d8334-aad9-41e4-8307-6a2aa8f2c818-trusted-ca\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.218645 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b26d8334-aad9-41e4-8307-6a2aa8f2c818-installation-pull-secrets\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.218645 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87h4\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-kube-api-access-k87h4\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.218645 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d908fd92-e82b-4cde-8075-72fd1e7a7862-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218648 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d908fd92-e82b-4cde-8075-72fd1e7a7862-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ae08f7-e218-44e4-a0d0-01d83fb2644a-cert\") pod \"ingress-canary-2zxhl\" (UID: \"c9ae08f7-e218-44e4-a0d0-01d83fb2644a\") " pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d908fd92-e82b-4cde-8075-72fd1e7a7862-crio-socket\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hx49\" (UniqueName: \"kubernetes.io/projected/d908fd92-e82b-4cde-8075-72fd1e7a7862-kube-api-access-4hx49\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b26d8334-aad9-41e4-8307-6a2aa8f2c818-image-registry-private-configuration\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218785 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-registry-tls\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.218832 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsfjf\" (UniqueName: \"kubernetes.io/projected/c9ae08f7-e218-44e4-a0d0-01d83fb2644a-kube-api-access-qsfjf\") pod \"ingress-canary-2zxhl\" (UID: \"c9ae08f7-e218-44e4-a0d0-01d83fb2644a\") " pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.219124 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218900 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b26d8334-aad9-41e4-8307-6a2aa8f2c818-ca-trust-extracted\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.219124 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-bound-sa-token\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.219124 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d908fd92-e82b-4cde-8075-72fd1e7a7862-data-volume\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.219124 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.218992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b26d8334-aad9-41e4-8307-6a2aa8f2c818-registry-certificates\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.319359 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319285 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b26d8334-aad9-41e4-8307-6a2aa8f2c818-trusted-ca\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.319359 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319316 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b26d8334-aad9-41e4-8307-6a2aa8f2c818-installation-pull-secrets\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.319359 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-metrics-tls\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.319617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319390 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k87h4\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-kube-api-access-k87h4\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.319617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-tmp-dir\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.319617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319456 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d908fd92-e82b-4cde-8075-72fd1e7a7862-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.319617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319475 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d908fd92-e82b-4cde-8075-72fd1e7a7862-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.319617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319517 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ae08f7-e218-44e4-a0d0-01d83fb2644a-cert\") pod \"ingress-canary-2zxhl\" (UID: \"c9ae08f7-e218-44e4-a0d0-01d83fb2644a\") " pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.319617 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-config-volume\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.319866 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgs5h\" (UniqueName: \"kubernetes.io/projected/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-kube-api-access-sgs5h\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.319866 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319777 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d908fd92-e82b-4cde-8075-72fd1e7a7862-crio-socket\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.319866 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319827 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hx49\" (UniqueName: \"kubernetes.io/projected/d908fd92-e82b-4cde-8075-72fd1e7a7862-kube-api-access-4hx49\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.319866 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319856 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b26d8334-aad9-41e4-8307-6a2aa8f2c818-image-registry-private-configuration\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320032 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319887 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-registry-tls\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320032 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.319923 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsfjf\" (UniqueName: \"kubernetes.io/projected/c9ae08f7-e218-44e4-a0d0-01d83fb2644a-kube-api-access-qsfjf\") pod \"ingress-canary-2zxhl\" (UID: \"c9ae08f7-e218-44e4-a0d0-01d83fb2644a\") " pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.320032 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320002 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b26d8334-aad9-41e4-8307-6a2aa8f2c818-ca-trust-extracted\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320032 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d908fd92-e82b-4cde-8075-72fd1e7a7862-crio-socket\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.320219 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320033 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-bound-sa-token\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320219 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320066 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d908fd92-e82b-4cde-8075-72fd1e7a7862-data-volume\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.320219 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b26d8334-aad9-41e4-8307-6a2aa8f2c818-registry-certificates\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320219 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320207 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d908fd92-e82b-4cde-8075-72fd1e7a7862-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.320997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b26d8334-aad9-41e4-8307-6a2aa8f2c818-ca-trust-extracted\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b26d8334-aad9-41e4-8307-6a2aa8f2c818-registry-certificates\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.320997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.320950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d908fd92-e82b-4cde-8075-72fd1e7a7862-data-volume\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.323871 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.323822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d908fd92-e82b-4cde-8075-72fd1e7a7862-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.323871 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.323835 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b26d8334-aad9-41e4-8307-6a2aa8f2c818-installation-pull-secrets\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.323871 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.323822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b26d8334-aad9-41e4-8307-6a2aa8f2c818-image-registry-private-configuration\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.323871 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.323867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9ae08f7-e218-44e4-a0d0-01d83fb2644a-cert\") pod \"ingress-canary-2zxhl\" (UID: \"c9ae08f7-e218-44e4-a0d0-01d83fb2644a\") " pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.323871 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.323855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-registry-tls\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.327446 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.327422 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-bound-sa-token\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.327929 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.327913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87h4\" (UniqueName: \"kubernetes.io/projected/b26d8334-aad9-41e4-8307-6a2aa8f2c818-kube-api-access-k87h4\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.328338 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.328324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hx49\" (UniqueName: \"kubernetes.io/projected/d908fd92-e82b-4cde-8075-72fd1e7a7862-kube-api-access-4hx49\") pod \"insights-runtime-extractor-7jc5j\" (UID: \"d908fd92-e82b-4cde-8075-72fd1e7a7862\") " pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.329810 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.329791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b26d8334-aad9-41e4-8307-6a2aa8f2c818-trusted-ca\") pod \"image-registry-7664589ff7-rzqsr\" (UID: \"b26d8334-aad9-41e4-8307-6a2aa8f2c818\") " pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.331323 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.331306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsfjf\" (UniqueName: \"kubernetes.io/projected/c9ae08f7-e218-44e4-a0d0-01d83fb2644a-kube-api-access-qsfjf\") pod \"ingress-canary-2zxhl\" (UID: \"c9ae08f7-e218-44e4-a0d0-01d83fb2644a\") " pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.394360 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.394326 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:50.402892 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.402866 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2zxhl" Apr 17 11:16:50.415613 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.415568 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jc5j" Apr 17 11:16:50.420407 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.420387 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-metrics-tls\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.420510 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.420431 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-tmp-dir\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.421628 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.420987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-tmp-dir\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.421628 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.421118 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-config-volume\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.421628 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.421169 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgs5h\" (UniqueName: \"kubernetes.io/projected/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-kube-api-access-sgs5h\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.422028 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.422004 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-config-volume\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.423352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.423320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-metrics-tls\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.429014 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.428976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgs5h\" (UniqueName: \"kubernetes.io/projected/5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa-kube-api-access-sgs5h\") pod \"dns-default-lqjk4\" (UID: \"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa\") " pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.501846 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.501168 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:50.576185 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.576122 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2zxhl"] Apr 17 11:16:50.580095 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:50.580060 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ae08f7_e218_44e4_a0d0_01d83fb2644a.slice/crio-77d457f6d279749125e0e12f015e6c6817337e59befc6f650cb1a623982fc90d WatchSource:0}: Error finding container 77d457f6d279749125e0e12f015e6c6817337e59befc6f650cb1a623982fc90d: Status 404 returned error can't find the container with id 77d457f6d279749125e0e12f015e6c6817337e59befc6f650cb1a623982fc90d Apr 17 11:16:50.580813 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.580782 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jc5j"] Apr 17 11:16:50.581598 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.581556 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7664589ff7-rzqsr"] Apr 17 11:16:50.634190 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:50.634160 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqjk4"] Apr 17 11:16:50.643539 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:50.643515 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4c7d4f_6f43_42d1_bbc0_e5f14e6f89aa.slice/crio-0000702bae88d7bd812c427693e66767142801002e37eb491013abe56e5904ad WatchSource:0}: Error finding container 0000702bae88d7bd812c427693e66767142801002e37eb491013abe56e5904ad: Status 404 returned error can't find the container with id 0000702bae88d7bd812c427693e66767142801002e37eb491013abe56e5904ad Apr 17 11:16:51.023732 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.023500 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" event={"ID":"b26d8334-aad9-41e4-8307-6a2aa8f2c818","Type":"ContainerStarted","Data":"7ddf344eb41dc8108d53f504fd6a2365705f338ab6767cfa7f0715f946da8e53"} Apr 17 11:16:51.024525 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.023743 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" event={"ID":"b26d8334-aad9-41e4-8307-6a2aa8f2c818","Type":"ContainerStarted","Data":"5704ca38a856884e39c69f7f085c01b12cdb33d956e0bdd1fe5c89850ff45a76"} Apr 17 11:16:51.024525 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.023851 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:16:51.025169 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.025128 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2zxhl" event={"ID":"c9ae08f7-e218-44e4-a0d0-01d83fb2644a","Type":"ContainerStarted","Data":"77d457f6d279749125e0e12f015e6c6817337e59befc6f650cb1a623982fc90d"} Apr 17 11:16:51.026541 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.026402 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqjk4" event={"ID":"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa","Type":"ContainerStarted","Data":"0000702bae88d7bd812c427693e66767142801002e37eb491013abe56e5904ad"} Apr 17 11:16:51.031552 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.031524 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" event={"ID":"1f736420-e15c-4069-947e-5fba427835fb","Type":"ContainerStarted","Data":"416310ab37caebdf39024be5eb5d3fcdcff040f3586d04f9c02a4edbead65957"} Apr 17 11:16:51.033352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.033302 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jc5j" event={"ID":"d908fd92-e82b-4cde-8075-72fd1e7a7862","Type":"ContainerStarted","Data":"63370ae09d460db7a1263ea07bcfa24c794786e1f635af3ae8df23d028869f76"} Apr 17 11:16:51.033352 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.033333 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jc5j" event={"ID":"d908fd92-e82b-4cde-8075-72fd1e7a7862","Type":"ContainerStarted","Data":"4bbc9720cb087867ec8604b5308941c2c19b3708d62f339fa57ee0925bef2d04"} Apr 17 11:16:51.043306 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.043222 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" podStartSLOduration=7.043207288 podStartE2EDuration="7.043207288s" podCreationTimestamp="2026-04-17 11:16:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 11:16:51.041695747 +0000 UTC m=+35.865459638" watchObservedRunningTime="2026-04-17 11:16:51.043207288 +0000 UTC m=+35.866971149" Apr 17 11:16:51.063265 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.062710 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5x2cw" podStartSLOduration=3.595483482 podStartE2EDuration="35.062694483s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:16:17.233847216 +0000 UTC m=+2.057611082" lastFinishedPulling="2026-04-17 11:16:48.701058223 +0000 UTC m=+33.524822083" observedRunningTime="2026-04-17 11:16:51.061508927 +0000 UTC m=+35.885272806" watchObservedRunningTime="2026-04-17 11:16:51.062694483 +0000 UTC m=+35.886458363" Apr 17 11:16:51.794031 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.793991 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:16:51.794240 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.793991 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:16:51.794240 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.794003 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:51.796147 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.796125 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 11:16:51.796273 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.796170 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 11:16:51.797089 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.796668 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 17 11:16:51.797089 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.796818 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 11:16:51.797089 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.796930 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-98wmj\"" Apr 17 11:16:51.797089 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:51.797048 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2vcd\"" Apr 17 11:16:52.538541 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:52.538501 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:52.541874 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:52.541840 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0786bd97-6959-432d-b9d0-e710ab215ae2-original-pull-secret\") pod \"global-pull-secret-syncer-8zdsn\" (UID: \"0786bd97-6959-432d-b9d0-e710ab215ae2\") " pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:52.717948 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:52.717919 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zdsn" Apr 17 11:16:53.025183 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:53.025156 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8zdsn"] Apr 17 11:16:53.035957 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:53.035918 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0786bd97_6959_432d_b9d0_e710ab215ae2.slice/crio-d556ea379217726329984a5b992c93d7645a8937f2c7195be0e7aabae8d520f1 WatchSource:0}: Error finding container d556ea379217726329984a5b992c93d7645a8937f2c7195be0e7aabae8d520f1: Status 404 returned error can't find the container with id d556ea379217726329984a5b992c93d7645a8937f2c7195be0e7aabae8d520f1 Apr 17 11:16:54.047118 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.046883 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8zdsn" event={"ID":"0786bd97-6959-432d-b9d0-e710ab215ae2","Type":"ContainerStarted","Data":"d556ea379217726329984a5b992c93d7645a8937f2c7195be0e7aabae8d520f1"} Apr 17 11:16:54.048805 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.048749 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2zxhl" event={"ID":"c9ae08f7-e218-44e4-a0d0-01d83fb2644a","Type":"ContainerStarted","Data":"247cd27568a05c250e61af36068b2ce2a35eedc30c48e243c920abfbfd2a6f29"} Apr 17 11:16:54.050900 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.050866 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqjk4" event={"ID":"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa","Type":"ContainerStarted","Data":"6d7b8713b400d9417b8a590a3eab379e2042a1cbadfe1c95409a776b36390279"} Apr 17 11:16:54.051010 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.050906 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqjk4" event={"ID":"5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa","Type":"ContainerStarted","Data":"fe075e72078d0a6c8e428f694f4a5fc194959089f537eb600e6a59d72837c737"} Apr 17 11:16:54.051010 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.050946 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lqjk4" Apr 17 11:16:54.053358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.053329 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jc5j" event={"ID":"d908fd92-e82b-4cde-8075-72fd1e7a7862","Type":"ContainerStarted","Data":"b7e1111c9624bd1bdb3a2db9d9a5f4a99e83d6be66c7e2fa2958b1cd119a39a4"} Apr 17 11:16:54.085978 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.085802 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-lqjk4" podStartSLOduration=1.8222100810000001 podStartE2EDuration="4.085787314s" podCreationTimestamp="2026-04-17 11:16:50 +0000 UTC" firstStartedPulling="2026-04-17 11:16:50.646099392 +0000 UTC m=+35.469863250" lastFinishedPulling="2026-04-17 11:16:52.909676619 +0000 UTC m=+37.733440483" observedRunningTime="2026-04-17 11:16:54.085391701 +0000 UTC m=+38.909155581" watchObservedRunningTime="2026-04-17 11:16:54.085787314 +0000 UTC m=+38.909551196" Apr 17 11:16:54.086490 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:54.086451 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2zxhl" podStartSLOduration=1.7560088230000002 podStartE2EDuration="4.086443628s" podCreationTimestamp="2026-04-17 11:16:50 +0000 UTC" firstStartedPulling="2026-04-17 11:16:50.582000484 +0000 UTC m=+35.405764343" lastFinishedPulling="2026-04-17 11:16:52.912435286 +0000 UTC m=+37.736199148" observedRunningTime="2026-04-17 11:16:54.067883005 +0000 UTC m=+38.891646881" watchObservedRunningTime="2026-04-17 11:16:54.086443628 +0000 UTC m=+38.910207508" Apr 17 11:16:55.057672 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:55.057561 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jc5j" event={"ID":"d908fd92-e82b-4cde-8075-72fd1e7a7862","Type":"ContainerStarted","Data":"4a5c7c38fb4ec6c56f0d480a904f16b96d5fd913a7fbdcbe6d8db672e1187281"} Apr 17 11:16:56.077019 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:56.076962 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7jc5j" podStartSLOduration=1.881847783 podStartE2EDuration="6.076942691s" podCreationTimestamp="2026-04-17 11:16:50 +0000 UTC" firstStartedPulling="2026-04-17 11:16:50.729967478 +0000 UTC m=+35.553731336" lastFinishedPulling="2026-04-17 11:16:54.92506237 +0000 UTC m=+39.748826244" observedRunningTime="2026-04-17 11:16:56.075779733 +0000 UTC m=+40.899543614" watchObservedRunningTime="2026-04-17 11:16:56.076942691 +0000 UTC m=+40.900706573" Apr 17 11:16:58.067084 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.067045 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8zdsn" event={"ID":"0786bd97-6959-432d-b9d0-e710ab215ae2","Type":"ContainerStarted","Data":"30fd72de5fe3ac7d89eff2ed7b1bd67f41f212febd44bf16513742884e69170c"} Apr 17 11:16:58.081943 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.081900 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8zdsn" podStartSLOduration=10.078299268 podStartE2EDuration="14.081887523s" podCreationTimestamp="2026-04-17 11:16:44 +0000 UTC" firstStartedPulling="2026-04-17 11:16:53.038052163 +0000 UTC m=+37.861816022" lastFinishedPulling="2026-04-17 11:16:57.041640409 +0000 UTC m=+41.865404277" observedRunningTime="2026-04-17 11:16:58.081420378 +0000 UTC m=+42.905184259" watchObservedRunningTime="2026-04-17 11:16:58.081887523 +0000 UTC m=+42.905651401" Apr 17 11:16:58.634667 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.634636 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-gk2gv"] Apr 17 11:16:58.653193 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.653167 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-gk2gv"] Apr 17 11:16:58.653328 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.653275 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.657083 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.657063 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 17 11:16:58.657199 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.657170 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 17 11:16:58.657281 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.657266 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rwdsf\"" Apr 17 11:16:58.657328 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.657264 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 17 11:16:58.657530 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.657517 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 17 11:16:58.657626 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.657540 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 17 11:16:58.784603 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.784557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7107136-aa34-4193-9560-daa5747f91b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.784763 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.784626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7107136-aa34-4193-9560-daa5747f91b7-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.784763 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.784681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7107136-aa34-4193-9560-daa5747f91b7-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.784763 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.784697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nntzk\" (UniqueName: \"kubernetes.io/projected/d7107136-aa34-4193-9560-daa5747f91b7-kube-api-access-nntzk\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.885849 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.885759 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7107136-aa34-4193-9560-daa5747f91b7-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.885849 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.885797 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nntzk\" (UniqueName: \"kubernetes.io/projected/d7107136-aa34-4193-9560-daa5747f91b7-kube-api-access-nntzk\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.885849 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.885825 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7107136-aa34-4193-9560-daa5747f91b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.886074 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.885870 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7107136-aa34-4193-9560-daa5747f91b7-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.886643 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.886619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7107136-aa34-4193-9560-daa5747f91b7-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.889143 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.889119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7107136-aa34-4193-9560-daa5747f91b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.889241 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.889156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d7107136-aa34-4193-9560-daa5747f91b7-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.893777 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.893752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nntzk\" (UniqueName: \"kubernetes.io/projected/d7107136-aa34-4193-9560-daa5747f91b7-kube-api-access-nntzk\") pod \"prometheus-operator-5676c8c784-gk2gv\" (UID: \"d7107136-aa34-4193-9560-daa5747f91b7\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:58.961564 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:58.961521 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" Apr 17 11:16:59.074293 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:16:59.074262 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-gk2gv"] Apr 17 11:16:59.076832 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:16:59.076806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7107136_aa34_4193_9560_daa5747f91b7.slice/crio-737dcfcb4c52a488ab08512c15cf20b4795ca7e130910e465c4ba0449ace8135 WatchSource:0}: Error finding container 737dcfcb4c52a488ab08512c15cf20b4795ca7e130910e465c4ba0449ace8135: Status 404 returned error can't find the container with id 737dcfcb4c52a488ab08512c15cf20b4795ca7e130910e465c4ba0449ace8135 Apr 17 11:17:00.076359 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:00.076322 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" event={"ID":"d7107136-aa34-4193-9560-daa5747f91b7","Type":"ContainerStarted","Data":"737dcfcb4c52a488ab08512c15cf20b4795ca7e130910e465c4ba0449ace8135"} Apr 17 11:17:01.081369 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:01.081327 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" event={"ID":"d7107136-aa34-4193-9560-daa5747f91b7","Type":"ContainerStarted","Data":"9526d112686186585cbff4608d194f8b68900af168129396e9ff458a9aaf52ba"} Apr 17 11:17:01.081369 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:01.081375 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" event={"ID":"d7107136-aa34-4193-9560-daa5747f91b7","Type":"ContainerStarted","Data":"44dddf49fba986fec3e13fa75f32208b3b70538aa552a877f2419b624e12b283"} Apr 17 11:17:01.099816 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:01.099764 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-gk2gv" podStartSLOduration=1.322944074 podStartE2EDuration="3.099750055s" podCreationTimestamp="2026-04-17 11:16:58 +0000 UTC" firstStartedPulling="2026-04-17 11:16:59.078528947 +0000 UTC m=+43.902292805" lastFinishedPulling="2026-04-17 11:17:00.855334925 +0000 UTC m=+45.679098786" observedRunningTime="2026-04-17 11:17:01.098521561 +0000 UTC m=+45.922285440" watchObservedRunningTime="2026-04-17 11:17:01.099750055 +0000 UTC m=+45.923513934" Apr 17 11:17:03.066545 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.066497 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qcpd"] Apr 17 11:17:03.083761 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.083736 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.085557 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.085534 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 17 11:17:03.085883 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.085852 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 17 11:17:03.085993 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.085865 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 17 11:17:03.086047 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.085940 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sfwkf\"" Apr 17 11:17:03.218024 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.217981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93790766-417d-4bd6-ba29-d9588341992e-metrics-client-ca\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218024 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-textfile\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218068 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-sys\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-wtmp\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-root\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-tls\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.218421 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.218242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/93790766-417d-4bd6-ba29-d9588341992e-kube-api-access-sgrpv\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319342 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319264 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93790766-417d-4bd6-ba29-d9588341992e-metrics-client-ca\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319342 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319301 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-textfile\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319342 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319323 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319352 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-sys\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-sys\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319408 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319507 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-wtmp\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319527 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-root\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319541 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-tls\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319609 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319558 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/93790766-417d-4bd6-ba29-d9588341992e-kube-api-access-sgrpv\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319898 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-root\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319898 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-textfile\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.319898 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.319744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-wtmp\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.320025 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.320010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93790766-417d-4bd6-ba29-d9588341992e-metrics-client-ca\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.320059 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.320028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.321863 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.321838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.321917 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.321899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93790766-417d-4bd6-ba29-d9588341992e-node-exporter-tls\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.326760 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.326739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrpv\" (UniqueName: \"kubernetes.io/projected/93790766-417d-4bd6-ba29-d9588341992e-kube-api-access-sgrpv\") pod \"node-exporter-4qcpd\" (UID: \"93790766-417d-4bd6-ba29-d9588341992e\") " pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.393115 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:03.393063 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qcpd" Apr 17 11:17:03.415106 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:17:03.415078 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93790766_417d_4bd6_ba29_d9588341992e.slice/crio-5ca0ace1c3f9dfcce18eb806063fc7c415d785d0fa48610be8670d60cb113863 WatchSource:0}: Error finding container 5ca0ace1c3f9dfcce18eb806063fc7c415d785d0fa48610be8670d60cb113863: Status 404 returned error can't find the container with id 5ca0ace1c3f9dfcce18eb806063fc7c415d785d0fa48610be8670d60cb113863 Apr 17 11:17:04.062460 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:04.062430 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lqjk4" Apr 17 11:17:04.091461 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:04.091420 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qcpd" event={"ID":"93790766-417d-4bd6-ba29-d9588341992e","Type":"ContainerStarted","Data":"5ca0ace1c3f9dfcce18eb806063fc7c415d785d0fa48610be8670d60cb113863"} Apr 17 11:17:05.092749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.092722 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86f765bf9-hv7jt"] Apr 17 11:17:05.095130 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.095099 2576 generic.go:358] "Generic (PLEG): container finished" podID="93790766-417d-4bd6-ba29-d9588341992e" containerID="43906f3186c1c3bd89791d358495b9556c9879939ce86c3c683310d83c78ed6e" exitCode=0 Apr 17 11:17:05.104852 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.104823 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qcpd" event={"ID":"93790766-417d-4bd6-ba29-d9588341992e","Type":"ContainerDied","Data":"43906f3186c1c3bd89791d358495b9556c9879939ce86c3c683310d83c78ed6e"} Apr 17 11:17:05.104997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.104984 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.107379 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107168 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Apr 17 11:17:05.107379 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107176 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Apr 17 11:17:05.107379 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107226 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3qufkj0hrlt5n\"" Apr 17 11:17:05.107379 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107233 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Apr 17 11:17:05.107379 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107412 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Apr 17 11:17:05.107825 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107499 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8m98g\"" Apr 17 11:17:05.107960 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.107940 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Apr 17 11:17:05.109639 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.109618 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86f765bf9-hv7jt"] Apr 17 11:17:05.235419 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-tls\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235419 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235419 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235616 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70ea5b67-2854-4270-92a0-489575df47a4-metrics-client-ca\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235616 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-grpc-tls\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235616 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vwp\" (UniqueName: \"kubernetes.io/projected/70ea5b67-2854-4270-92a0-489575df47a4-kube-api-access-m8vwp\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.235768 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.235658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336223 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336189 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336223 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336224 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336497 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336476 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-tls\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336545 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336521 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336622 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336622 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336605 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70ea5b67-2854-4270-92a0-489575df47a4-metrics-client-ca\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336735 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336640 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-grpc-tls\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.336735 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.336663 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vwp\" (UniqueName: \"kubernetes.io/projected/70ea5b67-2854-4270-92a0-489575df47a4-kube-api-access-m8vwp\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.337310 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.337278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70ea5b67-2854-4270-92a0-489575df47a4-metrics-client-ca\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.339204 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.339179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.339339 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.339264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.339339 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.339325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-grpc-tls\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.339449 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.339363 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.339449 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.339383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.339449 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.339398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/70ea5b67-2854-4270-92a0-489575df47a4-secret-thanos-querier-tls\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.344326 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.344281 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vwp\" (UniqueName: \"kubernetes.io/projected/70ea5b67-2854-4270-92a0-489575df47a4-kube-api-access-m8vwp\") pod \"thanos-querier-86f765bf9-hv7jt\" (UID: \"70ea5b67-2854-4270-92a0-489575df47a4\") " pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.415708 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.415674 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:05.530989 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:05.530961 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86f765bf9-hv7jt"] Apr 17 11:17:05.533709 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:17:05.533685 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ea5b67_2854_4270_92a0_489575df47a4.slice/crio-2f2d18bb59d31abf9b081948503b3d09223b01a05730ce8314242a617b907796 WatchSource:0}: Error finding container 2f2d18bb59d31abf9b081948503b3d09223b01a05730ce8314242a617b907796: Status 404 returned error can't find the container with id 2f2d18bb59d31abf9b081948503b3d09223b01a05730ce8314242a617b907796 Apr 17 11:17:06.099215 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:06.099177 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qcpd" event={"ID":"93790766-417d-4bd6-ba29-d9588341992e","Type":"ContainerStarted","Data":"fa1aca21e8b5482c90f5cceabc4229ba1e12502a2ee092eb33136fe87aa70a6f"} Apr 17 11:17:06.099215 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:06.099215 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qcpd" event={"ID":"93790766-417d-4bd6-ba29-d9588341992e","Type":"ContainerStarted","Data":"4174e7ed417a0730ca0bc458d4a02cf342cb5a03fa21113fdf81b90ce0c07965"} Apr 17 11:17:06.100319 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:06.100295 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"2f2d18bb59d31abf9b081948503b3d09223b01a05730ce8314242a617b907796"} Apr 17 11:17:06.122623 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:06.122544 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qcpd" podStartSLOduration=1.92379467 podStartE2EDuration="3.122527467s" podCreationTimestamp="2026-04-17 11:17:03 +0000 UTC" firstStartedPulling="2026-04-17 11:17:03.416799838 +0000 UTC m=+48.240563697" lastFinishedPulling="2026-04-17 11:17:04.615532635 +0000 UTC m=+49.439296494" observedRunningTime="2026-04-17 11:17:06.121222872 +0000 UTC m=+50.944986760" watchObservedRunningTime="2026-04-17 11:17:06.122527467 +0000 UTC m=+50.946291348" Apr 17 11:17:07.429478 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.429446 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fffd5d994-zd527"] Apr 17 11:17:07.432960 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.432936 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.434904 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.434880 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 17 11:17:07.435028 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.434888 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 17 11:17:07.435324 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.435303 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zvrz5\"" Apr 17 11:17:07.435427 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.435335 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 17 11:17:07.435427 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.435365 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6e1nccvkrnat0\"" Apr 17 11:17:07.435427 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.435398 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 17 11:17:07.442008 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.441988 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fffd5d994-zd527"] Apr 17 11:17:07.555811 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-client-ca-bundle\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.555811 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkcgj\" (UniqueName: \"kubernetes.io/projected/846d55b7-b479-419d-9c70-2704972ac4a0-kube-api-access-pkcgj\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.556045 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846d55b7-b479-419d-9c70-2704972ac4a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.556045 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/846d55b7-b479-419d-9c70-2704972ac4a0-metrics-server-audit-profiles\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.556045 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/846d55b7-b479-419d-9c70-2704972ac4a0-audit-log\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.556045 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-secret-metrics-server-client-certs\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.556045 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.555969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-secret-metrics-server-tls\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656704 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656664 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-secret-metrics-server-client-certs\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656704 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656707 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-secret-metrics-server-tls\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656757 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-client-ca-bundle\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656778 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkcgj\" (UniqueName: \"kubernetes.io/projected/846d55b7-b479-419d-9c70-2704972ac4a0-kube-api-access-pkcgj\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656814 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846d55b7-b479-419d-9c70-2704972ac4a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656843 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/846d55b7-b479-419d-9c70-2704972ac4a0-metrics-server-audit-profiles\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.656893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.656878 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/846d55b7-b479-419d-9c70-2704972ac4a0-audit-log\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.657235 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.657210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/846d55b7-b479-419d-9c70-2704972ac4a0-audit-log\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.657633 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.657608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/846d55b7-b479-419d-9c70-2704972ac4a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.658122 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.658095 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/846d55b7-b479-419d-9c70-2704972ac4a0-metrics-server-audit-profiles\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.659427 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.659403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-client-ca-bundle\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.659625 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.659572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-secret-metrics-server-tls\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.659838 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.659817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/846d55b7-b479-419d-9c70-2704972ac4a0-secret-metrics-server-client-certs\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.663775 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.663756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkcgj\" (UniqueName: \"kubernetes.io/projected/846d55b7-b479-419d-9c70-2704972ac4a0-kube-api-access-pkcgj\") pod \"metrics-server-6fffd5d994-zd527\" (UID: \"846d55b7-b479-419d-9c70-2704972ac4a0\") " pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.744358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.744332 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:07.871385 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:07.871357 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fffd5d994-zd527"] Apr 17 11:17:08.108616 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.108565 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"f1900981c4760d521fa4b04b282feacc79dc27f5c3265c05579875c10da4b69b"} Apr 17 11:17:08.108616 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.108620 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"b58e81903f61800dd0c27900c5f18737ba299c5219ea22285d11b4621c0da854"} Apr 17 11:17:08.108830 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.108635 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"75f576f8b41a8a2bd5ce63cdfb6a7241966819c90ba5b91c7ed1e51fa1917472"} Apr 17 11:17:08.109519 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.109497 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" event={"ID":"846d55b7-b479-419d-9c70-2704972ac4a0","Type":"ContainerStarted","Data":"722419bde41b5dc87497ee4d959c0566822856e7c899557b3b076955ea396d34"} Apr 17 11:17:08.249274 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.249240 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74b6c6978c-qn7ng"] Apr 17 11:17:08.252907 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.252892 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.254734 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.254698 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Apr 17 11:17:08.254852 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.254787 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Apr 17 11:17:08.254917 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.254862 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Apr 17 11:17:08.254917 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.254891 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r6gs5\"" Apr 17 11:17:08.255014 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.254930 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Apr 17 11:17:08.255258 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.255235 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Apr 17 11:17:08.259772 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.259751 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Apr 17 11:17:08.262748 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.262724 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74b6c6978c-qn7ng"] Apr 17 11:17:08.263177 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263264 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-secret-telemeter-client\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263264 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-serving-certs-ca-bundle\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-federate-client-tls\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-telemeter-client-tls\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckw2p\" (UniqueName: \"kubernetes.io/projected/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-kube-api-access-ckw2p\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263455 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.263455 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.263406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-metrics-client-ca\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364109 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364021 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364109 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364061 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-metrics-client-ca\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364109 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364104 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364363 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364334 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-secret-telemeter-client\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364417 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364391 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-serving-certs-ca-bundle\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364471 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364418 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-federate-client-tls\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364518 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364471 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-telemeter-client-tls\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.364518 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.364496 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckw2p\" (UniqueName: \"kubernetes.io/projected/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-kube-api-access-ckw2p\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.365083 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.365059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-metrics-client-ca\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.365457 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.365407 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-serving-certs-ca-bundle\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.365781 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.365746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.367047 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.367025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.367234 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.367202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-secret-telemeter-client\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.367234 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.367216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-federate-client-tls\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.367339 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.367275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-telemeter-client-tls\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.371743 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.371721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckw2p\" (UniqueName: \"kubernetes.io/projected/e3c5e4b7-45e2-423a-80d9-ecda1973faf4-kube-api-access-ckw2p\") pod \"telemeter-client-74b6c6978c-qn7ng\" (UID: \"e3c5e4b7-45e2-423a-80d9-ecda1973faf4\") " pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.561868 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.561807 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" Apr 17 11:17:08.733658 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:08.733557 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74b6c6978c-qn7ng"] Apr 17 11:17:08.736017 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:17:08.735994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c5e4b7_45e2_423a_80d9_ecda1973faf4.slice/crio-173bc323eaca0d81e581fcb11e58e9ceaac0e50684fa2d78d22d781f213829db WatchSource:0}: Error finding container 173bc323eaca0d81e581fcb11e58e9ceaac0e50684fa2d78d22d781f213829db: Status 404 returned error can't find the container with id 173bc323eaca0d81e581fcb11e58e9ceaac0e50684fa2d78d22d781f213829db Apr 17 11:17:09.117474 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.117435 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"ea516dd613a2b5e171955b075d947e87aa40d3bd32cfe5a43c53921a2299a3ed"} Apr 17 11:17:09.117686 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.117482 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"20483dc749fef9af0e9170741b20d372a3c9f0529acbd8317e14d5160ce530ae"} Apr 17 11:17:09.117686 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.117495 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" event={"ID":"70ea5b67-2854-4270-92a0-489575df47a4","Type":"ContainerStarted","Data":"76873b26b0207f7fb0b501eee18d7491509501d9d36d75eea6b5caf97051b581"} Apr 17 11:17:09.117686 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.117653 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:09.120193 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.120163 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" event={"ID":"e3c5e4b7-45e2-423a-80d9-ecda1973faf4","Type":"ContainerStarted","Data":"173bc323eaca0d81e581fcb11e58e9ceaac0e50684fa2d78d22d781f213829db"} Apr 17 11:17:09.146795 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.146742 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" podStartSLOduration=1.044489371 podStartE2EDuration="4.146725669s" podCreationTimestamp="2026-04-17 11:17:05 +0000 UTC" firstStartedPulling="2026-04-17 11:17:05.535459825 +0000 UTC m=+50.359223684" lastFinishedPulling="2026-04-17 11:17:08.637696111 +0000 UTC m=+53.461459982" observedRunningTime="2026-04-17 11:17:09.14401132 +0000 UTC m=+53.967775199" watchObservedRunningTime="2026-04-17 11:17:09.146725669 +0000 UTC m=+53.970489548" Apr 17 11:17:09.706048 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.705962 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59dd965667-bmrxj"] Apr 17 11:17:09.709961 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.709830 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.712431 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.712053 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 17 11:17:09.712431 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.712064 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 17 11:17:09.712431 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.712292 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 17 11:17:09.712718 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.712652 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w9dfd\"" Apr 17 11:17:09.712888 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.712865 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 17 11:17:09.713613 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.712865 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 17 11:17:09.713613 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.713091 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 17 11:17:09.713613 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.713453 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 17 11:17:09.719715 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.719676 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59dd965667-bmrxj"] Apr 17 11:17:09.720127 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.719953 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 17 11:17:09.777662 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-config\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.777827 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-trusted-ca-bundle\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.777827 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-oauth-serving-cert\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.777827 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-service-ca\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.777827 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmkcq\" (UniqueName: \"kubernetes.io/projected/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-kube-api-access-bmkcq\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.778011 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-serving-cert\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.778011 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.777956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-oauth-config\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879095 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879061 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-oauth-config\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879133 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-config\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879156 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-trusted-ca-bundle\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879171 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-oauth-serving-cert\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879192 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-service-ca\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879206 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmkcq\" (UniqueName: \"kubernetes.io/projected/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-kube-api-access-bmkcq\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879233 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-serving-cert\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.879997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.879966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-oauth-serving-cert\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.880098 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.880079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-service-ca\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.880798 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.880776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-trusted-ca-bundle\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.881039 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.881022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-config\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.882213 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.882187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-oauth-config\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.882337 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.882318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-serving-cert\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:09.890119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:09.890086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmkcq\" (UniqueName: \"kubernetes.io/projected/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-kube-api-access-bmkcq\") pod \"console-59dd965667-bmrxj\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:10.024425 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:10.024397 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:10.125581 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:10.125544 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" event={"ID":"846d55b7-b479-419d-9c70-2704972ac4a0","Type":"ContainerStarted","Data":"13ce4282fb47db67cd5c0fa2b7562f52659ba100eedb4a05e15df124962ebfd4"} Apr 17 11:17:10.143514 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:10.143468 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" podStartSLOduration=1.660928124 podStartE2EDuration="3.143454613s" podCreationTimestamp="2026-04-17 11:17:07 +0000 UTC" firstStartedPulling="2026-04-17 11:17:07.879123518 +0000 UTC m=+52.702887377" lastFinishedPulling="2026-04-17 11:17:09.361650004 +0000 UTC m=+54.185413866" observedRunningTime="2026-04-17 11:17:10.142602488 +0000 UTC m=+54.966366373" watchObservedRunningTime="2026-04-17 11:17:10.143454613 +0000 UTC m=+54.967218557" Apr 17 11:17:10.159954 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:10.159908 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59dd965667-bmrxj"] Apr 17 11:17:10.164523 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:17:10.164494 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e16627_6d92_4fea_bc9c_b1d31e6f77f3.slice/crio-1d17fba6f86bbfa38405db1fe283344090f734f2ad33c527ff3d764ff7d677d4 WatchSource:0}: Error finding container 1d17fba6f86bbfa38405db1fe283344090f734f2ad33c527ff3d764ff7d677d4: Status 404 returned error can't find the container with id 1d17fba6f86bbfa38405db1fe283344090f734f2ad33c527ff3d764ff7d677d4 Apr 17 11:17:11.130156 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:11.130118 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" event={"ID":"e3c5e4b7-45e2-423a-80d9-ecda1973faf4","Type":"ContainerStarted","Data":"0dc0aa9c1ef9da6929d6ae613511dfa1f25f36cb1cd8a33fcd9c95759a69df6b"} Apr 17 11:17:11.131124 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:11.131101 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59dd965667-bmrxj" event={"ID":"70e16627-6d92-4fea-bc9c-b1d31e6f77f3","Type":"ContainerStarted","Data":"1d17fba6f86bbfa38405db1fe283344090f734f2ad33c527ff3d764ff7d677d4"} Apr 17 11:17:12.039191 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:12.039170 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7664589ff7-rzqsr" Apr 17 11:17:12.136885 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:12.136851 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" event={"ID":"e3c5e4b7-45e2-423a-80d9-ecda1973faf4","Type":"ContainerStarted","Data":"9b8f00777f86a41e8beda881c0eb89a6f9ac15c0f27f46c03bc20806177e1eb1"} Apr 17 11:17:13.016380 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:13.016347 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmxqh" Apr 17 11:17:14.142896 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:14.142855 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59dd965667-bmrxj" event={"ID":"70e16627-6d92-4fea-bc9c-b1d31e6f77f3","Type":"ContainerStarted","Data":"2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d"} Apr 17 11:17:14.145623 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:14.145035 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" event={"ID":"e3c5e4b7-45e2-423a-80d9-ecda1973faf4","Type":"ContainerStarted","Data":"bb70ef0fd750e1962c54960b9bbb9e8618e08072e5cca8ab6a19ff83649da01a"} Apr 17 11:17:14.181980 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:14.181915 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59dd965667-bmrxj" podStartSLOduration=2.214798086 podStartE2EDuration="5.181893525s" podCreationTimestamp="2026-04-17 11:17:09 +0000 UTC" firstStartedPulling="2026-04-17 11:17:10.166770325 +0000 UTC m=+54.990534192" lastFinishedPulling="2026-04-17 11:17:13.133865759 +0000 UTC m=+57.957629631" observedRunningTime="2026-04-17 11:17:14.180309678 +0000 UTC m=+59.004073559" watchObservedRunningTime="2026-04-17 11:17:14.181893525 +0000 UTC m=+59.005657406" Apr 17 11:17:14.209698 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:14.209650 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74b6c6978c-qn7ng" podStartSLOduration=2.9281486230000002 podStartE2EDuration="6.209634067s" podCreationTimestamp="2026-04-17 11:17:08 +0000 UTC" firstStartedPulling="2026-04-17 11:17:08.738168038 +0000 UTC m=+53.561931897" lastFinishedPulling="2026-04-17 11:17:12.019653483 +0000 UTC m=+56.843417341" observedRunningTime="2026-04-17 11:17:14.207566102 +0000 UTC m=+59.031330006" watchObservedRunningTime="2026-04-17 11:17:14.209634067 +0000 UTC m=+59.033397946" Apr 17 11:17:14.862781 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:14.862746 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59dd965667-bmrxj"] Apr 17 11:17:15.131382 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:15.131308 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86f765bf9-hv7jt" Apr 17 11:17:20.025295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.025242 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:20.477872 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.477793 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:17:20.480165 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.480148 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 11:17:20.490933 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.490908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87c84598-6174-4e54-9961-2dc53effa865-metrics-certs\") pod \"network-metrics-daemon-47s58\" (UID: \"87c84598-6174-4e54-9961-2dc53effa865\") " pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:17:20.614769 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.614742 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-98wmj\"" Apr 17 11:17:20.622876 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.622854 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47s58" Apr 17 11:17:20.679504 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.679476 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:17:20.682160 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.682129 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 11:17:20.692736 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.692716 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 11:17:20.703734 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.703709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qq8\" (UniqueName: \"kubernetes.io/projected/ce81cfef-ea4a-46be-8482-af5eac179f0b-kube-api-access-p6qq8\") pod \"network-check-target-j9jfg\" (UID: \"ce81cfef-ea4a-46be-8482-af5eac179f0b\") " pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:17:20.741021 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.740991 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47s58"] Apr 17 11:17:20.743185 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:17:20.743157 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c84598_6174_4e54_9961_2dc53effa865.slice/crio-7b3b3f8bf714acfe53d127eab7576533cab424043827bbb03d13a94375a687dc WatchSource:0}: Error finding container 7b3b3f8bf714acfe53d127eab7576533cab424043827bbb03d13a94375a687dc: Status 404 returned error can't find the container with id 7b3b3f8bf714acfe53d127eab7576533cab424043827bbb03d13a94375a687dc Apr 17 11:17:20.908088 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.908059 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x2vcd\"" Apr 17 11:17:20.916385 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:20.916366 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:17:21.030426 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:21.030358 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j9jfg"] Apr 17 11:17:21.033270 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:17:21.033244 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce81cfef_ea4a_46be_8482_af5eac179f0b.slice/crio-56d30d0a1ccda751dcb7b9bb6492ff660a9f38c70daee78c9d36a01178ef7a97 WatchSource:0}: Error finding container 56d30d0a1ccda751dcb7b9bb6492ff660a9f38c70daee78c9d36a01178ef7a97: Status 404 returned error can't find the container with id 56d30d0a1ccda751dcb7b9bb6492ff660a9f38c70daee78c9d36a01178ef7a97 Apr 17 11:17:21.163110 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:21.163063 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j9jfg" event={"ID":"ce81cfef-ea4a-46be-8482-af5eac179f0b","Type":"ContainerStarted","Data":"56d30d0a1ccda751dcb7b9bb6492ff660a9f38c70daee78c9d36a01178ef7a97"} Apr 17 11:17:21.164044 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:21.164020 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47s58" event={"ID":"87c84598-6174-4e54-9961-2dc53effa865","Type":"ContainerStarted","Data":"7b3b3f8bf714acfe53d127eab7576533cab424043827bbb03d13a94375a687dc"} Apr 17 11:17:23.172717 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:23.172674 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47s58" event={"ID":"87c84598-6174-4e54-9961-2dc53effa865","Type":"ContainerStarted","Data":"e8ccf0cdb7773ae6efec5e3cfcfa2e4d84e70ad8ebd3ca7fce9ed2ffb1a367e0"} Apr 17 11:17:23.172717 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:23.172722 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47s58" event={"ID":"87c84598-6174-4e54-9961-2dc53effa865","Type":"ContainerStarted","Data":"ecf4f3e633fb416f6f005cc2bba2275a8f774f0e82675c84a63381d9950abdeb"} Apr 17 11:17:23.187744 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:23.187426 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-47s58" podStartSLOduration=65.600514365 podStartE2EDuration="1m7.187410517s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:17:20.745038394 +0000 UTC m=+65.568802255" lastFinishedPulling="2026-04-17 11:17:22.331934533 +0000 UTC m=+67.155698407" observedRunningTime="2026-04-17 11:17:23.187161155 +0000 UTC m=+68.010925034" watchObservedRunningTime="2026-04-17 11:17:23.187410517 +0000 UTC m=+68.011174399" Apr 17 11:17:24.177123 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:24.177027 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j9jfg" event={"ID":"ce81cfef-ea4a-46be-8482-af5eac179f0b","Type":"ContainerStarted","Data":"2ff4c87df7e37ac2a5b998a8bc998c36c65f3102f18798c6da1f0cc526fb491f"} Apr 17 11:17:24.177548 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:24.177223 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:17:24.191560 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:24.191514 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j9jfg" podStartSLOduration=65.424337626 podStartE2EDuration="1m8.191500772s" podCreationTimestamp="2026-04-17 11:16:16 +0000 UTC" firstStartedPulling="2026-04-17 11:17:21.035032758 +0000 UTC m=+65.858796617" lastFinishedPulling="2026-04-17 11:17:23.80219589 +0000 UTC m=+68.625959763" observedRunningTime="2026-04-17 11:17:24.190819114 +0000 UTC m=+69.014582996" watchObservedRunningTime="2026-04-17 11:17:24.191500772 +0000 UTC m=+69.015264652" Apr 17 11:17:27.745025 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:27.744992 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:27.745025 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:27.745032 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:41.168748 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.168682 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59dd965667-bmrxj" podUID="70e16627-6d92-4fea-bc9c-b1d31e6f77f3" containerName="console" containerID="cri-o://2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d" gracePeriod=15 Apr 17 11:17:41.397937 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.397915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59dd965667-bmrxj_70e16627-6d92-4fea-bc9c-b1d31e6f77f3/console/0.log" Apr 17 11:17:41.398061 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.397987 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:41.539283 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539252 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-service-ca\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539422 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539357 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-oauth-config\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539422 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539399 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-config\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539422 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539420 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmkcq\" (UniqueName: \"kubernetes.io/projected/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-kube-api-access-bmkcq\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539546 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539462 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-oauth-serving-cert\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539546 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539491 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-serving-cert\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539546 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539518 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-trusted-ca-bundle\") pod \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\" (UID: \"70e16627-6d92-4fea-bc9c-b1d31e6f77f3\") " Apr 17 11:17:41.539719 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539568 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-service-ca" (OuterVolumeSpecName: "service-ca") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:17:41.539891 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539865 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-config" (OuterVolumeSpecName: "console-config") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:17:41.539982 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539901 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-service-ca\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:41.539982 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539912 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:17:41.539982 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.539952 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:17:41.541570 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.541549 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 11:17:41.541690 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.541668 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-kube-api-access-bmkcq" (OuterVolumeSpecName: "kube-api-access-bmkcq") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "kube-api-access-bmkcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 11:17:41.541838 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.541809 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "70e16627-6d92-4fea-bc9c-b1d31e6f77f3" (UID: "70e16627-6d92-4fea-bc9c-b1d31e6f77f3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 11:17:41.641238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.641196 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-oauth-config\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:41.641238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.641232 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-config\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:41.641238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.641242 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmkcq\" (UniqueName: \"kubernetes.io/projected/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-kube-api-access-bmkcq\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:41.641238 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.641251 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-oauth-serving-cert\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:41.641504 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.641261 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-console-serving-cert\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:41.641504 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:41.641269 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70e16627-6d92-4fea-bc9c-b1d31e6f77f3-trusted-ca-bundle\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:17:42.226603 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.226518 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59dd965667-bmrxj_70e16627-6d92-4fea-bc9c-b1d31e6f77f3/console/0.log" Apr 17 11:17:42.226603 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.226557 2576 generic.go:358] "Generic (PLEG): container finished" podID="70e16627-6d92-4fea-bc9c-b1d31e6f77f3" containerID="2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d" exitCode=2 Apr 17 11:17:42.226997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.226618 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59dd965667-bmrxj" event={"ID":"70e16627-6d92-4fea-bc9c-b1d31e6f77f3","Type":"ContainerDied","Data":"2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d"} Apr 17 11:17:42.226997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.226652 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59dd965667-bmrxj" Apr 17 11:17:42.226997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.226668 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59dd965667-bmrxj" event={"ID":"70e16627-6d92-4fea-bc9c-b1d31e6f77f3","Type":"ContainerDied","Data":"1d17fba6f86bbfa38405db1fe283344090f734f2ad33c527ff3d764ff7d677d4"} Apr 17 11:17:42.226997 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.226689 2576 scope.go:117] "RemoveContainer" containerID="2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d" Apr 17 11:17:42.237097 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.237080 2576 scope.go:117] "RemoveContainer" containerID="2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d" Apr 17 11:17:42.237330 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:17:42.237310 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d\": container with ID starting with 2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d not found: ID does not exist" containerID="2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d" Apr 17 11:17:42.237378 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.237341 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d"} err="failed to get container status \"2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d\": rpc error: code = NotFound desc = could not find container \"2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d\": container with ID starting with 2722166da150cec006ce98cfc7d14357cd6e3127796c3c6279c59ed295dae18d not found: ID does not exist" Apr 17 11:17:42.241720 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.241699 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59dd965667-bmrxj"] Apr 17 11:17:42.245271 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:42.245250 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59dd965667-bmrxj"] Apr 17 11:17:43.797937 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:43.797899 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70e16627-6d92-4fea-bc9c-b1d31e6f77f3" path="/var/lib/kubelet/pods/70e16627-6d92-4fea-bc9c-b1d31e6f77f3/volumes" Apr 17 11:17:47.751173 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:47.751134 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:47.755942 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:47.755919 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fffd5d994-zd527" Apr 17 11:17:55.182969 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:17:55.182934 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j9jfg" Apr 17 11:18:07.286184 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.286147 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-568545866d-c5lkh"] Apr 17 11:18:07.286762 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.286548 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70e16627-6d92-4fea-bc9c-b1d31e6f77f3" containerName="console" Apr 17 11:18:07.286762 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.286567 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="70e16627-6d92-4fea-bc9c-b1d31e6f77f3" containerName="console" Apr 17 11:18:07.286762 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.286670 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="70e16627-6d92-4fea-bc9c-b1d31e6f77f3" containerName="console" Apr 17 11:18:07.289353 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.289333 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.291652 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.291627 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 17 11:18:07.291744 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.291628 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 17 11:18:07.291813 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.291745 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 17 11:18:07.292115 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.292091 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 17 11:18:07.292215 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.292098 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 17 11:18:07.292279 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.292263 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 17 11:18:07.292279 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.292273 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 17 11:18:07.292416 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.292401 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w9dfd\"" Apr 17 11:18:07.297088 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.297070 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 17 11:18:07.300604 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.300567 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568545866d-c5lkh"] Apr 17 11:18:07.340953 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.340928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-trusted-ca-bundle\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.341056 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.340957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-oauth-config\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.341056 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.340976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-service-ca\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.341132 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.341053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-oauth-serving-cert\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.341132 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.341111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-serving-cert\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.341200 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.341144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-config\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.341200 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.341164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk5pv\" (UniqueName: \"kubernetes.io/projected/41fc724e-e37c-4e47-bcdb-039e10878d7e-kube-api-access-lk5pv\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442307 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442285 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-oauth-serving-cert\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442322 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-serving-cert\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442343 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-config\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442367 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk5pv\" (UniqueName: \"kubernetes.io/projected/41fc724e-e37c-4e47-bcdb-039e10878d7e-kube-api-access-lk5pv\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442401 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-trusted-ca-bundle\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442426 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-oauth-config\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.442708 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.442452 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-service-ca\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.443110 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.443086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-config\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.443206 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.443086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-oauth-serving-cert\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.443206 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.443126 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-service-ca\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.443329 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.443306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-trusted-ca-bundle\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.444906 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.444878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-serving-cert\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.444990 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.444918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-oauth-config\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.449440 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.449408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk5pv\" (UniqueName: \"kubernetes.io/projected/41fc724e-e37c-4e47-bcdb-039e10878d7e-kube-api-access-lk5pv\") pod \"console-568545866d-c5lkh\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.598465 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.598393 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:07.711963 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:07.711930 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568545866d-c5lkh"] Apr 17 11:18:07.715494 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:18:07.715464 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fc724e_e37c_4e47_bcdb_039e10878d7e.slice/crio-53b8242141e43145fa4390f2a630e1ad039a2a84a1e8b24d7749bedf3d06d795 WatchSource:0}: Error finding container 53b8242141e43145fa4390f2a630e1ad039a2a84a1e8b24d7749bedf3d06d795: Status 404 returned error can't find the container with id 53b8242141e43145fa4390f2a630e1ad039a2a84a1e8b24d7749bedf3d06d795 Apr 17 11:18:08.298390 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:08.298354 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568545866d-c5lkh" event={"ID":"41fc724e-e37c-4e47-bcdb-039e10878d7e","Type":"ContainerStarted","Data":"25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df"} Apr 17 11:18:08.298390 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:08.298389 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568545866d-c5lkh" event={"ID":"41fc724e-e37c-4e47-bcdb-039e10878d7e","Type":"ContainerStarted","Data":"53b8242141e43145fa4390f2a630e1ad039a2a84a1e8b24d7749bedf3d06d795"} Apr 17 11:18:08.315115 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:08.315065 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-568545866d-c5lkh" podStartSLOduration=1.315051166 podStartE2EDuration="1.315051166s" podCreationTimestamp="2026-04-17 11:18:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 11:18:08.314478537 +0000 UTC m=+113.138242443" watchObservedRunningTime="2026-04-17 11:18:08.315051166 +0000 UTC m=+113.138815045" Apr 17 11:18:17.598821 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:17.598793 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:17.599240 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:17.598944 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:17.603170 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:17.603147 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:18:18.328272 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:18:18.328243 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:19:53.847678 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.847645 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk"] Apr 17 11:19:53.850844 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.850824 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:53.853078 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.853050 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-55tjp\"" Apr 17 11:19:53.853192 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.853050 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Apr 17 11:19:53.853192 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.853061 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Apr 17 11:19:53.859190 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.859168 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk"] Apr 17 11:19:53.949161 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.949131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:53.949295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.949163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgns\" (UniqueName: \"kubernetes.io/projected/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-kube-api-access-wqgns\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:53.949295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:53.949230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.050009 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.049981 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.050110 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.050033 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.050175 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.050153 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgns\" (UniqueName: \"kubernetes.io/projected/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-kube-api-access-wqgns\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.050323 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.050309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.050404 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.050385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.059104 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.059082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgns\" (UniqueName: \"kubernetes.io/projected/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-kube-api-access-wqgns\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.159482 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.159432 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:19:54.273620 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.273579 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk"] Apr 17 11:19:54.275817 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:19:54.275793 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4c40ec_b2f8_4dbe_8fb8_e0c584c5fe4b.slice/crio-3b51eda3fc0bb4269f8b44582569b90f6197cbbfeaceb2c0a7c37553fa3cc4d8 WatchSource:0}: Error finding container 3b51eda3fc0bb4269f8b44582569b90f6197cbbfeaceb2c0a7c37553fa3cc4d8: Status 404 returned error can't find the container with id 3b51eda3fc0bb4269f8b44582569b90f6197cbbfeaceb2c0a7c37553fa3cc4d8 Apr 17 11:19:54.568650 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:19:54.568622 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" event={"ID":"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b","Type":"ContainerStarted","Data":"3b51eda3fc0bb4269f8b44582569b90f6197cbbfeaceb2c0a7c37553fa3cc4d8"} Apr 17 11:20:00.588138 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:00.588103 2576 generic.go:358] "Generic (PLEG): container finished" podID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerID="dd28da649f5f449eb6255d2758e44ec6205142fb0fc71f9518369eb1215a508d" exitCode=0 Apr 17 11:20:00.588477 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:00.588184 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" event={"ID":"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b","Type":"ContainerDied","Data":"dd28da649f5f449eb6255d2758e44ec6205142fb0fc71f9518369eb1215a508d"} Apr 17 11:20:03.597914 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:03.597882 2576 generic.go:358] "Generic (PLEG): container finished" podID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerID="70bf837e65b94e11001264fb2db28fb8ac1a8de4f7bacb8526eb9c6d1eba8e6b" exitCode=0 Apr 17 11:20:03.598268 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:03.597966 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" event={"ID":"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b","Type":"ContainerDied","Data":"70bf837e65b94e11001264fb2db28fb8ac1a8de4f7bacb8526eb9c6d1eba8e6b"} Apr 17 11:20:10.621990 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:10.621954 2576 generic.go:358] "Generic (PLEG): container finished" podID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerID="cd656cdfe84c1d6aa752cbc48f628ecf019a77ba58dece61568872527b27b5d0" exitCode=0 Apr 17 11:20:10.622381 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:10.622021 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" event={"ID":"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b","Type":"ContainerDied","Data":"cd656cdfe84c1d6aa752cbc48f628ecf019a77ba58dece61568872527b27b5d0"} Apr 17 11:20:11.740082 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.740055 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:20:11.790938 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.790912 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-bundle\") pod \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " Apr 17 11:20:11.791099 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.791000 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqgns\" (UniqueName: \"kubernetes.io/projected/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-kube-api-access-wqgns\") pod \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " Apr 17 11:20:11.791099 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.791035 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-util\") pod \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\" (UID: \"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b\") " Apr 17 11:20:11.791570 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.791542 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-bundle" (OuterVolumeSpecName: "bundle") pod "9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" (UID: "9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 11:20:11.793149 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.793124 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-kube-api-access-wqgns" (OuterVolumeSpecName: "kube-api-access-wqgns") pod "9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" (UID: "9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b"). InnerVolumeSpecName "kube-api-access-wqgns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 11:20:11.794971 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.794944 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-util" (OuterVolumeSpecName: "util") pod "9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" (UID: "9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 11:20:11.891785 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.891708 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-util\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:20:11.891785 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.891734 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-bundle\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:20:11.891785 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:11.891744 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqgns\" (UniqueName: \"kubernetes.io/projected/9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b-kube-api-access-wqgns\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:20:12.629358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:12.629322 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" event={"ID":"9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b","Type":"ContainerDied","Data":"3b51eda3fc0bb4269f8b44582569b90f6197cbbfeaceb2c0a7c37553fa3cc4d8"} Apr 17 11:20:12.629358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:12.629359 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b51eda3fc0bb4269f8b44582569b90f6197cbbfeaceb2c0a7c37553fa3cc4d8" Apr 17 11:20:12.629358 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:12.629336 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4xvtk" Apr 17 11:20:16.012286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012253 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p"] Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012519 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="pull" Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012529 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="pull" Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012544 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="extract" Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012549 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="extract" Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012559 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="util" Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012564 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="util" Apr 17 11:20:16.012703 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.012622 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f4c40ec-b2f8-4dbe-8fb8-e0c584c5fe4b" containerName="extract" Apr 17 11:20:16.046491 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.046458 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p"] Apr 17 11:20:16.046649 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.046613 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.051230 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.051212 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Apr 17 11:20:16.051230 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.051228 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-plthd\"" Apr 17 11:20:16.051382 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.051213 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Apr 17 11:20:16.051656 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.051643 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Apr 17 11:20:16.127972 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.127934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfzmv\" (UniqueName: \"kubernetes.io/projected/50ccd6ea-1313-414d-b10b-d452197c95c1-kube-api-access-lfzmv\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p\" (UID: \"50ccd6ea-1313-414d-b10b-d452197c95c1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.128118 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.127982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/50ccd6ea-1313-414d-b10b-d452197c95c1-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p\" (UID: \"50ccd6ea-1313-414d-b10b-d452197c95c1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.228919 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.228876 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfzmv\" (UniqueName: \"kubernetes.io/projected/50ccd6ea-1313-414d-b10b-d452197c95c1-kube-api-access-lfzmv\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p\" (UID: \"50ccd6ea-1313-414d-b10b-d452197c95c1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.228919 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.228924 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/50ccd6ea-1313-414d-b10b-d452197c95c1-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p\" (UID: \"50ccd6ea-1313-414d-b10b-d452197c95c1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.231242 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.231219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/50ccd6ea-1313-414d-b10b-d452197c95c1-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p\" (UID: \"50ccd6ea-1313-414d-b10b-d452197c95c1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.241363 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.241338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfzmv\" (UniqueName: \"kubernetes.io/projected/50ccd6ea-1313-414d-b10b-d452197c95c1-kube-api-access-lfzmv\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p\" (UID: \"50ccd6ea-1313-414d-b10b-d452197c95c1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.357205 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.357120 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:16.482234 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.482196 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p"] Apr 17 11:20:16.486099 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:20:16.486069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ccd6ea_1313_414d_b10b_d452197c95c1.slice/crio-14191827ca0ffe24816582c8ceea4d0f002fe289e61d36d525cc8fc3fcfb7662 WatchSource:0}: Error finding container 14191827ca0ffe24816582c8ceea4d0f002fe289e61d36d525cc8fc3fcfb7662: Status 404 returned error can't find the container with id 14191827ca0ffe24816582c8ceea4d0f002fe289e61d36d525cc8fc3fcfb7662 Apr 17 11:20:16.643063 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:16.642977 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" event={"ID":"50ccd6ea-1313-414d-b10b-d452197c95c1","Type":"ContainerStarted","Data":"14191827ca0ffe24816582c8ceea4d0f002fe289e61d36d525cc8fc3fcfb7662"} Apr 17 11:20:20.656286 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.656246 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" event={"ID":"50ccd6ea-1313-414d-b10b-d452197c95c1","Type":"ContainerStarted","Data":"48ae96c5c50c160575cb56da1dff24540adca3ada5289ef854057612b764ff30"} Apr 17 11:20:20.656803 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.656671 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:20.678910 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.678875 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-kw6xp"] Apr 17 11:20:20.681579 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.681532 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" podStartSLOduration=2.138414385 podStartE2EDuration="5.681514009s" podCreationTimestamp="2026-04-17 11:20:15 +0000 UTC" firstStartedPulling="2026-04-17 11:20:16.487867137 +0000 UTC m=+241.311630996" lastFinishedPulling="2026-04-17 11:20:20.030966748 +0000 UTC m=+244.854730620" observedRunningTime="2026-04-17 11:20:20.67976121 +0000 UTC m=+245.503525090" watchObservedRunningTime="2026-04-17 11:20:20.681514009 +0000 UTC m=+245.505277888" Apr 17 11:20:20.703828 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.703800 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-kw6xp"] Apr 17 11:20:20.703974 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.703931 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.706409 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.706389 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Apr 17 11:20:20.706527 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.706394 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Apr 17 11:20:20.706659 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.706644 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mlj5v\"" Apr 17 11:20:20.775641 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.775572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/db2e96d0-c3ea-45de-adef-6ba6babdab02-cabundle0\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.775804 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.775651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5t6\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-kube-api-access-7j5t6\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.775804 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.775735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.876805 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.876771 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.876949 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.876842 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/db2e96d0-c3ea-45de-adef-6ba6babdab02-cabundle0\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.876949 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.876873 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5t6\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-kube-api-access-7j5t6\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.876949 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:20.876932 2576 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Apr 17 11:20:20.877066 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:20.876961 2576 secret.go:281] references non-existent secret key: ca.crt Apr 17 11:20:20.877066 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:20.876968 2576 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Apr 17 11:20:20.877066 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:20.876980 2576 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-kw6xp: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Apr 17 11:20:20.877066 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:20.877034 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates podName:db2e96d0-c3ea-45de-adef-6ba6babdab02 nodeName:}" failed. No retries permitted until 2026-04-17 11:20:21.377015448 +0000 UTC m=+246.200779322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates") pod "keda-operator-ffbb595cb-kw6xp" (UID: "db2e96d0-c3ea-45de-adef-6ba6babdab02") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Apr 17 11:20:20.877464 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.877447 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/db2e96d0-c3ea-45de-adef-6ba6babdab02-cabundle0\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:20.887978 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:20.887947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5t6\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-kube-api-access-7j5t6\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:21.097221 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.097183 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w"] Apr 17 11:20:21.119879 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.119845 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.122418 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.122387 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w"] Apr 17 11:20:21.123189 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.123165 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Apr 17 11:20:21.281653 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.281619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-certificates\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.281809 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.281698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.281809 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.281775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7t6m\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-kube-api-access-p7t6m\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.318911 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.318874 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-6b6hr"] Apr 17 11:20:21.344527 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.344490 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-6b6hr"] Apr 17 11:20:21.344771 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.344638 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:21.346991 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.346962 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Apr 17 11:20:21.382894 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.382864 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.383060 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.382900 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7t6m\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-kube-api-access-p7t6m\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.383060 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.382929 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:21.383060 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.382992 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-certificates\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.383164 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383077 2576 secret.go:281] references non-existent secret key: tls.crt Apr 17 11:20:21.383164 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383091 2576 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Apr 17 11:20:21.383164 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383106 2576 projected.go:264] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Apr 17 11:20:21.383164 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383122 2576 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Apr 17 11:20:21.383164 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383079 2576 secret.go:281] references non-existent secret key: ca.crt Apr 17 11:20:21.383316 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383171 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-certificates podName:db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e nodeName:}" failed. No retries permitted until 2026-04-17 11:20:21.883152921 +0000 UTC m=+246.706916780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-certificates") pod "keda-metrics-apiserver-7c9f485588-6gb5w" (UID: "db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Apr 17 11:20:21.383316 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383170 2576 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Apr 17 11:20:21.383316 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383185 2576 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-kw6xp: references non-existent secret key: ca.crt Apr 17 11:20:21.383316 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.383206 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates podName:db2e96d0-c3ea-45de-adef-6ba6babdab02 nodeName:}" failed. No retries permitted until 2026-04-17 11:20:22.383198964 +0000 UTC m=+247.206962822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates") pod "keda-operator-ffbb595cb-kw6xp" (UID: "db2e96d0-c3ea-45de-adef-6ba6babdab02") : references non-existent secret key: ca.crt Apr 17 11:20:21.383450 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.383425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.392742 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.392711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7t6m\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-kube-api-access-p7t6m\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.484011 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.483970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-certificates\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:21.484190 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.484098 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjhk\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-kube-api-access-5fjhk\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:21.584819 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.584778 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-certificates\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:21.584995 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.584866 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjhk\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-kube-api-access-5fjhk\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:21.584995 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.584954 2576 projected.go:264] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Apr 17 11:20:21.584995 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.584979 2576 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-cf49989db-6b6hr: secret "keda-admission-webhooks-certs" not found Apr 17 11:20:21.585091 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:20:21.585044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-certificates podName:77c8a7a3-6271-4f4c-bf6d-f053104eed86 nodeName:}" failed. No retries permitted until 2026-04-17 11:20:22.08502607 +0000 UTC m=+246.908789940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-certificates") pod "keda-admission-cf49989db-6b6hr" (UID: "77c8a7a3-6271-4f4c-bf6d-f053104eed86") : secret "keda-admission-webhooks-certs" not found Apr 17 11:20:21.602113 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.602042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjhk\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-kube-api-access-5fjhk\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:21.889236 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.889148 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-certificates\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:21.891774 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:21.891753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e-certificates\") pod \"keda-metrics-apiserver-7c9f485588-6gb5w\" (UID: \"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:22.031661 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.031619 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:22.091565 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.091488 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-certificates\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:22.094050 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.094005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/77c8a7a3-6271-4f4c-bf6d-f053104eed86-certificates\") pod \"keda-admission-cf49989db-6b6hr\" (UID: \"77c8a7a3-6271-4f4c-bf6d-f053104eed86\") " pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:22.201502 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.201419 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w"] Apr 17 11:20:22.204421 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:20:22.204393 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5d650c_c819_4bd2_a6c2_a5fa5b3bf50e.slice/crio-81e4e7347c6849570edfea91f8ff92fa291642b4aacdb95330e755df004238bf WatchSource:0}: Error finding container 81e4e7347c6849570edfea91f8ff92fa291642b4aacdb95330e755df004238bf: Status 404 returned error can't find the container with id 81e4e7347c6849570edfea91f8ff92fa291642b4aacdb95330e755df004238bf Apr 17 11:20:22.254475 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.254448 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:22.367739 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.367702 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-6b6hr"] Apr 17 11:20:22.370572 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:20:22.370545 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c8a7a3_6271_4f4c_bf6d_f053104eed86.slice/crio-0696602e3d8a73752611fd1870ec4255fd4359069dac25abf77f099a7e8122f9 WatchSource:0}: Error finding container 0696602e3d8a73752611fd1870ec4255fd4359069dac25abf77f099a7e8122f9: Status 404 returned error can't find the container with id 0696602e3d8a73752611fd1870ec4255fd4359069dac25abf77f099a7e8122f9 Apr 17 11:20:22.394490 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.394460 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:22.397014 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.396989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/db2e96d0-c3ea-45de-adef-6ba6babdab02-certificates\") pod \"keda-operator-ffbb595cb-kw6xp\" (UID: \"db2e96d0-c3ea-45de-adef-6ba6babdab02\") " pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:22.513817 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.513786 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:22.635893 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.635863 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-kw6xp"] Apr 17 11:20:22.638878 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:20:22.638845 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2e96d0_c3ea_45de_adef_6ba6babdab02.slice/crio-baa1ed75008ed06bc3874870f5eb37467048a18dcfc2f1b9915668e38b5eee2d WatchSource:0}: Error finding container baa1ed75008ed06bc3874870f5eb37467048a18dcfc2f1b9915668e38b5eee2d: Status 404 returned error can't find the container with id baa1ed75008ed06bc3874870f5eb37467048a18dcfc2f1b9915668e38b5eee2d Apr 17 11:20:22.663448 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.663414 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" event={"ID":"db2e96d0-c3ea-45de-adef-6ba6babdab02","Type":"ContainerStarted","Data":"baa1ed75008ed06bc3874870f5eb37467048a18dcfc2f1b9915668e38b5eee2d"} Apr 17 11:20:22.664575 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.664545 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" event={"ID":"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e","Type":"ContainerStarted","Data":"81e4e7347c6849570edfea91f8ff92fa291642b4aacdb95330e755df004238bf"} Apr 17 11:20:22.665381 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:22.665360 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-6b6hr" event={"ID":"77c8a7a3-6271-4f4c-bf6d-f053104eed86","Type":"ContainerStarted","Data":"0696602e3d8a73752611fd1870ec4255fd4359069dac25abf77f099a7e8122f9"} Apr 17 11:20:26.679270 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.679231 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" event={"ID":"db2e96d0-c3ea-45de-adef-6ba6babdab02","Type":"ContainerStarted","Data":"7ed2110c39d9de2657c5a4b0a79172ba01c21396f53c981fe0ff66a5ece5a97d"} Apr 17 11:20:26.679764 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.679459 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:26.680553 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.680526 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" event={"ID":"db5d650c-c819-4bd2-a6c2-a5fa5b3bf50e","Type":"ContainerStarted","Data":"967e6f9d209d279c15d9cae92dc99f1676e3fc1985500b992bc1ba22f6aaf065"} Apr 17 11:20:26.680704 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.680562 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:26.681740 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.681719 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-6b6hr" event={"ID":"77c8a7a3-6271-4f4c-bf6d-f053104eed86","Type":"ContainerStarted","Data":"0d8b57c478725f99f5a3d7fe8101149d9369554bea7333fe5bc5cae853a5a506"} Apr 17 11:20:26.681843 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.681831 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:20:26.699447 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.699407 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" podStartSLOduration=3.527715892 podStartE2EDuration="6.699395477s" podCreationTimestamp="2026-04-17 11:20:20 +0000 UTC" firstStartedPulling="2026-04-17 11:20:22.640409829 +0000 UTC m=+247.464173702" lastFinishedPulling="2026-04-17 11:20:25.812089416 +0000 UTC m=+250.635853287" observedRunningTime="2026-04-17 11:20:26.69745888 +0000 UTC m=+251.521222775" watchObservedRunningTime="2026-04-17 11:20:26.699395477 +0000 UTC m=+251.523159357" Apr 17 11:20:26.714253 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.714199 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-6b6hr" podStartSLOduration=2.336081593 podStartE2EDuration="5.714185278s" podCreationTimestamp="2026-04-17 11:20:21 +0000 UTC" firstStartedPulling="2026-04-17 11:20:22.371932658 +0000 UTC m=+247.195696517" lastFinishedPulling="2026-04-17 11:20:25.750036335 +0000 UTC m=+250.573800202" observedRunningTime="2026-04-17 11:20:26.713277726 +0000 UTC m=+251.537041606" watchObservedRunningTime="2026-04-17 11:20:26.714185278 +0000 UTC m=+251.537949161" Apr 17 11:20:26.731512 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:26.731474 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" podStartSLOduration=2.178418095 podStartE2EDuration="5.731462934s" podCreationTimestamp="2026-04-17 11:20:21 +0000 UTC" firstStartedPulling="2026-04-17 11:20:22.205552759 +0000 UTC m=+247.029316618" lastFinishedPulling="2026-04-17 11:20:25.758597387 +0000 UTC m=+250.582361457" observedRunningTime="2026-04-17 11:20:26.729665468 +0000 UTC m=+251.553429347" watchObservedRunningTime="2026-04-17 11:20:26.731462934 +0000 UTC m=+251.555226813" Apr 17 11:20:37.690334 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:37.690306 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-6gb5w" Apr 17 11:20:41.661629 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:41.661572 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-v9n6p" Apr 17 11:20:47.687437 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:47.687408 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-kw6xp" Apr 17 11:20:47.687841 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:20:47.687538 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-6b6hr" Apr 17 11:21:15.666347 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:15.666306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:21:15.667046 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:15.667022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:21:15.674295 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:15.674266 2576 kubelet.go:1628] "Image garbage collection succeeded" Apr 17 11:21:28.445293 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.445256 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-x4wh6"] Apr 17 11:21:28.448293 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.448277 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.450361 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.450341 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Apr 17 11:21:28.450450 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.450341 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Apr 17 11:21:28.450951 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.450935 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-fg57s\"" Apr 17 11:21:28.451023 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.450942 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Apr 17 11:21:28.456334 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.456314 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-2wntg"] Apr 17 11:21:28.459656 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.459640 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-x4wh6"] Apr 17 11:21:28.459741 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.459730 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.461531 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.461510 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-fqt22\"" Apr 17 11:21:28.461647 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.461558 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Apr 17 11:21:28.470189 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.469400 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-2wntg"] Apr 17 11:21:28.615679 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.615647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8403fd9-3745-4574-b251-454eef01b42e-cert\") pod \"kserve-controller-manager-7dcb9f9f85-x4wh6\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.615834 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.615688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/a8403fd9-3745-4574-b251-454eef01b42e-kube-api-access-qmrw6\") pod \"kserve-controller-manager-7dcb9f9f85-x4wh6\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.615834 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.615709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6hl8\" (UniqueName: \"kubernetes.io/projected/c5ee0bb3-521b-4644-ad3a-abf2f83c1801-kube-api-access-v6hl8\") pod \"llmisvc-controller-manager-68cc5db7c4-2wntg\" (UID: \"c5ee0bb3-521b-4644-ad3a-abf2f83c1801\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.615906 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.615867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ee0bb3-521b-4644-ad3a-abf2f83c1801-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-2wntg\" (UID: \"c5ee0bb3-521b-4644-ad3a-abf2f83c1801\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.716558 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.716475 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ee0bb3-521b-4644-ad3a-abf2f83c1801-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-2wntg\" (UID: \"c5ee0bb3-521b-4644-ad3a-abf2f83c1801\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.716558 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.716536 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8403fd9-3745-4574-b251-454eef01b42e-cert\") pod \"kserve-controller-manager-7dcb9f9f85-x4wh6\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.716558 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.716559 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/a8403fd9-3745-4574-b251-454eef01b42e-kube-api-access-qmrw6\") pod \"kserve-controller-manager-7dcb9f9f85-x4wh6\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.716792 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.716576 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6hl8\" (UniqueName: \"kubernetes.io/projected/c5ee0bb3-521b-4644-ad3a-abf2f83c1801-kube-api-access-v6hl8\") pod \"llmisvc-controller-manager-68cc5db7c4-2wntg\" (UID: \"c5ee0bb3-521b-4644-ad3a-abf2f83c1801\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.718913 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.718889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8403fd9-3745-4574-b251-454eef01b42e-cert\") pod \"kserve-controller-manager-7dcb9f9f85-x4wh6\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.719016 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.718937 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ee0bb3-521b-4644-ad3a-abf2f83c1801-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-2wntg\" (UID: \"c5ee0bb3-521b-4644-ad3a-abf2f83c1801\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.724843 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.724809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/a8403fd9-3745-4574-b251-454eef01b42e-kube-api-access-qmrw6\") pod \"kserve-controller-manager-7dcb9f9f85-x4wh6\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.724954 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.724859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6hl8\" (UniqueName: \"kubernetes.io/projected/c5ee0bb3-521b-4644-ad3a-abf2f83c1801-kube-api-access-v6hl8\") pod \"llmisvc-controller-manager-68cc5db7c4-2wntg\" (UID: \"c5ee0bb3-521b-4644-ad3a-abf2f83c1801\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.759145 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.759118 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:21:28.769946 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.769920 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:28.889665 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.889641 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-x4wh6"] Apr 17 11:21:28.892049 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:21:28.892014 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8403fd9_3745_4574_b251_454eef01b42e.slice/crio-83e3ce4e42fe4863cbca138bf11904f71d430f4c5562f00f08540cc1cbb9ee35 WatchSource:0}: Error finding container 83e3ce4e42fe4863cbca138bf11904f71d430f4c5562f00f08540cc1cbb9ee35: Status 404 returned error can't find the container with id 83e3ce4e42fe4863cbca138bf11904f71d430f4c5562f00f08540cc1cbb9ee35 Apr 17 11:21:28.893543 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.893523 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 11:21:28.907039 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:28.907007 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-2wntg"] Apr 17 11:21:28.911172 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:21:28.911146 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5ee0bb3_521b_4644_ad3a_abf2f83c1801.slice/crio-9b6c5c50698e8c93aef3cdefa22bcaa423df72791e24d311137802d848602802 WatchSource:0}: Error finding container 9b6c5c50698e8c93aef3cdefa22bcaa423df72791e24d311137802d848602802: Status 404 returned error can't find the container with id 9b6c5c50698e8c93aef3cdefa22bcaa423df72791e24d311137802d848602802 Apr 17 11:21:29.865419 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:29.865374 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" event={"ID":"c5ee0bb3-521b-4644-ad3a-abf2f83c1801","Type":"ContainerStarted","Data":"9b6c5c50698e8c93aef3cdefa22bcaa423df72791e24d311137802d848602802"} Apr 17 11:21:29.866818 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:29.866789 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" event={"ID":"a8403fd9-3745-4574-b251-454eef01b42e","Type":"ContainerStarted","Data":"83e3ce4e42fe4863cbca138bf11904f71d430f4c5562f00f08540cc1cbb9ee35"} Apr 17 11:21:31.874269 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:31.874228 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" event={"ID":"c5ee0bb3-521b-4644-ad3a-abf2f83c1801","Type":"ContainerStarted","Data":"60794dea4cead3666ffaaff4f16620becdabf569891b918ef7350004c2607ac5"} Apr 17 11:21:31.874749 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:31.874346 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:21:31.899540 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:31.899489 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" podStartSLOduration=1.346052683 podStartE2EDuration="3.899467337s" podCreationTimestamp="2026-04-17 11:21:28 +0000 UTC" firstStartedPulling="2026-04-17 11:21:28.911920263 +0000 UTC m=+313.735684125" lastFinishedPulling="2026-04-17 11:21:31.465334917 +0000 UTC m=+316.289098779" observedRunningTime="2026-04-17 11:21:31.897200186 +0000 UTC m=+316.720964068" watchObservedRunningTime="2026-04-17 11:21:31.899467337 +0000 UTC m=+316.723231219" Apr 17 11:21:32.878707 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:32.878671 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" event={"ID":"a8403fd9-3745-4574-b251-454eef01b42e","Type":"ContainerStarted","Data":"df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811"} Apr 17 11:21:32.895535 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:32.895463 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" podStartSLOduration=1.368335218 podStartE2EDuration="4.895449466s" podCreationTimestamp="2026-04-17 11:21:28 +0000 UTC" firstStartedPulling="2026-04-17 11:21:28.893695744 +0000 UTC m=+313.717459602" lastFinishedPulling="2026-04-17 11:21:32.42080998 +0000 UTC m=+317.244573850" observedRunningTime="2026-04-17 11:21:32.893391188 +0000 UTC m=+317.717155068" watchObservedRunningTime="2026-04-17 11:21:32.895449466 +0000 UTC m=+317.719213378" Apr 17 11:21:33.882283 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:21:33.882255 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:22:02.881244 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:02.881161 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-68cc5db7c4-2wntg" Apr 17 11:22:04.084456 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.084421 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-x4wh6"] Apr 17 11:22:04.084894 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.084667 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" podUID="a8403fd9-3745-4574-b251-454eef01b42e" containerName="manager" containerID="cri-o://df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811" gracePeriod=10 Apr 17 11:22:04.089724 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.089697 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:22:04.110733 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.110706 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-mlnsg"] Apr 17 11:22:04.114092 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.114069 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.123012 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.122985 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-mlnsg"] Apr 17 11:22:04.165984 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.165949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f172c625-e41a-43a5-afec-60850e549aed-cert\") pod \"kserve-controller-manager-7dcb9f9f85-mlnsg\" (UID: \"f172c625-e41a-43a5-afec-60850e549aed\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.166119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.166009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tzw4\" (UniqueName: \"kubernetes.io/projected/f172c625-e41a-43a5-afec-60850e549aed-kube-api-access-4tzw4\") pod \"kserve-controller-manager-7dcb9f9f85-mlnsg\" (UID: \"f172c625-e41a-43a5-afec-60850e549aed\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.267081 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.267054 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f172c625-e41a-43a5-afec-60850e549aed-cert\") pod \"kserve-controller-manager-7dcb9f9f85-mlnsg\" (UID: \"f172c625-e41a-43a5-afec-60850e549aed\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.267220 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.267113 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tzw4\" (UniqueName: \"kubernetes.io/projected/f172c625-e41a-43a5-afec-60850e549aed-kube-api-access-4tzw4\") pod \"kserve-controller-manager-7dcb9f9f85-mlnsg\" (UID: \"f172c625-e41a-43a5-afec-60850e549aed\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.270153 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.270124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f172c625-e41a-43a5-afec-60850e549aed-cert\") pod \"kserve-controller-manager-7dcb9f9f85-mlnsg\" (UID: \"f172c625-e41a-43a5-afec-60850e549aed\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.275739 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.275713 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tzw4\" (UniqueName: \"kubernetes.io/projected/f172c625-e41a-43a5-afec-60850e549aed-kube-api-access-4tzw4\") pod \"kserve-controller-manager-7dcb9f9f85-mlnsg\" (UID: \"f172c625-e41a-43a5-afec-60850e549aed\") " pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.313318 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.313298 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:22:04.367456 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.367383 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/a8403fd9-3745-4574-b251-454eef01b42e-kube-api-access-qmrw6\") pod \"a8403fd9-3745-4574-b251-454eef01b42e\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " Apr 17 11:22:04.367456 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.367428 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8403fd9-3745-4574-b251-454eef01b42e-cert\") pod \"a8403fd9-3745-4574-b251-454eef01b42e\" (UID: \"a8403fd9-3745-4574-b251-454eef01b42e\") " Apr 17 11:22:04.369477 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.369443 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8403fd9-3745-4574-b251-454eef01b42e-cert" (OuterVolumeSpecName: "cert") pod "a8403fd9-3745-4574-b251-454eef01b42e" (UID: "a8403fd9-3745-4574-b251-454eef01b42e"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 11:22:04.369569 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.369447 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8403fd9-3745-4574-b251-454eef01b42e-kube-api-access-qmrw6" (OuterVolumeSpecName: "kube-api-access-qmrw6") pod "a8403fd9-3745-4574-b251-454eef01b42e" (UID: "a8403fd9-3745-4574-b251-454eef01b42e"). InnerVolumeSpecName "kube-api-access-qmrw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 11:22:04.458270 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.458233 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:04.468256 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.468230 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmrw6\" (UniqueName: \"kubernetes.io/projected/a8403fd9-3745-4574-b251-454eef01b42e-kube-api-access-qmrw6\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:22:04.468256 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.468256 2576 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8403fd9-3745-4574-b251-454eef01b42e-cert\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:22:04.575741 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.575701 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-mlnsg"] Apr 17 11:22:04.578422 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:22:04.578394 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf172c625_e41a_43a5_afec_60850e549aed.slice/crio-edb9d36baaa3e6e59ae4f354afe369e8ff4b9343a0e89a7648f541554505a0ba WatchSource:0}: Error finding container edb9d36baaa3e6e59ae4f354afe369e8ff4b9343a0e89a7648f541554505a0ba: Status 404 returned error can't find the container with id edb9d36baaa3e6e59ae4f354afe369e8ff4b9343a0e89a7648f541554505a0ba Apr 17 11:22:04.971909 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.971809 2576 generic.go:358] "Generic (PLEG): container finished" podID="a8403fd9-3745-4574-b251-454eef01b42e" containerID="df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811" exitCode=0 Apr 17 11:22:04.971909 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.971869 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" event={"ID":"a8403fd9-3745-4574-b251-454eef01b42e","Type":"ContainerDied","Data":"df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811"} Apr 17 11:22:04.971909 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.971901 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" event={"ID":"a8403fd9-3745-4574-b251-454eef01b42e","Type":"ContainerDied","Data":"83e3ce4e42fe4863cbca138bf11904f71d430f4c5562f00f08540cc1cbb9ee35"} Apr 17 11:22:04.971909 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.971871 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcb9f9f85-x4wh6" Apr 17 11:22:04.972125 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.971917 2576 scope.go:117] "RemoveContainer" containerID="df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811" Apr 17 11:22:04.973053 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.973031 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" event={"ID":"f172c625-e41a-43a5-afec-60850e549aed","Type":"ContainerStarted","Data":"edb9d36baaa3e6e59ae4f354afe369e8ff4b9343a0e89a7648f541554505a0ba"} Apr 17 11:22:04.980404 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.980387 2576 scope.go:117] "RemoveContainer" containerID="df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811" Apr 17 11:22:04.980658 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:22:04.980640 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811\": container with ID starting with df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811 not found: ID does not exist" containerID="df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811" Apr 17 11:22:04.980701 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:04.980666 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811"} err="failed to get container status \"df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811\": rpc error: code = NotFound desc = could not find container \"df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811\": container with ID starting with df1cbb6eacc2b49143696e91c1ca76dec8e8b29ed0248103ab6559a0758f3811 not found: ID does not exist" Apr 17 11:22:05.004498 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:05.004478 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-x4wh6"] Apr 17 11:22:05.008521 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:05.008502 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7dcb9f9f85-x4wh6"] Apr 17 11:22:05.799763 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:05.799728 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8403fd9-3745-4574-b251-454eef01b42e" path="/var/lib/kubelet/pods/a8403fd9-3745-4574-b251-454eef01b42e/volumes" Apr 17 11:22:05.977873 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:05.977831 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" event={"ID":"f172c625-e41a-43a5-afec-60850e549aed","Type":"ContainerStarted","Data":"99be00ea7de22a58a17d285dd91d47b6f3af4a1c07448b296b73058ff8b993d7"} Apr 17 11:22:05.978036 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:05.977946 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:05.995344 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:05.995283 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" podStartSLOduration=1.614188658 podStartE2EDuration="1.995262787s" podCreationTimestamp="2026-04-17 11:22:04 +0000 UTC" firstStartedPulling="2026-04-17 11:22:04.579630535 +0000 UTC m=+349.403394394" lastFinishedPulling="2026-04-17 11:22:04.960704665 +0000 UTC m=+349.784468523" observedRunningTime="2026-04-17 11:22:05.993842408 +0000 UTC m=+350.817606271" watchObservedRunningTime="2026-04-17 11:22:05.995262787 +0000 UTC m=+350.819026668" Apr 17 11:22:32.768657 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.768623 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f48c45ff5-9whsd"] Apr 17 11:22:32.769236 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.769153 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8403fd9-3745-4574-b251-454eef01b42e" containerName="manager" Apr 17 11:22:32.769236 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.769173 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8403fd9-3745-4574-b251-454eef01b42e" containerName="manager" Apr 17 11:22:32.769359 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.769271 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8403fd9-3745-4574-b251-454eef01b42e" containerName="manager" Apr 17 11:22:32.772067 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.772046 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.782009 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.781985 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f48c45ff5-9whsd"] Apr 17 11:22:32.884153 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-trusted-ca-bundle\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.884262 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qwps\" (UniqueName: \"kubernetes.io/projected/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-kube-api-access-7qwps\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.884262 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-serving-cert\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.884262 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-config\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.884262 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-oauth-config\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.884262 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-service-ca\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.884432 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.884323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-oauth-serving-cert\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985008 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.984984 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-oauth-serving-cert\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985021 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-trusted-ca-bundle\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985037 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qwps\" (UniqueName: \"kubernetes.io/projected/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-kube-api-access-7qwps\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985073 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-serving-cert\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985119 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985099 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-config\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985289 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985125 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-oauth-config\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985289 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985171 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-service-ca\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985755 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-oauth-serving-cert\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.985912 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-config\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.986024 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-trusted-ca-bundle\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.986024 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.985913 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-service-ca\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.987491 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.987467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-serving-cert\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.987567 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.987485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-console-oauth-config\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:32.993359 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:32.993339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qwps\" (UniqueName: \"kubernetes.io/projected/0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc-kube-api-access-7qwps\") pod \"console-f48c45ff5-9whsd\" (UID: \"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc\") " pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:33.080995 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:33.080934 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:33.195068 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:33.195034 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f48c45ff5-9whsd"] Apr 17 11:22:33.197564 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:22:33.197535 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0beaf6bb_c7e5_4f78_b4f5_36fdbd997dcc.slice/crio-3bdf37cdfacb0ede64a81412a9097288582efa43daf80960c49cb1581cef53f4 WatchSource:0}: Error finding container 3bdf37cdfacb0ede64a81412a9097288582efa43daf80960c49cb1581cef53f4: Status 404 returned error can't find the container with id 3bdf37cdfacb0ede64a81412a9097288582efa43daf80960c49cb1581cef53f4 Apr 17 11:22:34.066719 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:34.066681 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f48c45ff5-9whsd" event={"ID":"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc","Type":"ContainerStarted","Data":"820968c0fe459ce9edb01d22a684d367825160c820841b7f16e715a59083c5e0"} Apr 17 11:22:34.067055 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:34.066723 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f48c45ff5-9whsd" event={"ID":"0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc","Type":"ContainerStarted","Data":"3bdf37cdfacb0ede64a81412a9097288582efa43daf80960c49cb1581cef53f4"} Apr 17 11:22:34.085001 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:34.084951 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f48c45ff5-9whsd" podStartSLOduration=2.084933057 podStartE2EDuration="2.084933057s" podCreationTimestamp="2026-04-17 11:22:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 11:22:34.083127807 +0000 UTC m=+378.906891687" watchObservedRunningTime="2026-04-17 11:22:34.084933057 +0000 UTC m=+378.908696938" Apr 17 11:22:36.987235 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:36.987203 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcb9f9f85-mlnsg" Apr 17 11:22:37.870478 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.870442 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-lk8pd"] Apr 17 11:22:37.873841 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.873817 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:37.876157 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.876137 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-t6rh4\"" Apr 17 11:22:37.876246 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.876197 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Apr 17 11:22:37.884114 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.884097 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-lk8pd"] Apr 17 11:22:37.923222 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.923197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbk6f\" (UniqueName: \"kubernetes.io/projected/ffd9b152-78fa-42c8-8921-e1f1599c41ea-kube-api-access-hbk6f\") pod \"model-serving-api-86f7b4b499-lk8pd\" (UID: \"ffd9b152-78fa-42c8-8921-e1f1599c41ea\") " pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:37.923306 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:37.923227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffd9b152-78fa-42c8-8921-e1f1599c41ea-tls-certs\") pod \"model-serving-api-86f7b4b499-lk8pd\" (UID: \"ffd9b152-78fa-42c8-8921-e1f1599c41ea\") " pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:38.024411 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:38.024384 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbk6f\" (UniqueName: \"kubernetes.io/projected/ffd9b152-78fa-42c8-8921-e1f1599c41ea-kube-api-access-hbk6f\") pod \"model-serving-api-86f7b4b499-lk8pd\" (UID: \"ffd9b152-78fa-42c8-8921-e1f1599c41ea\") " pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:38.024411 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:38.024414 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffd9b152-78fa-42c8-8921-e1f1599c41ea-tls-certs\") pod \"model-serving-api-86f7b4b499-lk8pd\" (UID: \"ffd9b152-78fa-42c8-8921-e1f1599c41ea\") " pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:38.026670 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:38.026653 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffd9b152-78fa-42c8-8921-e1f1599c41ea-tls-certs\") pod \"model-serving-api-86f7b4b499-lk8pd\" (UID: \"ffd9b152-78fa-42c8-8921-e1f1599c41ea\") " pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:38.032647 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:38.032623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbk6f\" (UniqueName: \"kubernetes.io/projected/ffd9b152-78fa-42c8-8921-e1f1599c41ea-kube-api-access-hbk6f\") pod \"model-serving-api-86f7b4b499-lk8pd\" (UID: \"ffd9b152-78fa-42c8-8921-e1f1599c41ea\") " pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:38.185353 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:38.185297 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:38.304675 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:38.304649 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-lk8pd"] Apr 17 11:22:38.307555 ip-10-0-130-188 kubenswrapper[2576]: W0417 11:22:38.307528 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd9b152_78fa_42c8_8921_e1f1599c41ea.slice/crio-7a90006310b37d86d43aedcee439836d62aec0d45ff0e847ce17fbcbf27faac3 WatchSource:0}: Error finding container 7a90006310b37d86d43aedcee439836d62aec0d45ff0e847ce17fbcbf27faac3: Status 404 returned error can't find the container with id 7a90006310b37d86d43aedcee439836d62aec0d45ff0e847ce17fbcbf27faac3 Apr 17 11:22:39.083389 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:39.083357 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-lk8pd" event={"ID":"ffd9b152-78fa-42c8-8921-e1f1599c41ea","Type":"ContainerStarted","Data":"7a90006310b37d86d43aedcee439836d62aec0d45ff0e847ce17fbcbf27faac3"} Apr 17 11:22:40.087895 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:40.087860 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-lk8pd" event={"ID":"ffd9b152-78fa-42c8-8921-e1f1599c41ea","Type":"ContainerStarted","Data":"ea7c0b025eb7e39de92ce06b685a7614b2a2369796bdff8783aa9e818d88c91a"} Apr 17 11:22:40.088288 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:40.087911 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:22:40.102853 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:40.102805 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-lk8pd" podStartSLOduration=1.430153609 podStartE2EDuration="3.102788871s" podCreationTimestamp="2026-04-17 11:22:37 +0000 UTC" firstStartedPulling="2026-04-17 11:22:38.309317408 +0000 UTC m=+383.133081266" lastFinishedPulling="2026-04-17 11:22:39.98195267 +0000 UTC m=+384.805716528" observedRunningTime="2026-04-17 11:22:40.102180328 +0000 UTC m=+384.925944220" watchObservedRunningTime="2026-04-17 11:22:40.102788871 +0000 UTC m=+384.926552753" Apr 17 11:22:43.081662 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:43.081631 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:43.082101 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:43.081671 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:43.085795 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:43.085774 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:43.102049 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:43.102026 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f48c45ff5-9whsd" Apr 17 11:22:43.151451 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:43.151425 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568545866d-c5lkh"] Apr 17 11:22:51.095303 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:22:51.095278 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-lk8pd" Apr 17 11:23:08.171392 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.171292 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-568545866d-c5lkh" podUID="41fc724e-e37c-4e47-bcdb-039e10878d7e" containerName="console" containerID="cri-o://25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df" gracePeriod=15 Apr 17 11:23:08.325977 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.325944 2576 patch_prober.go:28] interesting pod/console-568545866d-c5lkh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body= Apr 17 11:23:08.326111 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.325996 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-568545866d-c5lkh" podUID="41fc724e-e37c-4e47-bcdb-039e10878d7e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" Apr 17 11:23:08.409078 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.409058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-568545866d-c5lkh_41fc724e-e37c-4e47-bcdb-039e10878d7e/console/0.log" Apr 17 11:23:08.409184 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.409117 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:23:08.561235 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561203 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-serving-cert\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561384 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561260 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-trusted-ca-bundle\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561384 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561278 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk5pv\" (UniqueName: \"kubernetes.io/projected/41fc724e-e37c-4e47-bcdb-039e10878d7e-kube-api-access-lk5pv\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561384 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561299 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-config\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561514 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561420 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-oauth-config\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561514 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561458 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-service-ca\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561514 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561487 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-oauth-serving-cert\") pod \"41fc724e-e37c-4e47-bcdb-039e10878d7e\" (UID: \"41fc724e-e37c-4e47-bcdb-039e10878d7e\") " Apr 17 11:23:08.561789 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:23:08.561929 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561763 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-config" (OuterVolumeSpecName: "console-config") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:23:08.561929 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561825 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:23:08.562050 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.561999 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 11:23:08.563438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.563404 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 11:23:08.563527 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.563482 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41fc724e-e37c-4e47-bcdb-039e10878d7e-kube-api-access-lk5pv" (OuterVolumeSpecName: "kube-api-access-lk5pv") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "kube-api-access-lk5pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 11:23:08.563527 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.563518 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41fc724e-e37c-4e47-bcdb-039e10878d7e" (UID: "41fc724e-e37c-4e47-bcdb-039e10878d7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 11:23:08.662369 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662348 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-serving-cert\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:08.662369 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662367 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-trusted-ca-bundle\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:08.662486 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662377 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk5pv\" (UniqueName: \"kubernetes.io/projected/41fc724e-e37c-4e47-bcdb-039e10878d7e-kube-api-access-lk5pv\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:08.662486 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662386 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-config\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:08.662486 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662395 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41fc724e-e37c-4e47-bcdb-039e10878d7e-console-oauth-config\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:08.662486 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662403 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-service-ca\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:08.662486 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:08.662411 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41fc724e-e37c-4e47-bcdb-039e10878d7e-oauth-serving-cert\") on node \"ip-10-0-130-188.ec2.internal\" DevicePath \"\"" Apr 17 11:23:09.175942 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.175919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-568545866d-c5lkh_41fc724e-e37c-4e47-bcdb-039e10878d7e/console/0.log" Apr 17 11:23:09.176304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.175958 2576 generic.go:358] "Generic (PLEG): container finished" podID="41fc724e-e37c-4e47-bcdb-039e10878d7e" containerID="25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df" exitCode=2 Apr 17 11:23:09.176304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.176046 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568545866d-c5lkh" event={"ID":"41fc724e-e37c-4e47-bcdb-039e10878d7e","Type":"ContainerDied","Data":"25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df"} Apr 17 11:23:09.176304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.176056 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568545866d-c5lkh" Apr 17 11:23:09.176304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.176085 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568545866d-c5lkh" event={"ID":"41fc724e-e37c-4e47-bcdb-039e10878d7e","Type":"ContainerDied","Data":"53b8242141e43145fa4390f2a630e1ad039a2a84a1e8b24d7749bedf3d06d795"} Apr 17 11:23:09.176304 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.176099 2576 scope.go:117] "RemoveContainer" containerID="25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df" Apr 17 11:23:09.184716 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.184698 2576 scope.go:117] "RemoveContainer" containerID="25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df" Apr 17 11:23:09.184953 ip-10-0-130-188 kubenswrapper[2576]: E0417 11:23:09.184935 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df\": container with ID starting with 25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df not found: ID does not exist" containerID="25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df" Apr 17 11:23:09.185014 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.184959 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df"} err="failed to get container status \"25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df\": rpc error: code = NotFound desc = could not find container \"25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df\": container with ID starting with 25971c04f9910e7a9bb46d9b00cf58ebde916f50e856a85b892541b8a2b0b8df not found: ID does not exist" Apr 17 11:23:09.198745 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.198724 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568545866d-c5lkh"] Apr 17 11:23:09.204488 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.204472 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568545866d-c5lkh"] Apr 17 11:23:09.798858 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:09.798824 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41fc724e-e37c-4e47-bcdb-039e10878d7e" path="/var/lib/kubelet/pods/41fc724e-e37c-4e47-bcdb-039e10878d7e/volumes" Apr 17 11:23:56.850750 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:56.850723 2576 ???:1] "http: TLS handshake error from 10.0.133.190:54910: EOF" Apr 17 11:23:56.852378 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:56.852359 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8zdsn_0786bd97-6959-432d-b9d0-e710ab215ae2/global-pull-secret-syncer/0.log" Apr 17 11:23:57.052140 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:57.052118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bkvlp_4ab650d2-2c24-4fe2-a077-de6d2b170818/konnectivity-agent/0.log" Apr 17 11:23:57.201092 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:23:57.201009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-188.ec2.internal_8c94f84787f30fa393199c7cbd48cbbc/haproxy/0.log" Apr 17 11:24:00.489718 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:00.489690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fffd5d994-zd527_846d55b7-b479-419d-9c70-2704972ac4a0/metrics-server/0.log" Apr 17 11:24:00.622508 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:00.622484 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qcpd_93790766-417d-4bd6-ba29-d9588341992e/node-exporter/0.log" Apr 17 11:24:00.642738 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:00.642714 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qcpd_93790766-417d-4bd6-ba29-d9588341992e/kube-rbac-proxy/0.log" Apr 17 11:24:00.664916 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:00.664896 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qcpd_93790766-417d-4bd6-ba29-d9588341992e/init-textfile/0.log" Apr 17 11:24:01.180651 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.180623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-gk2gv_d7107136-aa34-4193-9560-daa5747f91b7/prometheus-operator/0.log" Apr 17 11:24:01.200507 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.200487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-gk2gv_d7107136-aa34-4193-9560-daa5747f91b7/kube-rbac-proxy/0.log" Apr 17 11:24:01.253982 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.253962 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b6c6978c-qn7ng_e3c5e4b7-45e2-423a-80d9-ecda1973faf4/telemeter-client/0.log" Apr 17 11:24:01.281356 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.281339 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b6c6978c-qn7ng_e3c5e4b7-45e2-423a-80d9-ecda1973faf4/reload/0.log" Apr 17 11:24:01.301140 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.301122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74b6c6978c-qn7ng_e3c5e4b7-45e2-423a-80d9-ecda1973faf4/kube-rbac-proxy/0.log" Apr 17 11:24:01.329393 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.329371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f765bf9-hv7jt_70ea5b67-2854-4270-92a0-489575df47a4/thanos-query/0.log" Apr 17 11:24:01.350815 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.350793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f765bf9-hv7jt_70ea5b67-2854-4270-92a0-489575df47a4/kube-rbac-proxy-web/0.log" Apr 17 11:24:01.370002 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.369984 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f765bf9-hv7jt_70ea5b67-2854-4270-92a0-489575df47a4/kube-rbac-proxy/0.log" Apr 17 11:24:01.390921 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.390903 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f765bf9-hv7jt_70ea5b67-2854-4270-92a0-489575df47a4/prom-label-proxy/0.log" Apr 17 11:24:01.412686 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.412668 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f765bf9-hv7jt_70ea5b67-2854-4270-92a0-489575df47a4/kube-rbac-proxy-rules/0.log" Apr 17 11:24:01.436207 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:01.436159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86f765bf9-hv7jt_70ea5b67-2854-4270-92a0-489575df47a4/kube-rbac-proxy-metrics/0.log" Apr 17 11:24:03.494875 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:03.494852 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f48c45ff5-9whsd_0beaf6bb-c7e5-4f78-b4f5-36fdbd997dcc/console/0.log" Apr 17 11:24:04.518252 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.518224 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm"] Apr 17 11:24:04.518618 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.518509 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41fc724e-e37c-4e47-bcdb-039e10878d7e" containerName="console" Apr 17 11:24:04.518618 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.518518 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41fc724e-e37c-4e47-bcdb-039e10878d7e" containerName="console" Apr 17 11:24:04.518618 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.518580 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="41fc724e-e37c-4e47-bcdb-039e10878d7e" containerName="console" Apr 17 11:24:04.521509 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.521486 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.524388 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.524368 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7s657\"/\"default-dockercfg-7h8qt\"" Apr 17 11:24:04.524673 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.524659 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7s657\"/\"kube-root-ca.crt\"" Apr 17 11:24:04.524726 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.524660 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7s657\"/\"openshift-service-ca.crt\"" Apr 17 11:24:04.534170 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.534147 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm"] Apr 17 11:24:04.558992 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.558967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-lib-modules\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.559074 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.558995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-sys\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.559074 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.559011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-proc\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.559074 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.559029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4t4\" (UniqueName: \"kubernetes.io/projected/b2767cf6-da83-486e-8cdc-0443ea8ef494-kube-api-access-9j4t4\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.559171 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.559106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-podres\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660267 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660229 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-lib-modules\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660267 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660266 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-sys\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660284 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-proc\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660301 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4t4\" (UniqueName: \"kubernetes.io/projected/b2767cf6-da83-486e-8cdc-0443ea8ef494-kube-api-access-9j4t4\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660355 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-podres\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-proc\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-sys\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660438 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-lib-modules\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.660666 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.660486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b2767cf6-da83-486e-8cdc-0443ea8ef494-podres\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.670884 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.670862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4t4\" (UniqueName: \"kubernetes.io/projected/b2767cf6-da83-486e-8cdc-0443ea8ef494-kube-api-access-9j4t4\") pod \"perf-node-gather-daemonset-mjghm\" (UID: \"b2767cf6-da83-486e-8cdc-0443ea8ef494\") " pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.762253 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.762209 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqjk4_5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa/dns/0.log" Apr 17 11:24:04.781259 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.781200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqjk4_5b4c7d4f-6f43-42d1-bbc0-e5f14e6f89aa/kube-rbac-proxy/0.log" Apr 17 11:24:04.830328 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.830307 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:04.850435 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.850404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bltmr_0a4672b1-7b40-4c9b-824a-8a50e03d7175/dns-node-resolver/0.log" Apr 17 11:24:04.948640 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:04.946810 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm"] Apr 17 11:24:05.333873 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:05.333838 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7664589ff7-rzqsr_b26d8334-aad9-41e4-8307-6a2aa8f2c818/registry/0.log" Apr 17 11:24:05.350247 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:05.350219 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" event={"ID":"b2767cf6-da83-486e-8cdc-0443ea8ef494","Type":"ContainerStarted","Data":"fc4574332435c1828d9cb9be76e459449e541969dc8447b91da4c51d5a9847fd"} Apr 17 11:24:05.350247 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:05.350252 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" event={"ID":"b2767cf6-da83-486e-8cdc-0443ea8ef494","Type":"ContainerStarted","Data":"4fc240234b27cc9659f9f0638933ce9e827e2be4bd7bf732239e61b7c2841f9d"} Apr 17 11:24:05.350441 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:05.350281 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:05.363969 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:05.363923 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" podStartSLOduration=1.363911112 podStartE2EDuration="1.363911112s" podCreationTimestamp="2026-04-17 11:24:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 11:24:05.363658511 +0000 UTC m=+470.187422390" watchObservedRunningTime="2026-04-17 11:24:05.363911112 +0000 UTC m=+470.187674992" Apr 17 11:24:05.398029 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:05.398009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mh2fr_f0998c63-b88c-4e5d-b5f5-4d1e823dda43/node-ca/0.log" Apr 17 11:24:06.428282 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:06.428250 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2zxhl_c9ae08f7-e218-44e4-a0d0-01d83fb2644a/serve-healthcheck-canary/0.log" Apr 17 11:24:06.900257 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:06.900231 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jc5j_d908fd92-e82b-4cde-8075-72fd1e7a7862/kube-rbac-proxy/0.log" Apr 17 11:24:06.920214 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:06.920185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jc5j_d908fd92-e82b-4cde-8075-72fd1e7a7862/exporter/0.log" Apr 17 11:24:06.939957 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:06.939936 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jc5j_d908fd92-e82b-4cde-8075-72fd1e7a7862/extractor/0.log" Apr 17 11:24:08.902268 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:08.902242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7dcb9f9f85-mlnsg_f172c625-e41a-43a5-afec-60850e549aed/manager/0.log" Apr 17 11:24:08.925531 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:08.925505 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-68cc5db7c4-2wntg_c5ee0bb3-521b-4644-ad3a-abf2f83c1801/manager/0.log" Apr 17 11:24:08.945418 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:08.945398 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-lk8pd_ffd9b152-78fa-42c8-8921-e1f1599c41ea/server/0.log" Apr 17 11:24:11.364976 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:11.364942 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7s657/perf-node-gather-daemonset-mjghm" Apr 17 11:24:14.344982 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.344953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/kube-multus-additional-cni-plugins/0.log" Apr 17 11:24:14.372763 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.372743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/egress-router-binary-copy/0.log" Apr 17 11:24:14.409840 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.409823 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/cni-plugins/0.log" Apr 17 11:24:14.432721 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.432696 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/bond-cni-plugin/0.log" Apr 17 11:24:14.455910 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.455894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/routeoverride-cni/0.log" Apr 17 11:24:14.475351 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.475299 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/whereabouts-cni-bincopy/0.log" Apr 17 11:24:14.496783 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.496753 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x2cw_1f736420-e15c-4069-947e-5fba427835fb/whereabouts-cni/0.log" Apr 17 11:24:14.861682 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.861656 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xlg6c_26288be6-4e7e-4bc3-b559-1a6808a040ac/kube-multus/0.log" Apr 17 11:24:14.885931 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.885908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-47s58_87c84598-6174-4e54-9961-2dc53effa865/network-metrics-daemon/0.log" Apr 17 11:24:14.905547 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:14.905518 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-47s58_87c84598-6174-4e54-9961-2dc53effa865/kube-rbac-proxy/0.log" Apr 17 11:24:16.442933 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.442907 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-controller/0.log" Apr 17 11:24:16.461705 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.461683 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/0.log" Apr 17 11:24:16.463726 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.463708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovn-acl-logging/1.log" Apr 17 11:24:16.477623 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.477605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/kube-rbac-proxy-node/0.log" Apr 17 11:24:16.498046 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.498024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/kube-rbac-proxy-ovn-metrics/0.log" Apr 17 11:24:16.517120 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.517105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/northd/0.log" Apr 17 11:24:16.534980 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.534957 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/nbdb/0.log" Apr 17 11:24:16.554208 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.554184 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/sbdb/0.log" Apr 17 11:24:16.639752 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:16.639730 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmxqh_d4216bf0-aee8-41ef-9cd7-4faf142a0459/ovnkube-controller/0.log" Apr 17 11:24:17.803983 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:17.803959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-j9jfg_ce81cfef-ea4a-46be-8482-af5eac179f0b/network-check-target-container/0.log" Apr 17 11:24:18.743261 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:18.743233 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6268l_9f1db6e3-ccc9-4ae6-90b9-340c0db5f049/iptables-alerter/0.log" Apr 17 11:24:19.443945 ip-10-0-130-188 kubenswrapper[2576]: I0417 11:24:19.443915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dtdmf_40c29d71-2d2c-4206-8b69-7023028bc594/tuned/0.log"