May 21 14:37:59.893059 ip-10-0-129-1 systemd[1]: Starting Kubernetes Kubelet... May 21 14:38:00.390566 ip-10-0-129-1 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:38:00.390566 ip-10-0-129-1 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:38:00.390566 ip-10-0-129-1 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:38:00.390566 ip-10-0-129-1 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:38:00.390566 ip-10-0-129-1 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:38:00.393574 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.393488 2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:38:00.397484 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397466 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:00.397484 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397484 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397488 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397491 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397494 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397497 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397500 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397503 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397513 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397517 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397520 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397523 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397526 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397529 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397532 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397535 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397538 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397541 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397544 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397547 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397549 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397552 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:00.397552 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397555 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397558 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397561 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397565 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397568 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397571 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397574 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397577 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397580 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397584 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397588 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397591 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397594 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397598 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397600 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397603 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397606 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397608 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397611 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:00.398192 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397614 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397617 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397620 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397622 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397626 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397628 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397630 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397633 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397635 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397638 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397640 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397645 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397648 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397651 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397654 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397658 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397661 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397664 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397667 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:00.398902 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397669 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397672 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397675 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397677 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397680 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397682 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397685 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397687 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397690 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397692 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397695 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397697 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397700 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397702 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397705 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397708 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397710 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397713 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397715 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397719 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:00.399365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397721 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397724 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397726 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397729 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397732 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.397735 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399535 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399548 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399552 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399555 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399558 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399561 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399565 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399568 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399570 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399573 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399576 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399579 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399581 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399584 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:00.399936 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399587 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399589 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399592 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399595 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399597 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399600 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399603 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399606 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399609 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399611 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399614 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399617 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399619 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399623 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399625 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399629 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399631 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399634 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399637 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399641 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:00.400409 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399644 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399647 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399649 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399652 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399655 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399658 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399660 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399663 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399666 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399668 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399671 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399674 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399676 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399679 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399681 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399684 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399687 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399689 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399692 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:00.400943 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399695 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399697 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399699 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399702 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399705 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399707 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399710 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399712 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399715 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399718 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399721 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399723 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399726 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399732 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399736 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399739 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399742 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399745 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399748 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:00.401398 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399768 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399771 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399774 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399777 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399781 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399793 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399796 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399799 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399802 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399804 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399807 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399809 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399812 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.399815 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399884 2572 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399892 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399907 2572 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399913 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399919 2572 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399923 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399928 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:38:00.401880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399932 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399935 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399939 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399943 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399947 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399950 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399953 2572 flags.go:64] FLAG: --cgroup-root="" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399956 2572 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399959 2572 flags.go:64] FLAG: --client-ca-file="" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399962 2572 flags.go:64] FLAG: --cloud-config="" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399965 2572 flags.go:64] FLAG: --cloud-provider="external" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399968 2572 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399975 2572 flags.go:64] FLAG: --cluster-domain="" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399978 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399981 2572 flags.go:64] FLAG: --config-dir="" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399984 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399987 2572 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.399997 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400000 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400004 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400007 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400010 2572 flags.go:64] FLAG: --contention-profiling="false" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400014 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400016 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400020 2572 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:38:00.402412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400023 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400027 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400030 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400033 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400036 2572 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400039 2572 flags.go:64] FLAG: --enable-server="true" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400042 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400049 2572 flags.go:64] FLAG: --event-burst="100" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400052 2572 flags.go:64] FLAG: --event-qps="50" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400055 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400058 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400062 2572 flags.go:64] FLAG: --eviction-hard="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400066 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400068 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400071 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400074 2572 flags.go:64] FLAG: --eviction-soft="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400077 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400080 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400083 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400086 2572 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400089 2572 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400092 2572 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400096 2572 flags.go:64] FLAG: --feature-gates="" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400099 2572 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400103 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:38:00.403019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400112 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400115 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400119 2572 flags.go:64] FLAG: --healthz-port="10248" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400122 2572 flags.go:64] FLAG: --help="false" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400125 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-129-1.ec2.internal" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400128 2572 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400131 2572 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400134 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400138 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400141 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400144 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400147 2572 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400150 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400154 2572 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400157 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400160 2572 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400163 2572 flags.go:64] FLAG: --kube-reserved="" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400166 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400169 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400172 2572 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400175 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400178 2572 flags.go:64] FLAG: --lock-file="" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400181 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400184 2572 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:38:00.403631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400187 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400196 2572 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400199 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400202 2572 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400205 2572 flags.go:64] FLAG: --logging-format="text" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400208 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400212 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400214 2572 flags.go:64] FLAG: --manifest-url="" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400217 2572 flags.go:64] FLAG: --manifest-url-header="" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400227 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400230 2572 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400234 2572 flags.go:64] FLAG: --max-pods="110" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400237 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400240 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400243 2572 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400246 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400249 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400252 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400255 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400262 2572 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400265 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400268 2572 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400271 2572 flags.go:64] FLAG: --pod-cidr="" May 21 14:38:00.404257 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400274 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400280 2572 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400282 2572 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400286 2572 flags.go:64] FLAG: --pods-per-core="0" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400289 2572 flags.go:64] FLAG: --port="10250" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400292 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400298 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0838730ed864c93a3" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400302 2572 flags.go:64] FLAG: --qos-reserved="" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400305 2572 flags.go:64] FLAG: --read-only-port="10255" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400308 2572 flags.go:64] FLAG: --register-node="true" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400310 2572 flags.go:64] FLAG: --register-schedulable="true" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400314 2572 flags.go:64] FLAG: --register-with-taints="" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400317 2572 flags.go:64] FLAG: --registry-burst="10" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400320 2572 flags.go:64] FLAG: --registry-qps="5" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400323 2572 flags.go:64] FLAG: --reserved-cpus="" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400326 2572 flags.go:64] FLAG: --reserved-memory="" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400330 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400333 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400336 2572 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400345 2572 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400348 2572 flags.go:64] FLAG: --runonce="false" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400351 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400355 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400358 2572 flags.go:64] FLAG: --seccomp-default="false" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400361 2572 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400364 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:38:00.404834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400367 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400370 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400374 2572 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400377 2572 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400380 2572 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400383 2572 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400400 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400404 2572 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400407 2572 flags.go:64] FLAG: --system-cgroups="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400410 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400415 2572 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400419 2572 flags.go:64] FLAG: --tls-cert-file="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400424 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400432 2572 flags.go:64] FLAG: --tls-min-version="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400435 2572 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400438 2572 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400441 2572 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400445 2572 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400448 2572 flags.go:64] FLAG: --v="2" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400453 2572 flags.go:64] FLAG: --version="false" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400457 2572 flags.go:64] FLAG: --vmodule="" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400461 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.400465 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400581 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:00.405488 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400585 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400590 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400600 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400603 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400606 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400609 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400615 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400617 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400620 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400623 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400626 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400628 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400632 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400634 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400638 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400640 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400643 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400645 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400648 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:00.406072 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400650 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400654 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400657 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400659 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400662 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400664 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400667 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400670 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400672 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400675 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400678 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400680 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400683 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400685 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400688 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400691 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400699 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400702 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400705 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400708 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:00.406539 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400711 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400714 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400716 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400719 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400722 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400724 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400727 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400730 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400732 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400735 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400737 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400740 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400743 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400764 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400767 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400770 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400773 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400775 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400778 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:00.407050 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400781 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400783 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400786 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400789 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400792 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400794 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400797 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400800 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400802 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400805 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400813 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400816 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400820 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400823 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400826 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400828 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400831 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400833 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400836 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400838 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:00.407521 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400841 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400843 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400846 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400849 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400852 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400855 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.400859 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:00.408024 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.401699 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:38:00.408715 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.408692 2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:38:00.408766 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.408715 2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408781 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408787 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408790 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408793 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408796 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408799 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408802 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408805 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:00.408803 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408808 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408811 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408814 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408817 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408819 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408822 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408824 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408828 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408833 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408836 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408838 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408841 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408844 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408846 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408849 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408851 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408854 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408857 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408860 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408862 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:00.409035 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408865 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408868 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408871 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408882 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408885 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408888 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408890 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408893 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408896 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408899 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408902 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408904 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408907 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408909 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408913 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408916 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408918 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408921 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408924 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408927 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:00.409556 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408929 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408932 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408935 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408937 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408940 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408942 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408945 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408948 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408950 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408953 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408955 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408958 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408961 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408963 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408966 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408970 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408974 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408977 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408980 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:00.410064 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408983 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408986 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408989 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408992 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408995 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.408997 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409000 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409003 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409007 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409009 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409012 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409014 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409017 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409020 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409023 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409025 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409028 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409030 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:00.410530 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409033 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.409038 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409142 2572 feature_gate.go:328] unrecognized feature gate: Example May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409146 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409149 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409152 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409155 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409158 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409161 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409163 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409166 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409169 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409172 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409175 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409177 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409180 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:38:00.410972 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409183 2572 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409185 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409188 2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409191 2572 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409193 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409197 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409200 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409202 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409205 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409208 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409210 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409213 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409215 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409218 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409220 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409223 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409226 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409228 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409231 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409233 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:38:00.411365 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409236 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409238 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409241 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409244 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409246 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409249 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409252 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409254 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409257 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409259 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409262 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409266 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409269 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409273 2572 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409275 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409278 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409281 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409284 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409287 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:38:00.411874 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409289 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409292 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409295 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409297 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409300 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409302 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409305 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409308 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409311 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409315 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409318 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409320 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409322 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409325 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409327 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409330 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409333 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409335 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409338 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:38:00.412331 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409340 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409343 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409345 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409348 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409351 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409354 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409356 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409359 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409362 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409364 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409367 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409370 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409372 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:00.409375 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.409380 2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:38:00.412904 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.410277 2572 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:38:00.415230 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.415214 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:38:00.416375 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.416363 2572 server.go:1019] "Starting client certificate rotation" May 21 14:38:00.416482 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.416464 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:38:00.416519 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.416506 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:38:00.443736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.443720 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:38:00.447746 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.447724 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:38:00.465271 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.465247 2572 log.go:25] "Validated CRI v1 runtime API" May 21 14:38:00.471247 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.471230 2572 log.go:25] "Validated CRI v1 image API" May 21 14:38:00.472677 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.472663 2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:38:00.477431 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.477412 2572 fs.go:135] Filesystem UUIDs: map[41760d79-e4a3-4a0f-996a-0c6622eabeaf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2196d25-bbdd-44c3-bcfb-6cbbafce819e:/dev/nvme0n1p4] May 21 14:38:00.477477 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.477432 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:38:00.481840 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.481714 2572 manager.go:217] Machine: {Timestamp:2026-05-21 14:38:00.481189409 +0000 UTC m=+0.457532881 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099615 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2658c6baa0533df648f1fefabc35f1 SystemUUID:ec2658c6-baa0-533d-f648-f1fefabc35f1 BootID:691ea419-b534-49a2-a5d7-b6d79e744769 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:ec:11:0a:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:ec:11:0a:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:0e:50:8b:6e:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:38:00.482655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.482643 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:38:00.482798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.482784 2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:38:00.484832 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.484806 2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:38:00.484966 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.484835 2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:38:00.485007 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.484975 2572 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:38:00.485007 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.484984 2572 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:38:00.485007 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.484992 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:38:00.485914 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.485903 2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:38:00.486027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.486012 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:38:00.487173 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.487162 2572 state_mem.go:36] "Initialized new in-memory state store" May 21 14:38:00.487274 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.487266 2572 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:38:00.489990 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.489980 2572 kubelet.go:491] "Attempting to sync node with API server" May 21 14:38:00.490025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.489995 2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:38:00.490025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.490007 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:38:00.490025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.490016 2572 kubelet.go:397] "Adding apiserver pod source" May 21 14:38:00.490025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.490025 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:38:00.491317 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.491300 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:38:00.491317 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.491319 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:38:00.494699 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.494681 2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:38:00.497083 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.497070 2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:38:00.498905 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498880 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:38:00.498905 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498906 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498919 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498930 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498946 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498956 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498969 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.498995 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.499005 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.499015 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.499028 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:38:00.499060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.499038 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:38:00.500038 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.500026 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:38:00.500100 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.500042 2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:38:00.503663 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.503645 2572 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:38:00.503746 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.503688 2572 server.go:1295] "Started kubelet" May 21 14:38:00.503839 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.503811 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:38:00.503887 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.503800 2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:38:00.503925 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.503889 2572 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:38:00.504634 ip-10-0-129-1 systemd[1]: Started Kubernetes Kubelet. May 21 14:38:00.505492 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.505264 2572 server.go:317] "Adding debug handlers to kubelet server" May 21 14:38:00.505566 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.505546 2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 14:38:00.505606 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.505577 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:38:00.505682 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.505663 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:38:00.509676 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.509642 2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:38:00.517687 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.516547 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-1.ec2.internal.18b19b7b07e30193 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-1.ec2.internal,UID:ip-10-0-129-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-1.ec2.internal,},FirstTimestamp:2026-05-21 14:38:00.503656851 +0000 UTC m=+0.480000329,LastTimestamp:2026-05-21 14:38:00.503656851 +0000 UTC m=+0.480000329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-1.ec2.internal,}" May 21 14:38:00.518035 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.518018 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:38:00.518684 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.518665 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:38:00.518799 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.518782 2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:38:00.518860 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.518848 2572 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:38:00.518928 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.518861 2572 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:38:00.518928 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.518916 2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:38:00.519039 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519025 2572 reconstruct.go:97] "Volume reconstruction finished" May 21 14:38:00.519093 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519040 2572 reconciler.go:26] "Reconciler: start to sync state" May 21 14:38:00.519313 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519296 2572 factory.go:55] Registering systemd factory May 21 14:38:00.519354 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519317 2572 factory.go:223] Registration of the systemd container factory successfully May 21 14:38:00.519556 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519536 2572 factory.go:153] Registering CRI-O factory May 21 14:38:00.519556 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519557 2572 factory.go:223] Registration of the crio container factory successfully May 21 14:38:00.519691 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519606 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:38:00.519691 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.519678 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:00.519781 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519706 2572 factory.go:103] Registering Raw factory May 21 14:38:00.519781 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.519721 2572 manager.go:1196] Started watching for new ooms in manager May 21 14:38:00.520249 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.520232 2572 manager.go:319] Starting recovery of all containers May 21 14:38:00.524684 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.524658 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 14:38:00.524806 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.524700 2572 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 14:38:00.531070 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.531056 2572 manager.go:324] Recovery completed May 21 14:38:00.532391 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.532373 2572 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 21 14:38:00.534567 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.534548 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pvq2w" May 21 14:38:00.535340 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.535327 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:00.537469 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.537452 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:00.537555 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.537486 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:00.537555 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.537503 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:00.538056 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.538041 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:38:00.538056 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.538054 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:38:00.538141 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.538068 2572 state_mem.go:36] "Initialized new in-memory state store" May 21 14:38:00.539850 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.539775 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-1.ec2.internal.18b19b7b09e6f441 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-1.ec2.internal,UID:ip-10-0-129-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-1.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-1.ec2.internal,},FirstTimestamp:2026-05-21 14:38:00.537470017 +0000 UTC m=+0.513813494,LastTimestamp:2026-05-21 14:38:00.537470017 +0000 UTC m=+0.513813494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-1.ec2.internal,}" May 21 14:38:00.542170 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.542154 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pvq2w" May 21 14:38:00.542242 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.542201 2572 policy_none.go:49] "None policy: Start" May 21 14:38:00.542242 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.542236 2572 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:38:00.542304 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.542254 2572 state_mem.go:35] "Initializing new in-memory state store" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.583270 2572 manager.go:341] "Starting Device Plugin manager" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.583325 2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.583335 2572 server.go:85] "Starting device plugin registration server" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.583737 2572 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.583773 2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.583959 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.584031 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.584039 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.584901 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:38:00.599967 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.584950 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:00.657484 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.657405 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:38:00.658611 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.658586 2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:38:00.658611 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.658604 2572 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:38:00.658778 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.658622 2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:38:00.658778 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.658629 2572 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:38:00.658778 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.658668 2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:38:00.661766 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.661733 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:00.684115 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.684087 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:00.684934 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.684919 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:00.685028 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.684946 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:00.685028 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.684959 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:00.685028 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.684985 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-1.ec2.internal" May 21 14:38:00.691809 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.691795 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-1.ec2.internal" May 21 14:38:00.691890 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.691813 2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-1.ec2.internal\": node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:00.705911 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.705888 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:00.759232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.759193 2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"] May 21 14:38:00.759322 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.759273 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:00.760191 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.760176 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:00.760258 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.760206 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:00.760258 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.760217 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:00.762606 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.762594 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:00.762797 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.762783 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:00.762849 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.762811 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:00.763309 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.763290 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:00.763309 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.763313 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:00.763429 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.763322 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:00.763429 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.763343 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:00.763429 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.763363 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:00.763429 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.763372 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:00.765604 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.765590 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" May 21 14:38:00.765654 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.765615 2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:38:00.766212 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.766199 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory" May 21 14:38:00.766282 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.766225 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:38:00.766282 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.766234 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID" May 21 14:38:00.781328 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.781309 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal" May 21 14:38:00.784621 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.784604 2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal" May 21 14:38:00.806586 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.806563 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:00.820387 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.820362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f205cb58eb9f4cc6358fe22b9f69e5cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"f205cb58eb9f4cc6358fe22b9f69e5cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:00.906673 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:00.906633 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:00.921020 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.920960 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f205cb58eb9f4cc6358fe22b9f69e5cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"f205cb58eb9f4cc6358fe22b9f69e5cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:00.921020 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.921000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f205cb58eb9f4cc6358fe22b9f69e5cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"f205cb58eb9f4cc6358fe22b9f69e5cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:00.921158 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.921030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c5b17db4b61eb5d387ece2607db7785-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"3c5b17db4b61eb5d387ece2607db7785\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" May 21 14:38:00.921158 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:00.921073 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f205cb58eb9f4cc6358fe22b9f69e5cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"f205cb58eb9f4cc6358fe22b9f69e5cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:01.007374 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.007337 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.021692 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.021667 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f205cb58eb9f4cc6358fe22b9f69e5cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"f205cb58eb9f4cc6358fe22b9f69e5cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:01.021777 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.021700 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c5b17db4b61eb5d387ece2607db7785-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"3c5b17db4b61eb5d387ece2607db7785\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" May 21 14:38:01.021777 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.021747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c5b17db4b61eb5d387ece2607db7785-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"3c5b17db4b61eb5d387ece2607db7785\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" May 21 14:38:01.021845 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.021787 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f205cb58eb9f4cc6358fe22b9f69e5cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"f205cb58eb9f4cc6358fe22b9f69e5cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:01.083858 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.083823 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:01.086394 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.086376 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" May 21 14:38:01.108009 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.107982 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.208581 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.208471 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.309020 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.308983 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.409672 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.409633 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.415830 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.415806 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:38:01.415997 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.415981 2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:38:01.510779 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.510705 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.518323 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.518304 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:38:01.534683 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.534648 2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:38:01.544813 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.544786 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:33:00 +0000 UTC" deadline="2028-01-03 06:29:49.489821666 +0000 UTC" May 21 14:38:01.544917 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.544813 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14199h51m47.94501181s" May 21 14:38:01.557991 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.557966 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r4h2x" May 21 14:38:01.565804 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.565785 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r4h2x" May 21 14:38:01.610970 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.610940 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.666736 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:01.666691 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf205cb58eb9f4cc6358fe22b9f69e5cb.slice/crio-5dacbc7acd355147da49cf35d28db674063612d8e7f867e5b6afd2be383ba1ea WatchSource:0}: Error finding container 5dacbc7acd355147da49cf35d28db674063612d8e7f867e5b6afd2be383ba1ea: Status 404 returned error can't find the container with id 5dacbc7acd355147da49cf35d28db674063612d8e7f867e5b6afd2be383ba1ea May 21 14:38:01.666903 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:01.666888 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5b17db4b61eb5d387ece2607db7785.slice/crio-371667561e9942f07505dba43991c3a57198d24c951cb5cc5fff4a500e3dd367 WatchSource:0}: Error finding container 371667561e9942f07505dba43991c3a57198d24c951cb5cc5fff4a500e3dd367: Status 404 returned error can't find the container with id 371667561e9942f07505dba43991c3a57198d24c951cb5cc5fff4a500e3dd367 May 21 14:38:01.672050 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.672031 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:38:01.711453 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.711411 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.812278 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.812208 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.812618 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.812603 2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:01.912632 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:01.912598 2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found" May 21 14:38:01.928274 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.928255 2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:01.948034 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:01.948010 2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:02.019658 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.019631 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" May 21 14:38:02.032969 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.032948 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:38:02.033735 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.033720 2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" May 21 14:38:02.042519 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.042495 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:38:02.362374 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.362340 2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:38:02.491451 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.491416 2572 apiserver.go:52] "Watching apiserver" May 21 14:38:02.497799 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.497770 2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:38:02.498186 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.498159 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj","openshift-cluster-node-tuning-operator/tuned-jvl6s","openshift-image-registry/node-ca-9st7g","openshift-multus/multus-6ckwn","openshift-multus/network-metrics-daemon-2lgcw","openshift-network-diagnostics/network-check-target-cklkr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal","openshift-multus/multus-additional-cni-plugins-wd44n","openshift-network-operator/iptables-alerter-ltq6n","openshift-ovn-kubernetes/ovnkube-node-64v5f","kube-system/konnectivity-agent-dtwlc"] May 21 14:38:02.502956 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.502934 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.505140 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.505119 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:38:02.505241 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.505183 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-65nlj\"" May 21 14:38:02.505299 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.505265 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.506163 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.506142 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:38:02.507044 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.505123 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:38:02.509205 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.509186 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:38:02.509416 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.509395 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:38:02.509626 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.509609 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8br47\"" May 21 14:38:02.509696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.509642 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:38:02.511579 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.511323 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.513469 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.513446 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:02.513561 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.513477 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:38:02.514123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.513820 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h6vpm\"" May 21 14:38:02.514123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.513875 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6ckwn" May 21 14:38:02.516373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.516183 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:38:02.516373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.516210 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:38:02.516373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.516192 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:38:02.516373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.516264 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:38:02.516373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.516303 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2vjsx\"" May 21 14:38:02.517277 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.517034 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:02.517277 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.517168 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:02.519479 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.519378 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:02.519479 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.519432 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:02.521734 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.521672 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.522142 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.521809 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.523628 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.523610 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:38:02.523892 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.523872 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lb25t\"" May 21 14:38:02.524236 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.524217 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8sj56\"" May 21 14:38:02.524305 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.524250 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:38:02.524359 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.524314 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:38:02.524498 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.524482 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:38:02.524564 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.524512 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:02.526453 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.526434 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.526696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.526678 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.528522 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.528504 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:38:02.528522 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.528581 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f8bgt\"" May 21 14:38:02.529562 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529210 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:38:02.529562 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529282 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:38:02.529562 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529214 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:38:02.529804 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529573 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8gxmq\"" May 21 14:38:02.529804 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529702 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:38:02.529804 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529781 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:38:02.530044 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529901 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:38:02.530044 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.529996 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:38:02.531479 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.531577 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-device-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.531577 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmzl\" (UniqueName: \"kubernetes.io/projected/15b6c289-87d2-4e47-8dcc-f62b1485e573-kube-api-access-jgmzl\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.531731 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysctl-conf\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.531731 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-var-lib-kubelet\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.531731 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.531731 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6kz\" (UniqueName: \"kubernetes.io/projected/01a70833-6459-41f6-9abc-47fe11629e33-kube-api-access-6n6kz\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-lib-modules\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-conf-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-multus-certs\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-etc-kubernetes\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-cnibin\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-os-release\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-kubelet\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-system-cni-dir\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-kubernetes\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.531995 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.531989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-cni-multus\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb27c\" (UniqueName: \"kubernetes.io/projected/5d32dc8d-e310-47db-be24-075dad49de57-kube-api-access-wb27c\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-sys-fs\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-modprobe-d\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysconfig\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysctl-d\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-systemd\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f864ec60-8a32-4494-b22c-7266f075f09e-tmp\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-hostroot\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6nd9\" (UniqueName: \"kubernetes.io/projected/a14260e7-302c-4a4a-8dda-71e933043038-kube-api-access-n6nd9\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532295 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-sys\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf96l\" (UniqueName: \"kubernetes.io/projected/f864ec60-8a32-4494-b22c-7266f075f09e-kube-api-access-hf96l\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532340 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a14260e7-302c-4a4a-8dda-71e933043038-cni-binary-copy\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-socket-dir-parent\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-k8s-cni-cncf-io\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.532586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-netns\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532453 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-cni-bin\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-os-release\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-registration-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-etc-selinux\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f864ec60-8a32-4494-b22c-7266f075f09e-etc-tuned\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4d0dfb2-f250-44a9-9615-4073f948685c-serviceca\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvssb\" (UniqueName: \"kubernetes.io/projected/a4d0dfb2-f250-44a9-9615-4073f948685c-kube-api-access-nvssb\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-system-cni-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-cnibin\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a14260e7-302c-4a4a-8dda-71e933043038-multus-daemon-config\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532693 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-socket-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-run\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-host\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532819 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4d0dfb2-f250-44a9-9615-4073f948685c-host\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-cni-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.533503 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:02.534529 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.532965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.566821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.566729 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:33:01 +0000 UTC" deadline="2028-02-02 08:35:52.267923318 +0000 UTC" May 21 14:38:02.566821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.566775 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14921h57m49.7011532s" May 21 14:38:02.620024 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.619957 2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:38:02.633969 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.633941 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-sys-fs\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.633969 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.633972 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-systemd\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.633994 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634012 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634046 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-sys\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634063 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a14260e7-302c-4a4a-8dda-71e933043038-cni-binary-copy\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634079 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-k8s-cni-cncf-io\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634096 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-netns\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-sys-fs\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634155 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.634232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634163 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-k8s-cni-cncf-io\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634248 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-systemd\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634280 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-netns\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634320 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-etc-selinux\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634349 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f864ec60-8a32-4494-b22c-7266f075f09e-etc-tuned\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634375 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvssb\" (UniqueName: \"kubernetes.io/projected/a4d0dfb2-f250-44a9-9615-4073f948685c-kube-api-access-nvssb\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634383 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-sys\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634400 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-system-cni-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634428 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-cnibin\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634470 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a14260e7-302c-4a4a-8dda-71e933043038-multus-daemon-config\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634493 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-host\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634517 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-cni-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgq6j\" (UniqueName: \"kubernetes.io/projected/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-kube-api-access-vgq6j\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634579 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-device-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634603 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysctl-conf\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634626 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-var-lib-kubelet\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634654 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6kz\" (UniqueName: \"kubernetes.io/projected/01a70833-6459-41f6-9abc-47fe11629e33-kube-api-access-6n6kz\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.634736 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-etc-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-env-overrides\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634707 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634702 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-etc-selinux\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a14260e7-302c-4a4a-8dda-71e933043038-cni-binary-copy\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-system-cni-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-var-lib-kubelet\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634899 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-cni-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634906 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-device-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-cnibin\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634975 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-etc-kubernetes\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634999 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-cnibin\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635004 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-host\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysctl-conf\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4f94ccd-5478-498f-82ba-a0888135005c-host-slash\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635068 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-etc-kubernetes\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635083 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-cnibin\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.635525 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635088 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-systemd\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.634705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-node-log\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635172 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-kubelet\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635199 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0373704-51d6-4a6b-a388-862406573a2a-agent-certs\") pod \"konnectivity-agent-dtwlc\" (UID: \"e0373704-51d6-4a6b-a388-862406573a2a\") " pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635226 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635251 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-kubernetes\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635278 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-cni-multus\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635287 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635294 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-kubernetes\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635253 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-kubelet\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635306 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb27c\" (UniqueName: \"kubernetes.io/projected/5d32dc8d-e310-47db-be24-075dad49de57-kube-api-access-wb27c\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-cni-multus\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635353 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635379 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-var-lib-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-cni-netd\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.636382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635438 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-modprobe-d\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635456 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysconfig\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635470 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysctl-d\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635492 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f864ec60-8a32-4494-b22c-7266f075f09e-tmp\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635516 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-hostroot\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635536 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6nd9\" (UniqueName: \"kubernetes.io/projected/a14260e7-302c-4a4a-8dda-71e933043038-kube-api-access-n6nd9\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635559 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-os-release\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-hostroot\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-cni-bin\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635575 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-modprobe-d\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635593 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a14260e7-302c-4a4a-8dda-71e933043038-multus-daemon-config\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635598 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysctl-d\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635536 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-etc-sysconfig\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635609 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hf96l\" (UniqueName: \"kubernetes.io/projected/f864ec60-8a32-4494-b22c-7266f075f09e-kube-api-access-hf96l\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635657 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-socket-dir-parent\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635663 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-os-release\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635700 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-cni-bin\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.637203 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-socket-dir-parent\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-kubelet\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635802 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-var-lib-cni-bin\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-run-netns\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635887 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-registration-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635908 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4d0dfb2-f250-44a9-9615-4073f948685c-serviceca\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-slash\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.635962 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-registration-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636004 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-socket-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636029 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-run\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636052 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4d0dfb2-f250-44a9-9615-4073f948685c-host\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636078 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f24w7\" (UniqueName: \"kubernetes.io/projected/f4f94ccd-5478-498f-82ba-a0888135005c-kube-api-access-f24w7\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636137 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmzl\" (UniqueName: \"kubernetes.io/projected/15b6c289-87d2-4e47-8dcc-f62b1485e573-kube-api-access-jgmzl\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4d0dfb2-f250-44a9-9615-4073f948685c-host\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/15b6c289-87d2-4e47-8dcc-f62b1485e573-socket-dir\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636164 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.638041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636193 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-systemd-units\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-log-socket\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovnkube-config\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636110 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-run\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636300 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-lib-modules\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636325 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-conf-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636364 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-multus-certs\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636386 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4d0dfb2-f250-44a9-9615-4073f948685c-serviceca\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovn-node-metrics-cert\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovnkube-script-lib\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-host-run-multus-certs\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636476 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-multus-conf-dir\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636550 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-os-release\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636590 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f864ec60-8a32-4494-b22c-7266f075f09e-lib-modules\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636594 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-system-cni-dir\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636640 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01a70833-6459-41f6-9abc-47fe11629e33-system-cni-dir\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4f94ccd-5478-498f-82ba-a0888135005c-iptables-alerter-script\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.638798 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636675 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a14260e7-302c-4a4a-8dda-71e933043038-os-release\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-ovn\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0373704-51d6-4a6b-a388-862406573a2a-konnectivity-ca\") pod \"konnectivity-agent-dtwlc\" (UID: \"e0373704-51d6-4a6b-a388-862406573a2a\") " pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01a70833-6459-41f6-9abc-47fe11629e33-cni-binary-copy\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.636774 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.636871 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.636956 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:03.136924909 +0000 UTC m=+3.113268386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.638194 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f864ec60-8a32-4494-b22c-7266f075f09e-etc-tuned\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.639243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.638597 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f864ec60-8a32-4494-b22c-7266f075f09e-tmp\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.642995 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.642974 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:02.642995 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.642996 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:02.643242 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.643009 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:02.643242 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:02.643074 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:03.143057057 +0000 UTC m=+3.119400536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:02.645022 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.644991 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmzl\" (UniqueName: \"kubernetes.io/projected/15b6c289-87d2-4e47-8dcc-f62b1485e573-kube-api-access-jgmzl\") pod \"aws-ebs-csi-driver-node-b72nj\" (UID: \"15b6c289-87d2-4e47-8dcc-f62b1485e573\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.645141 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.645058 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6nd9\" (UniqueName: \"kubernetes.io/projected/a14260e7-302c-4a4a-8dda-71e933043038-kube-api-access-n6nd9\") pod \"multus-6ckwn\" (UID: \"a14260e7-302c-4a4a-8dda-71e933043038\") " pod="openshift-multus/multus-6ckwn" May 21 14:38:02.645659 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.645638 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvssb\" (UniqueName: \"kubernetes.io/projected/a4d0dfb2-f250-44a9-9615-4073f948685c-kube-api-access-nvssb\") pod \"node-ca-9st7g\" (UID: \"a4d0dfb2-f250-44a9-9615-4073f948685c\") " pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.645937 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.645915 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6kz\" (UniqueName: \"kubernetes.io/projected/01a70833-6459-41f6-9abc-47fe11629e33-kube-api-access-6n6kz\") pod \"multus-additional-cni-plugins-wd44n\" (UID: \"01a70833-6459-41f6-9abc-47fe11629e33\") " pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.646500 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.646476 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb27c\" (UniqueName: \"kubernetes.io/projected/5d32dc8d-e310-47db-be24-075dad49de57-kube-api-access-wb27c\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:02.646858 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.646818 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf96l\" (UniqueName: \"kubernetes.io/projected/f864ec60-8a32-4494-b22c-7266f075f09e-kube-api-access-hf96l\") pod \"tuned-jvl6s\" (UID: \"f864ec60-8a32-4494-b22c-7266f075f09e\") " pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.662837 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.662783 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"f205cb58eb9f4cc6358fe22b9f69e5cb","Type":"ContainerStarted","Data":"5dacbc7acd355147da49cf35d28db674063612d8e7f867e5b6afd2be383ba1ea"} May 21 14:38:02.663881 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.663856 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" event={"ID":"3c5b17db4b61eb5d387ece2607db7785","Type":"ContainerStarted","Data":"371667561e9942f07505dba43991c3a57198d24c951cb5cc5fff4a500e3dd367"} May 21 14:38:02.737840 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737805 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-kubelet\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737850 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-run-netns\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737880 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-slash\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737908 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f24w7\" (UniqueName: \"kubernetes.io/projected/f4f94ccd-5478-498f-82ba-a0888135005c-kube-api-access-f24w7\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737909 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-kubelet\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737931 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-systemd-units\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737955 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-log-socket\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737967 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-run-netns\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737976 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovnkube-config\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-slash\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737996 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-systemd-units\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-log-socket\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.737996 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovn-node-metrics-cert\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738056 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovnkube-script-lib\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738083 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4f94ccd-5478-498f-82ba-a0888135005c-iptables-alerter-script\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738107 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-ovn\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738148 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0373704-51d6-4a6b-a388-862406573a2a-konnectivity-ca\") pod \"konnectivity-agent-dtwlc\" (UID: \"e0373704-51d6-4a6b-a388-862406573a2a\") " pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738188 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738223 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738270 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgq6j\" (UniqueName: \"kubernetes.io/projected/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-kube-api-access-vgq6j\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-ovn\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738300 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-etc-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738349 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-etc-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738608 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovnkube-config\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738677 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738803 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-env-overrides\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738835 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4f94ccd-5478-498f-82ba-a0888135005c-host-slash\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovnkube-script-lib\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4f94ccd-5478-498f-82ba-a0888135005c-iptables-alerter-script\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738887 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0373704-51d6-4a6b-a388-862406573a2a-konnectivity-ca\") pod \"konnectivity-agent-dtwlc\" (UID: \"e0373704-51d6-4a6b-a388-862406573a2a\") " pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738871 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-systemd\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.738911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-systemd\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738923 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4f94ccd-5478-498f-82ba-a0888135005c-host-slash\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738960 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-node-log\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.738995 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0373704-51d6-4a6b-a388-862406573a2a-agent-certs\") pod \"konnectivity-agent-dtwlc\" (UID: \"e0373704-51d6-4a6b-a388-862406573a2a\") " pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739024 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-var-lib-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739049 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739063 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-node-log\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739074 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-cni-netd\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739106 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-cni-bin\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739118 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-var-lib-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739162 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-run-openvswitch\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739174 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-cni-netd\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739189 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-env-overrides\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.739362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.739192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-host-cni-bin\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.740577 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.740553 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-ovn-node-metrics-cert\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.741891 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.741870 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0373704-51d6-4a6b-a388-862406573a2a-agent-certs\") pod \"konnectivity-agent-dtwlc\" (UID: \"e0373704-51d6-4a6b-a388-862406573a2a\") " pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.745252 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.745225 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f24w7\" (UniqueName: \"kubernetes.io/projected/f4f94ccd-5478-498f-82ba-a0888135005c-kube-api-access-f24w7\") pod \"iptables-alerter-ltq6n\" (UID: \"f4f94ccd-5478-498f-82ba-a0888135005c\") " pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.745663 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.745641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgq6j\" (UniqueName: \"kubernetes.io/projected/5e551bf2-bd2f-4d36-9f0c-384e0e7380b9-kube-api-access-vgq6j\") pod \"ovnkube-node-64v5f\" (UID: \"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:02.819674 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.819637 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" May 21 14:38:02.827869 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.827849 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9st7g" May 21 14:38:02.838765 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.838721 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" May 21 14:38:02.846490 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.846469 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6ckwn" May 21 14:38:02.854017 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.853999 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wd44n" May 21 14:38:02.863540 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.863519 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ltq6n" May 21 14:38:02.875166 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.875110 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:02.879737 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:02.879720 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:03.140807 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.140718 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:03.140955 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:03.140854 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:03.140955 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:03.140920 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:04.140904995 +0000 UTC m=+4.117248453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:03.241738 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.241709 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:03.241894 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:03.241868 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:03.241894 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:03.241886 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:03.241969 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:03.241897 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:03.241969 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:03.241944 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:04.241930353 +0000 UTC m=+4.218273818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:03.424961 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.424932 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d0dfb2_f250_44a9_9615_4073f948685c.slice/crio-f5189236dea6a4b4b3b0fc0cb2b7510ac19988e2001d9284f982fa1596d490ec WatchSource:0}: Error finding container f5189236dea6a4b4b3b0fc0cb2b7510ac19988e2001d9284f982fa1596d490ec: Status 404 returned error can't find the container with id f5189236dea6a4b4b3b0fc0cb2b7510ac19988e2001d9284f982fa1596d490ec May 21 14:38:03.428239 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.427969 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b6c289_87d2_4e47_8dcc_f62b1485e573.slice/crio-cbec66ea21b1a6fdc99b281d3d7064e4bb0d11286e5137df4bbe35d11418b7c8 WatchSource:0}: Error finding container cbec66ea21b1a6fdc99b281d3d7064e4bb0d11286e5137df4bbe35d11418b7c8: Status 404 returned error can't find the container with id cbec66ea21b1a6fdc99b281d3d7064e4bb0d11286e5137df4bbe35d11418b7c8 May 21 14:38:03.430300 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.430239 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f94ccd_5478_498f_82ba_a0888135005c.slice/crio-364b6699c80c9b48b8dc0c2ba45f3a4b034a2fd6ad11a029224222ec2c3a92e6 WatchSource:0}: Error finding container 364b6699c80c9b48b8dc0c2ba45f3a4b034a2fd6ad11a029224222ec2c3a92e6: Status 404 returned error can't find the container with id 364b6699c80c9b48b8dc0c2ba45f3a4b034a2fd6ad11a029224222ec2c3a92e6 May 21 14:38:03.432118 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.432086 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e551bf2_bd2f_4d36_9f0c_384e0e7380b9.slice/crio-b322a69b4da209c8acbd89c93033a78e9ff87db18ae843b7590128478fb8bc20 WatchSource:0}: Error finding container b322a69b4da209c8acbd89c93033a78e9ff87db18ae843b7590128478fb8bc20: Status 404 returned error can't find the container with id b322a69b4da209c8acbd89c93033a78e9ff87db18ae843b7590128478fb8bc20 May 21 14:38:03.433389 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.433152 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14260e7_302c_4a4a_8dda_71e933043038.slice/crio-6ef930b3bbd0951e4633e7697b382d0a3dde3bfb4884413caf3081960fa01747 WatchSource:0}: Error finding container 6ef930b3bbd0951e4633e7697b382d0a3dde3bfb4884413caf3081960fa01747: Status 404 returned error can't find the container with id 6ef930b3bbd0951e4633e7697b382d0a3dde3bfb4884413caf3081960fa01747 May 21 14:38:03.434399 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.434097 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf864ec60_8a32_4494_b22c_7266f075f09e.slice/crio-b38a0c0bbd0ba64a7a527c904ed34ef4fe1c60391d3a8adf73e107a2b4697321 WatchSource:0}: Error finding container b38a0c0bbd0ba64a7a527c904ed34ef4fe1c60391d3a8adf73e107a2b4697321: Status 404 returned error can't find the container with id b38a0c0bbd0ba64a7a527c904ed34ef4fe1c60391d3a8adf73e107a2b4697321 May 21 14:38:03.434971 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.434935 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0373704_51d6_4a6b_a388_862406573a2a.slice/crio-37de4121ed2024e4be923274e3a6c3668ef3332117728981c351422f88d5303c WatchSource:0}: Error finding container 37de4121ed2024e4be923274e3a6c3668ef3332117728981c351422f88d5303c: Status 404 returned error can't find the container with id 37de4121ed2024e4be923274e3a6c3668ef3332117728981c351422f88d5303c May 21 14:38:03.435823 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:03.435790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a70833_6459_41f6_9abc_47fe11629e33.slice/crio-5175deb6a49a20e0a29d8ae1738a9d2d0b5f7f471ef849ed29a5698452164d37 WatchSource:0}: Error finding container 5175deb6a49a20e0a29d8ae1738a9d2d0b5f7f471ef849ed29a5698452164d37: Status 404 returned error can't find the container with id 5175deb6a49a20e0a29d8ae1738a9d2d0b5f7f471ef849ed29a5698452164d37 May 21 14:38:03.567509 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.567470 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:33:01 +0000 UTC" deadline="2027-10-25 03:01:16.714354649 +0000 UTC" May 21 14:38:03.567892 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.567503 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12516h23m13.146855119s" May 21 14:38:03.666461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.666424 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerStarted","Data":"5175deb6a49a20e0a29d8ae1738a9d2d0b5f7f471ef849ed29a5698452164d37"} May 21 14:38:03.668375 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.668349 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dtwlc" event={"ID":"e0373704-51d6-4a6b-a388-862406573a2a","Type":"ContainerStarted","Data":"37de4121ed2024e4be923274e3a6c3668ef3332117728981c351422f88d5303c"} May 21 14:38:03.670098 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.670011 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" event={"ID":"f864ec60-8a32-4494-b22c-7266f075f09e","Type":"ContainerStarted","Data":"b38a0c0bbd0ba64a7a527c904ed34ef4fe1c60391d3a8adf73e107a2b4697321"} May 21 14:38:03.671140 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.671119 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6ckwn" event={"ID":"a14260e7-302c-4a4a-8dda-71e933043038","Type":"ContainerStarted","Data":"6ef930b3bbd0951e4633e7697b382d0a3dde3bfb4884413caf3081960fa01747"} May 21 14:38:03.672620 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.672601 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"b322a69b4da209c8acbd89c93033a78e9ff87db18ae843b7590128478fb8bc20"} May 21 14:38:03.673613 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.673594 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ltq6n" event={"ID":"f4f94ccd-5478-498f-82ba-a0888135005c","Type":"ContainerStarted","Data":"364b6699c80c9b48b8dc0c2ba45f3a4b034a2fd6ad11a029224222ec2c3a92e6"} May 21 14:38:03.674642 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.674613 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" event={"ID":"15b6c289-87d2-4e47-8dcc-f62b1485e573","Type":"ContainerStarted","Data":"cbec66ea21b1a6fdc99b281d3d7064e4bb0d11286e5137df4bbe35d11418b7c8"} May 21 14:38:03.676818 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.676796 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9st7g" event={"ID":"a4d0dfb2-f250-44a9-9615-4073f948685c","Type":"ContainerStarted","Data":"f5189236dea6a4b4b3b0fc0cb2b7510ac19988e2001d9284f982fa1596d490ec"} May 21 14:38:03.678728 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.678708 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" event={"ID":"3c5b17db4b61eb5d387ece2607db7785","Type":"ContainerStarted","Data":"e0fb87d17765f5f5e73276403f4c1b4b25be611a0c8078e0125906d21bfc7d35"} May 21 14:38:03.691488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:03.691451 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" podStartSLOduration=1.691440816 podStartE2EDuration="1.691440816s" podCreationTimestamp="2026-05-21 14:38:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:03.691389883 +0000 UTC m=+3.667733376" watchObservedRunningTime="2026-05-21 14:38:03.691440816 +0000 UTC m=+3.667784297" May 21 14:38:04.150375 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:04.150268 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:04.150542 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.150429 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:04.150542 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.150491 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:06.150473544 +0000 UTC m=+6.126817003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:04.250852 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:04.250813 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:04.251044 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.251024 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:04.251120 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.251049 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:04.251120 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.251061 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:04.251120 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.251116 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:06.251098867 +0000 UTC m=+6.227442332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:04.661928 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:04.661892 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:04.662361 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.662038 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:04.662860 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:04.662536 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:04.662860 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:04.662635 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:04.687545 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:04.687514 2572 generic.go:358] "Generic (PLEG): container finished" podID="f205cb58eb9f4cc6358fe22b9f69e5cb" containerID="6d16c4adf45c2e278e26ff3121f0b45eed44e92df0cdb68419e311648a9b8452" exitCode=0 May 21 14:38:04.687795 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:04.687621 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"f205cb58eb9f4cc6358fe22b9f69e5cb","Type":"ContainerDied","Data":"6d16c4adf45c2e278e26ff3121f0b45eed44e92df0cdb68419e311648a9b8452"} May 21 14:38:05.702498 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:05.702456 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"f205cb58eb9f4cc6358fe22b9f69e5cb","Type":"ContainerStarted","Data":"c0ae99ac517264eda5b430d9f24669f9af41e26d890f2a4cbbfa4a3ff2eea846"} May 21 14:38:06.166568 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:06.165997 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:06.166568 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.166126 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:06.166568 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.166183 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:10.166162759 +0000 UTC m=+10.142506218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:06.267697 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:06.266977 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:06.267697 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.267156 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:06.267697 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.267177 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:06.267697 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.267189 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:06.267697 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.267250 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:10.267231521 +0000 UTC m=+10.243574996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:06.662169 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:06.662028 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:06.662323 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.662204 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:06.662545 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:06.662525 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:06.662677 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:06.662646 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:08.660261 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:08.659768 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:08.660261 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:08.659912 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:08.660261 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:08.660261 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:08.660857 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:08.660364 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:10.204396 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.204354 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:10.204876 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.204510 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:10.204876 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.204581 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:18.204562273 +0000 UTC m=+18.180905746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:10.306148 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.305509 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:10.306148 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.305693 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:10.306148 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.305713 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:10.306148 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.305725 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:10.306148 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.305802 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:18.305782079 +0000 UTC m=+18.282125547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:10.421549 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.421432 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" podStartSLOduration=8.421412164 podStartE2EDuration="8.421412164s" podCreationTimestamp="2026-05-21 14:38:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:05.714879719 +0000 UTC m=+5.691223201" watchObservedRunningTime="2026-05-21 14:38:10.421412164 +0000 UTC m=+10.397755647" May 21 14:38:10.421773 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.421569 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hjv2b"] May 21 14:38:10.424793 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.424768 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.424911 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.424851 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:10.507564 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.507481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e15a5dca-468f-4b8c-b0d9-980a5e54998a-dbus\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.507564 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.507538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.507722 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.507623 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e15a5dca-468f-4b8c-b0d9-980a5e54998a-kubelet-config\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.608547 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.608506 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.608726 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.608576 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e15a5dca-468f-4b8c-b0d9-980a5e54998a-kubelet-config\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.608726 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.608628 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e15a5dca-468f-4b8c-b0d9-980a5e54998a-dbus\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.608869 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.608808 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e15a5dca-468f-4b8c-b0d9-980a5e54998a-dbus\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.609018 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.608918 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:10.609018 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.608983 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret podName:e15a5dca-468f-4b8c-b0d9-980a5e54998a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:11.10896411 +0000 UTC m=+11.085307573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret") pod "global-pull-secret-syncer-hjv2b" (UID: "e15a5dca-468f-4b8c-b0d9-980a5e54998a") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:10.609018 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.608983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e15a5dca-468f-4b8c-b0d9-980a5e54998a-kubelet-config\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:10.660027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.659993 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:10.660180 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.660104 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:10.660180 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:10.660162 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:10.660294 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:10.660248 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:11.112432 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:11.112389 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:11.112632 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:11.112599 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:11.112701 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:11.112663 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret podName:e15a5dca-468f-4b8c-b0d9-980a5e54998a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:12.112644307 +0000 UTC m=+12.088987767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret") pod "global-pull-secret-syncer-hjv2b" (UID: "e15a5dca-468f-4b8c-b0d9-980a5e54998a") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:11.659746 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:11.659712 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:11.660228 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:11.659858 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:12.120359 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:12.120276 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:12.120517 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:12.120414 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:12.120591 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:12.120531 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret podName:e15a5dca-468f-4b8c-b0d9-980a5e54998a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:14.120504207 +0000 UTC m=+14.096847679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret") pod "global-pull-secret-syncer-hjv2b" (UID: "e15a5dca-468f-4b8c-b0d9-980a5e54998a") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:12.659509 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:12.659468 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:12.659690 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:12.659600 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:12.659690 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:12.659665 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:12.660091 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:12.659793 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:13.160747 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.160704 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-7hrr5"] May 21 14:38:13.164625 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.164596 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.166781 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.166739 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-64jhk\"" May 21 14:38:13.169472 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.169444 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:38:13.169580 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.169487 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:38:13.230862 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.230830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee53d69f-8bed-4661-a837-fca3fd43ab2d-hosts-file\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.231032 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.230922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4hp\" (UniqueName: \"kubernetes.io/projected/ee53d69f-8bed-4661-a837-fca3fd43ab2d-kube-api-access-ms4hp\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.231032 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.230971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee53d69f-8bed-4661-a837-fca3fd43ab2d-tmp-dir\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.331700 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.331618 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4hp\" (UniqueName: \"kubernetes.io/projected/ee53d69f-8bed-4661-a837-fca3fd43ab2d-kube-api-access-ms4hp\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.331880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.331779 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee53d69f-8bed-4661-a837-fca3fd43ab2d-tmp-dir\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.331880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.331816 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee53d69f-8bed-4661-a837-fca3fd43ab2d-hosts-file\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.331992 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.331956 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee53d69f-8bed-4661-a837-fca3fd43ab2d-hosts-file\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.332244 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.332215 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee53d69f-8bed-4661-a837-fca3fd43ab2d-tmp-dir\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.340299 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.340276 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4hp\" (UniqueName: \"kubernetes.io/projected/ee53d69f-8bed-4661-a837-fca3fd43ab2d-kube-api-access-ms4hp\") pod \"node-resolver-7hrr5\" (UID: \"ee53d69f-8bed-4661-a837-fca3fd43ab2d\") " pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.474622 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.474581 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7hrr5" May 21 14:38:13.659258 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:13.659188 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:13.659406 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:13.659334 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:14.137728 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:14.137649 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:14.138280 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:14.137831 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:14.138280 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:14.137909 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret podName:e15a5dca-468f-4b8c-b0d9-980a5e54998a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:18.137890465 +0000 UTC m=+18.114233937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret") pod "global-pull-secret-syncer-hjv2b" (UID: "e15a5dca-468f-4b8c-b0d9-980a5e54998a") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:14.659743 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:14.659685 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:14.659743 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:14.659725 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:14.659970 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:14.659834 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:14.659970 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:14.659913 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:15.659318 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:15.659287 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:15.659801 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:15.659408 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:16.659446 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:16.659356 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:16.659446 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:16.659398 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:16.659909 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:16.659509 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:16.659909 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:16.659616 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:17.659412 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:17.659376 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:17.659610 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:17.659511 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:18.170005 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:18.169972 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:18.170177 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.170110 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:18.170225 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.170203 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret podName:e15a5dca-468f-4b8c-b0d9-980a5e54998a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:26.17018133 +0000 UTC m=+26.146524811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret") pod "global-pull-secret-syncer-hjv2b" (UID: "e15a5dca-468f-4b8c-b0d9-980a5e54998a") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:18.270618 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:18.270585 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:18.270814 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.270745 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:18.270883 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.270837 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:34.270816782 +0000 UTC m=+34.247160243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:18.372046 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:18.372004 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:18.372212 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.372189 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:18.372269 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.372214 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:18.372269 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.372228 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:18.372353 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.372293 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:34.372275432 +0000 UTC m=+34.348618905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:18.659545 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:18.659466 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:18.659698 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.659614 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:18.659698 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:18.659673 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:18.660137 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:18.659804 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:19.659628 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:19.659592 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:19.659804 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:19.659717 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:20.660187 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:20.660154 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:20.660615 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:20.660267 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:20.660615 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:20.660315 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:20.660615 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:20.660412 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:21.125954 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:21.125928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee53d69f_8bed_4661_a837_fca3fd43ab2d.slice/crio-0562e03057c21c062a20151cba87840700269b4096eaa9bdc7040ab4ce8b3173 WatchSource:0}: Error finding container 0562e03057c21c062a20151cba87840700269b4096eaa9bdc7040ab4ce8b3173: Status 404 returned error can't find the container with id 0562e03057c21c062a20151cba87840700269b4096eaa9bdc7040ab4ce8b3173 May 21 14:38:21.659862 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.659440 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:21.660008 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:21.659983 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:21.729951 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.729921 2572 generic.go:358] "Generic (PLEG): container finished" podID="01a70833-6459-41f6-9abc-47fe11629e33" containerID="734ae20d248cf861382492c05a3196069ea2d186c97273b0a2039c1f810ce8d9" exitCode=0 May 21 14:38:21.730647 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.730009 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerDied","Data":"734ae20d248cf861382492c05a3196069ea2d186c97273b0a2039c1f810ce8d9"} May 21 14:38:21.732935 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.732909 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dtwlc" event={"ID":"e0373704-51d6-4a6b-a388-862406573a2a","Type":"ContainerStarted","Data":"9c290348fdb91c7560ea8b347e9f3051d5c1927982273e960fbdca566da360c0"} May 21 14:38:21.735004 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.734952 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" event={"ID":"f864ec60-8a32-4494-b22c-7266f075f09e","Type":"ContainerStarted","Data":"5ace814f7aed444435a8286b8a30993179ed0a73978bdb153ce24f4629b1d2e8"} May 21 14:38:21.736665 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.736643 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6ckwn" event={"ID":"a14260e7-302c-4a4a-8dda-71e933043038","Type":"ContainerStarted","Data":"dd182445844d1eac94063dc49443a07181e050e4f508208e9cdaceb6d485ec4b"} May 21 14:38:21.738109 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.738087 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7hrr5" event={"ID":"ee53d69f-8bed-4661-a837-fca3fd43ab2d","Type":"ContainerStarted","Data":"80bf265d058dfd5f274e6559cd3d4be2de9c219f288d20ebcbc7b8b60f92315a"} May 21 14:38:21.738215 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.738116 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7hrr5" event={"ID":"ee53d69f-8bed-4661-a837-fca3fd43ab2d","Type":"ContainerStarted","Data":"0562e03057c21c062a20151cba87840700269b4096eaa9bdc7040ab4ce8b3173"} May 21 14:38:21.740724 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.740701 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"c9a0cdfdaf6c13a4f3dd9262af8a400f4140cd983e4963092a83da94f8b8aa44"} May 21 14:38:21.740833 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.740731 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"0beed7f246938b0fab3db2b666a694a424da390bda326a78b58c859bcc697857"} May 21 14:38:21.740833 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.740745 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"5ff560f00f264a6d366de357cfaaf83398eacf6f78d41cdfa19f19682fd4d275"} May 21 14:38:21.740833 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.740772 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"a24efb0fee8d7e1c5351e263c0dc8e9c232fa8b6cf1cdd0f6d4055f9005d8891"} May 21 14:38:21.742046 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.742022 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" event={"ID":"15b6c289-87d2-4e47-8dcc-f62b1485e573","Type":"ContainerStarted","Data":"1adef7ad02119cdc0b561c2567418647798e96987ea95a52bd54e1016c280fde"} May 21 14:38:21.743301 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.743277 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9st7g" event={"ID":"a4d0dfb2-f250-44a9-9615-4073f948685c","Type":"ContainerStarted","Data":"a1c4e9338c1fb558673fb849d1363aa107021a729aacf72cc183eab19533b151"} May 21 14:38:21.759480 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.759432 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jvl6s" podStartSLOduration=4.074281261 podStartE2EDuration="21.759419596s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.436388755 +0000 UTC m=+3.412732213" lastFinishedPulling="2026-05-21 14:38:21.121527074 +0000 UTC m=+21.097870548" observedRunningTime="2026-05-21 14:38:21.758938324 +0000 UTC m=+21.735281805" watchObservedRunningTime="2026-05-21 14:38:21.759419596 +0000 UTC m=+21.735763075" May 21 14:38:21.774982 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.774936 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6ckwn" podStartSLOduration=4.08632345 podStartE2EDuration="21.77492005s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.435044693 +0000 UTC m=+3.411388164" lastFinishedPulling="2026-05-21 14:38:21.12364129 +0000 UTC m=+21.099984764" observedRunningTime="2026-05-21 14:38:21.774496359 +0000 UTC m=+21.750839840" watchObservedRunningTime="2026-05-21 14:38:21.77492005 +0000 UTC m=+21.751263531" May 21 14:38:21.786410 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.786371 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dtwlc" podStartSLOduration=4.103637241 podStartE2EDuration="21.786355481s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.437093249 +0000 UTC m=+3.413436708" lastFinishedPulling="2026-05-21 14:38:21.119811478 +0000 UTC m=+21.096154948" observedRunningTime="2026-05-21 14:38:21.78632084 +0000 UTC m=+21.762664322" watchObservedRunningTime="2026-05-21 14:38:21.786355481 +0000 UTC m=+21.762698962" May 21 14:38:21.797856 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:21.797493 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9st7g" podStartSLOduration=8.91366947 podStartE2EDuration="21.797478518s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.426858929 +0000 UTC m=+3.403202393" lastFinishedPulling="2026-05-21 14:38:16.31066798 +0000 UTC m=+16.287011441" observedRunningTime="2026-05-21 14:38:21.79728027 +0000 UTC m=+21.773623747" watchObservedRunningTime="2026-05-21 14:38:21.797478518 +0000 UTC m=+21.773822000" May 21 14:38:22.620390 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.620172 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:38:22.659800 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.659767 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:22.659982 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.659812 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:22.659982 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:22.659891 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:22.660098 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:22.660027 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:22.748310 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.748227 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"add274d9d598ae3535987f893591d3c680c7d28200d911e1eb83ad0df8afeca3"} May 21 14:38:22.748310 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.748276 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"fe80194bc4a5a96e0c323db968429b5904059959af7806c178fbac6fc1bf62dc"} May 21 14:38:22.749693 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.749657 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ltq6n" event={"ID":"f4f94ccd-5478-498f-82ba-a0888135005c","Type":"ContainerStarted","Data":"735de9e30509dc582c54a749e61067f0d21d4631299772ebb06082861fa060e3"} May 21 14:38:22.751961 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.751937 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" event={"ID":"15b6c289-87d2-4e47-8dcc-f62b1485e573","Type":"ContainerStarted","Data":"b025ada97e2c8ca50acc0dabea703a477ccbadf66b23756a647700728104ed6d"} May 21 14:38:22.771530 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.771482 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ltq6n" podStartSLOduration=5.0837977500000004 podStartE2EDuration="22.771464872s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.432299636 +0000 UTC m=+3.408643098" lastFinishedPulling="2026-05-21 14:38:21.119966756 +0000 UTC m=+21.096310220" observedRunningTime="2026-05-21 14:38:22.771208732 +0000 UTC m=+22.747552214" watchObservedRunningTime="2026-05-21 14:38:22.771464872 +0000 UTC m=+22.747808354" May 21 14:38:22.771892 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:22.771858 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-7hrr5" podStartSLOduration=9.771848046 podStartE2EDuration="9.771848046s" podCreationTimestamp="2026-05-21 14:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:38:21.8148285 +0000 UTC m=+21.791171978" watchObservedRunningTime="2026-05-21 14:38:22.771848046 +0000 UTC m=+22.748191528" May 21 14:38:23.594565 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.594458 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:38:22.620364399Z","UUID":"757eea34-c458-4487-a87e-3d5c6fcd0af4","Handler":null,"Name":"","Endpoint":""} May 21 14:38:23.597424 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.597394 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:38:23.597424 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.597431 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:38:23.659641 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.659605 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:23.659895 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:23.659776 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:23.732189 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.732147 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:23.732865 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.732839 2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:23.753944 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.753869 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:23.754368 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:23.754351 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dtwlc" May 21 14:38:24.659816 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:24.659781 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:24.659998 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:24.659781 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:24.659998 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:24.659902 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:24.660117 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:24.660031 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:24.758395 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:24.758358 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"353667ab45251d9a1a3cbd2af9b57f532579c7b9d49f1d96dc7bf374473a292d"} May 21 14:38:24.760224 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:24.760197 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" event={"ID":"15b6c289-87d2-4e47-8dcc-f62b1485e573","Type":"ContainerStarted","Data":"4bf8ba9409f662405526b336567878c991aa7b09951ecc0abff5c27af5203e6e"} May 21 14:38:25.658885 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:25.658843 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:25.659075 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:25.658978 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:26.236190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.236151 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:26.236824 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:26.236323 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 14:38:26.236824 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:26.236408 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret podName:e15a5dca-468f-4b8c-b0d9-980a5e54998a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.236385495 +0000 UTC m=+42.212728968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret") pod "global-pull-secret-syncer-hjv2b" (UID: "e15a5dca-468f-4b8c-b0d9-980a5e54998a") : object "kube-system"/"original-pull-secret" not registered May 21 14:38:26.659679 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.659423 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:26.659679 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.659436 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:26.659903 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:26.659703 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:26.659903 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:26.659775 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:26.765747 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.765709 2572 generic.go:358] "Generic (PLEG): container finished" podID="01a70833-6459-41f6-9abc-47fe11629e33" containerID="9eb0637d92b0c9bec0ead78357243295bee6411e0bfd07143c0eeb2c2c91c6a5" exitCode=0 May 21 14:38:26.765939 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.765797 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerDied","Data":"9eb0637d92b0c9bec0ead78357243295bee6411e0bfd07143c0eeb2c2c91c6a5"} May 21 14:38:26.769283 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.769262 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" event={"ID":"5e551bf2-bd2f-4d36-9f0c-384e0e7380b9","Type":"ContainerStarted","Data":"5fd9fd958f6639d7eb3b6716537f5aae34e2cf8b5a46df98fa60a3a97053fc33"} May 21 14:38:26.769588 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.769575 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:26.785057 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.785038 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:26.786122 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.786087 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b72nj" podStartSLOduration=6.400884304 podStartE2EDuration="26.786075531s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.42993398 +0000 UTC m=+3.406277438" lastFinishedPulling="2026-05-21 14:38:23.815125204 +0000 UTC m=+23.791468665" observedRunningTime="2026-05-21 14:38:24.775940809 +0000 UTC m=+24.752284289" watchObservedRunningTime="2026-05-21 14:38:26.786075531 +0000 UTC m=+26.762419016" May 21 14:38:26.806431 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:26.806395 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" podStartSLOduration=9.077963398 podStartE2EDuration="26.80637391s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.433579525 +0000 UTC m=+3.409922983" lastFinishedPulling="2026-05-21 14:38:21.161990036 +0000 UTC m=+21.138333495" observedRunningTime="2026-05-21 14:38:26.805594416 +0000 UTC m=+26.781937897" watchObservedRunningTime="2026-05-21 14:38:26.80637391 +0000 UTC m=+26.782717382" May 21 14:38:27.660355 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:27.659847 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:27.660355 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:27.659990 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:27.772970 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:27.772882 2572 generic.go:358] "Generic (PLEG): container finished" podID="01a70833-6459-41f6-9abc-47fe11629e33" containerID="498f51b97523e89a3468d63e9f8e74b395baa81dcb80dd5018b04ed5e94c86e5" exitCode=0 May 21 14:38:27.773107 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:27.772973 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerDied","Data":"498f51b97523e89a3468d63e9f8e74b395baa81dcb80dd5018b04ed5e94c86e5"} May 21 14:38:27.773630 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:27.773503 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:27.773630 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:27.773529 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:27.789056 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:27.789029 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:38:28.318445 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.318408 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjv2b"] May 21 14:38:28.318605 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.318535 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:28.318671 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:28.318648 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:28.321554 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.321522 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lgcw"] May 21 14:38:28.321698 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.321667 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:28.321827 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:28.321802 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:28.323960 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.323933 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cklkr"] May 21 14:38:28.324097 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.324061 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:28.324179 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:28.324160 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:28.776938 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.776845 2572 generic.go:358] "Generic (PLEG): container finished" podID="01a70833-6459-41f6-9abc-47fe11629e33" containerID="c902d9cad541ac3e2443183adf625044be8e79ab47eeaffc235413179e9363ff" exitCode=0 May 21 14:38:28.776938 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:28.776917 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerDied","Data":"c902d9cad541ac3e2443183adf625044be8e79ab47eeaffc235413179e9363ff"} May 21 14:38:29.659139 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:29.659106 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:29.659275 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:29.659107 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:29.659275 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:29.659208 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:29.659351 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:29.659290 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:30.660652 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:30.660420 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:30.661283 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:30.660742 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:31.659568 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:31.659527 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:31.659747 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:31.659527 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:31.659747 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:31.659674 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:31.659747 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:31.659704 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:32.659536 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:32.659504 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:32.660122 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:32.659633 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:33.659603 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:33.659566 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:33.660245 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:33.659566 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:33.660245 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:33.659698 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cklkr" podUID="30a2a08b-17e0-48cf-91e3-bf51b09bb7c1" May 21 14:38:33.660245 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:33.659779 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lgcw" podUID="5d32dc8d-e310-47db-be24-075dad49de57" May 21 14:38:34.297532 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.297494 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:34.297721 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.297634 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:34.297721 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.297711 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs podName:5d32dc8d-e310-47db-be24-075dad49de57 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.297693026 +0000 UTC m=+66.274036488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs") pod "network-metrics-daemon-2lgcw" (UID: "5d32dc8d-e310-47db-be24-075dad49de57") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:38:34.398502 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.398463 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:34.398710 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.398688 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:38:34.398815 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.398716 2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:38:34.398815 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.398730 2572 projected.go:194] Error preparing data for projected volume kube-api-access-bktlr for pod openshift-network-diagnostics/network-check-target-cklkr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:34.398815 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.398813 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr podName:30a2a08b-17e0-48cf-91e3-bf51b09bb7c1 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.398791772 +0000 UTC m=+66.375135246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bktlr" (UniqueName: "kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr") pod "network-check-target-cklkr" (UID: "30a2a08b-17e0-48cf-91e3-bf51b09bb7c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:38:34.659593 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.659467 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:34.659778 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:34.659605 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjv2b" podUID="e15a5dca-468f-4b8c-b0d9-980a5e54998a" May 21 14:38:34.841745 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.841716 2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeReady" May 21 14:38:34.841930 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.841894 2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:38:34.874987 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.874949 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj"] May 21 14:38:34.928682 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.928612 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rqlt4"] May 21 14:38:34.928821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.928724 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" May 21 14:38:34.930879 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.930848 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:34.931025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.930925 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 14:38:34.931025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.931009 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6h82g\"" May 21 14:38:34.942401 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.942202 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2"] May 21 14:38:34.942532 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.942504 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:34.944454 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.944433 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 14:38:34.944677 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.944661 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 14:38:34.944789 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.944721 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:34.944789 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.944767 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 14:38:34.944922 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.944865 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hx2r8\"" May 21 14:38:34.958650 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.958627 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25"] May 21 14:38:34.958801 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.958771 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:34.960705 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.960687 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 21 14:38:34.960827 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.960701 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:34.960915 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.960870 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rbggp\"" May 21 14:38:34.961129 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.961110 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 21 14:38:34.961515 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.961495 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 14:38:34.977441 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.977416 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df44b68dd-qzx8h"] May 21 14:38:34.977556 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.977545 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:34.980034 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.980007 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 14:38:34.980034 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.980026 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 14:38:34.980034 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.980011 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:34.980244 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.980011 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 14:38:34.980511 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.980489 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mmfk2\"" May 21 14:38:34.992012 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.991992 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd"] May 21 14:38:34.992144 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.992130 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:34.994107 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.994089 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6kdzp\"" May 21 14:38:34.994195 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.994090 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 14:38:34.994328 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.994313 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 14:38:34.994374 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:34.994342 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 14:38:35.001644 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.001624 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 14:38:35.001964 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.001944 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb"] May 21 14:38:35.002106 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.002091 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.005371 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.005350 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 14:38:35.005461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.005428 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 14:38:35.005461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.005359 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wtfz9\"" May 21 14:38:35.012331 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.012293 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6"] May 21 14:38:35.012482 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.012435 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.014622 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.014602 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 14:38:35.014717 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.014645 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 14:38:35.014796 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.014736 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 14:38:35.014796 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.014742 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 14:38:35.014796 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.014746 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qgrnd\"" May 21 14:38:35.033108 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.033087 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt"] May 21 14:38:35.033230 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.033213 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.034984 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.034962 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 14:38:35.035099 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.035027 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 14:38:35.035099 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.035034 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-s6z8m\"" May 21 14:38:35.035099 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.035068 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 14:38:35.035232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.035119 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 14:38:35.045291 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.045264 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm"] May 21 14:38:35.045433 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.045417 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" May 21 14:38:35.047196 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.047178 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:38:35.047291 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.047197 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v9kv6\"" May 21 14:38:35.047352 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.047308 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:38:35.055684 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.055664 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd"] May 21 14:38:35.055839 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.055824 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.057718 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.057698 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 14:38:35.057718 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.057709 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 14:38:35.057860 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.057712 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 14:38:35.057860 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.057738 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 14:38:35.067928 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.067909 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj"] May 21 14:38:35.068038 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.067933 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c2fdl"] May 21 14:38:35.068098 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.068065 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.070018 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.069999 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 14:38:35.076030 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076011 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076035 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076044 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076051 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076060 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076071 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076083 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df44b68dd-qzx8h"] May 21 14:38:35.076123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076113 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cjn7j"] May 21 14:38:35.076358 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.076170 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.078061 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.078044 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:38:35.078136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.078060 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:38:35.078185 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.078145 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-86l7j\"" May 21 14:38:35.082307 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.082285 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rqlt4"] May 21 14:38:35.082307 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.082308 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6"] May 21 14:38:35.082444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.082320 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c2fdl"] May 21 14:38:35.082444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.082333 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm"] May 21 14:38:35.082444 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.082345 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjn7j"] May 21 14:38:35.082573 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.082439 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.084316 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.084300 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:38:35.084431 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.084414 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:38:35.084488 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.084474 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:38:35.084553 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.084539 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsm8g\"" May 21 14:38:35.103517 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103491 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-ca-trust-extracted\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.103643 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-bound-sa-token\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.103643 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-certificates\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.103643 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8mjq\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-kube-api-access-x8mjq\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.103643 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n8w\" (UniqueName: \"kubernetes.io/projected/e0146795-82a0-4a59-a5a3-43ef797c0edd-kube-api-access-24n8w\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:35.103643 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-trusted-ca\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfabbbdb-f7d2-4907-aebf-228c094a214f-trusted-ca\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gj8v\" (UniqueName: \"kubernetes.io/projected/bfabbbdb-f7d2-4907-aebf-228c094a214f-kube-api-access-9gj8v\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/340fcef8-b371-4749-b30c-8d588a4a6403-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq87n\" (UniqueName: \"kubernetes.io/projected/335ea2a0-a7a0-4814-b032-461ed3fed85d-kube-api-access-zq87n\") pod \"volume-data-source-validator-5cf8c89d64-tzwbj\" (UID: \"335ea2a0-a7a0-4814-b032-461ed3fed85d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103874 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977808ec-b508-4551-abe3-3e131dd869ac-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.103899 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/977808ec-b508-4551-abe3-3e131dd869ac-config\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-image-registry-private-configuration\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103974 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfabbbdb-f7d2-4907-aebf-228c094a214f-serving-cert\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.103997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-installation-pull-secrets\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.104026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjp47\" (UniqueName: \"kubernetes.io/projected/977808ec-b508-4551-abe3-3e131dd869ac-kube-api-access-xjp47\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.104058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.104080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:35.104190 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.104096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfabbbdb-f7d2-4907-aebf-228c094a214f-config\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.205035 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205010 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-ca-trust-extracted\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.205136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205047 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mjq\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-kube-api-access-x8mjq\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.205136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205075 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24n8w\" (UniqueName: \"kubernetes.io/projected/e0146795-82a0-4a59-a5a3-43ef797c0edd-kube-api-access-24n8w\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:35.205136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.205136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205130 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-certificates\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.205334 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205159 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.205334 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.205244 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:38:35.205334 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.205259 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df44b68dd-qzx8h: secret "image-registry-tls" not found May 21 14:38:35.205334 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205274 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfabbbdb-f7d2-4907-aebf-228c094a214f-trusted-ca\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.205334 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205314 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gj8v\" (UniqueName: \"kubernetes.io/projected/bfabbbdb-f7d2-4907-aebf-228c094a214f-kube-api-access-9gj8v\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.205544 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205342 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/340fcef8-b371-4749-b30c-8d588a4a6403-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.205544 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.205402 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls podName:6c188d9c-2b57-4122-97dd-ebb743aa6c7a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:35.705381995 +0000 UTC m=+35.681725459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls") pod "image-registry-7df44b68dd-qzx8h" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a") : secret "image-registry-tls" not found May 21 14:38:35.205544 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-ca-trust-extracted\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.205544 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205499 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zq87n\" (UniqueName: \"kubernetes.io/projected/335ea2a0-a7a0-4814-b032-461ed3fed85d-kube-api-access-zq87n\") pod \"volume-data-source-validator-5cf8c89d64-tzwbj\" (UID: \"335ea2a0-a7a0-4814-b032-461ed3fed85d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" May 21 14:38:35.205544 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205534 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977808ec-b508-4551-abe3-3e131dd869ac-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.205784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205563 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/977808ec-b508-4551-abe3-3e131dd869ac-config\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.205784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205596 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/741d0260-3430-4a33-b9ea-1f29891abafb-klusterlet-config\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.205784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525th\" (UniqueName: \"kubernetes.io/projected/3aa6d295-1eab-4aaf-9496-06b72212e484-kube-api-access-525th\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.205784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20718e91-7ead-4bed-80e0-4f12b7883b7a-config\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.205784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7308e29d-7eea-4f0e-8981-d62052fb459f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6\" (UID: \"7308e29d-7eea-4f0e-8981-d62052fb459f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.205784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205772 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-certificates\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.205992 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205831 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfabbbdb-f7d2-4907-aebf-228c094a214f-serving-cert\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.205992 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/741d0260-3430-4a33-b9ea-1f29891abafb-tmp\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.205992 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.205981 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-installation-pull-secrets\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.206103 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206016 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.206103 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/340fcef8-b371-4749-b30c-8d588a4a6403-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.206103 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206063 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzfwq\" (UniqueName: \"kubernetes.io/projected/5b6274e1-9635-4291-ad41-32587068ca02-kube-api-access-zzfwq\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.206210 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/977808ec-b508-4551-abe3-3e131dd869ac-config\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.206210 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206174 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn7d6\" (UniqueName: \"kubernetes.io/projected/9e62a23a-6e74-4181-a37b-7404a0095596-kube-api-access-jn7d6\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.206303 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206222 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.206303 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.206382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfabbbdb-f7d2-4907-aebf-228c094a214f-trusted-ca\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.206382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206331 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:35.206382 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.206377 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:38:35.206521 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.206463 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:38:35.206521 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206469 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-bound-sa-token\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.206521 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206509 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zh6f\" (UniqueName: \"kubernetes.io/projected/7308e29d-7eea-4f0e-8981-d62052fb459f-kube-api-access-5zh6f\") pod \"managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6\" (UID: \"7308e29d-7eea-4f0e-8981-d62052fb459f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.206661 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.206525 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls podName:e0146795-82a0-4a59-a5a3-43ef797c0edd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:35.706510528 +0000 UTC m=+35.682853993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls") pod "cluster-samples-operator-697587599-qc7z2" (UID: "e0146795-82a0-4a59-a5a3-43ef797c0edd") : secret "samples-operator-tls" not found May 21 14:38:35.206661 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.206572 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert podName:340fcef8-b371-4749-b30c-8d588a4a6403 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:35.706550571 +0000 UTC m=+35.682894039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-blsvd" (UID: "340fcef8-b371-4749-b30c-8d588a4a6403") : secret "networking-console-plugin-cert" not found May 21 14:38:35.206661 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5b6274e1-9635-4291-ad41-32587068ca02-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.206661 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206640 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-trusted-ca\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.206854 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e62a23a-6e74-4181-a37b-7404a0095596-config-volume\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.206854 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20718e91-7ead-4bed-80e0-4f12b7883b7a-serving-cert\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.206854 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbpt\" (UniqueName: \"kubernetes.io/projected/741d0260-3430-4a33-b9ea-1f29891abafb-kube-api-access-plbpt\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.206854 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.206854 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206832 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e62a23a-6e74-4181-a37b-7404a0095596-tmp-dir\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.207050 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206859 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-image-registry-private-configuration\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.207050 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s2ft\" (UniqueName: \"kubernetes.io/projected/20718e91-7ead-4bed-80e0-4f12b7883b7a-kube-api-access-4s2ft\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.207050 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-ca\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.207050 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.206984 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjp47\" (UniqueName: \"kubernetes.io/projected/977808ec-b508-4551-abe3-3e131dd869ac-kube-api-access-xjp47\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.207050 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.207015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-hub\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.207245 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.207043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvxxw\" (UniqueName: \"kubernetes.io/projected/081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c-kube-api-access-wvxxw\") pod \"network-check-source-7f44b6dd87-cktgt\" (UID: \"081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" May 21 14:38:35.207245 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.207082 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfabbbdb-f7d2-4907-aebf-228c094a214f-config\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.207572 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.207551 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-trusted-ca\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.207643 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.207591 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfabbbdb-f7d2-4907-aebf-228c094a214f-config\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.209879 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.209854 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfabbbdb-f7d2-4907-aebf-228c094a214f-serving-cert\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.209960 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.209867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977808ec-b508-4551-abe3-3e131dd869ac-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.209960 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.209935 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-installation-pull-secrets\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.210029 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.209979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-image-registry-private-configuration\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.213935 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.213909 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n8w\" (UniqueName: \"kubernetes.io/projected/e0146795-82a0-4a59-a5a3-43ef797c0edd-kube-api-access-24n8w\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:35.214365 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.214343 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjp47\" (UniqueName: \"kubernetes.io/projected/977808ec-b508-4551-abe3-3e131dd869ac-kube-api-access-xjp47\") pod \"kube-storage-version-migrator-operator-565644f49-kns25\" (UID: \"977808ec-b508-4551-abe3-3e131dd869ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.214642 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.214611 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-bound-sa-token\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.214887 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.214870 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gj8v\" (UniqueName: \"kubernetes.io/projected/bfabbbdb-f7d2-4907-aebf-228c094a214f-kube-api-access-9gj8v\") pod \"console-operator-76dff48d59-rqlt4\" (UID: \"bfabbbdb-f7d2-4907-aebf-228c094a214f\") " pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.215068 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.215049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8mjq\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-kube-api-access-x8mjq\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.215143 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.215127 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq87n\" (UniqueName: \"kubernetes.io/projected/335ea2a0-a7a0-4814-b032-461ed3fed85d-kube-api-access-zq87n\") pod \"volume-data-source-validator-5cf8c89d64-tzwbj\" (UID: \"335ea2a0-a7a0-4814-b032-461ed3fed85d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" May 21 14:38:35.238457 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.238420 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" May 21 14:38:35.251296 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.251264 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:35.286037 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.285823 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" May 21 14:38:35.308277 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.308251 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.308398 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.308286 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzfwq\" (UniqueName: \"kubernetes.io/projected/5b6274e1-9635-4291-ad41-32587068ca02-kube-api-access-zzfwq\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.308446 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.308397 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jn7d6\" (UniqueName: \"kubernetes.io/projected/9e62a23a-6e74-4181-a37b-7404a0095596-kube-api-access-jn7d6\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.308558 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.308538 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.308885 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.308788 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zh6f\" (UniqueName: \"kubernetes.io/projected/7308e29d-7eea-4f0e-8981-d62052fb459f-kube-api-access-5zh6f\") pod \"managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6\" (UID: \"7308e29d-7eea-4f0e-8981-d62052fb459f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.308885 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.308810 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:35.309113 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.308896 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert podName:3aa6d295-1eab-4aaf-9496-06b72212e484 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:35.808876477 +0000 UTC m=+35.785219944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert") pod "ingress-canary-cjn7j" (UID: "3aa6d295-1eab-4aaf-9496-06b72212e484") : secret "canary-serving-cert" not found May 21 14:38:35.309199 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.308815 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5b6274e1-9635-4291-ad41-32587068ca02-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.309261 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309228 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e62a23a-6e74-4181-a37b-7404a0095596-config-volume\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.309352 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309286 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20718e91-7ead-4bed-80e0-4f12b7883b7a-serving-cert\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.309430 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309354 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plbpt\" (UniqueName: \"kubernetes.io/projected/741d0260-3430-4a33-b9ea-1f29891abafb-kube-api-access-plbpt\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.309430 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309398 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/5b6274e1-9635-4291-ad41-32587068ca02-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.309530 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309435 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.309530 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309507 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e62a23a-6e74-4181-a37b-7404a0095596-tmp-dir\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.309702 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309538 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s2ft\" (UniqueName: \"kubernetes.io/projected/20718e91-7ead-4bed-80e0-4f12b7883b7a-kube-api-access-4s2ft\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.309702 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309585 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-ca\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.309702 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309671 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-hub\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.309875 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309706 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvxxw\" (UniqueName: \"kubernetes.io/projected/081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c-kube-api-access-wvxxw\") pod \"network-check-source-7f44b6dd87-cktgt\" (UID: \"081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" May 21 14:38:35.309875 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309798 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.309875 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.309810 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.309876 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls podName:9e62a23a-6e74-4181-a37b-7404a0095596 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:35.809859286 +0000 UTC m=+35.786202751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls") pod "dns-default-c2fdl" (UID: "9e62a23a-6e74-4181-a37b-7404a0095596") : secret "dns-default-metrics-tls" not found May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309893 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e62a23a-6e74-4181-a37b-7404a0095596-config-volume\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e62a23a-6e74-4181-a37b-7404a0095596-tmp-dir\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309931 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/741d0260-3430-4a33-b9ea-1f29891abafb-klusterlet-config\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309961 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-525th\" (UniqueName: \"kubernetes.io/projected/3aa6d295-1eab-4aaf-9496-06b72212e484-kube-api-access-525th\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.309989 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20718e91-7ead-4bed-80e0-4f12b7883b7a-config\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.310027 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.310014 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7308e29d-7eea-4f0e-8981-d62052fb459f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6\" (UID: \"7308e29d-7eea-4f0e-8981-d62052fb459f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.310391 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.310053 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/741d0260-3430-4a33-b9ea-1f29891abafb-tmp\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.310452 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.310401 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/741d0260-3430-4a33-b9ea-1f29891abafb-tmp\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.310815 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.310771 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20718e91-7ead-4bed-80e0-4f12b7883b7a-config\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.313996 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.313886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.314779 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7308e29d-7eea-4f0e-8981-d62052fb459f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6\" (UID: \"7308e29d-7eea-4f0e-8981-d62052fb459f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.315033 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20718e91-7ead-4bed-80e0-4f12b7883b7a-serving-cert\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.315073 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.315549 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/741d0260-3430-4a33-b9ea-1f29891abafb-klusterlet-config\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.315803 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-hub\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.316449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5b6274e1-9635-4291-ad41-32587068ca02-ca\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.320747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvxxw\" (UniqueName: \"kubernetes.io/projected/081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c-kube-api-access-wvxxw\") pod \"network-check-source-7f44b6dd87-cktgt\" (UID: \"081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.320822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzfwq\" (UniqueName: \"kubernetes.io/projected/5b6274e1-9635-4291-ad41-32587068ca02-kube-api-access-zzfwq\") pod \"cluster-proxy-proxy-agent-78665757b-sxcrm\" (UID: \"5b6274e1-9635-4291-ad41-32587068ca02\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.321810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.321185 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s2ft\" (UniqueName: \"kubernetes.io/projected/20718e91-7ead-4bed-80e0-4f12b7883b7a-kube-api-access-4s2ft\") pod \"service-ca-operator-57b5b68b8-9btvb\" (UID: \"20718e91-7ead-4bed-80e0-4f12b7883b7a\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.322298 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.322046 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbpt\" (UniqueName: \"kubernetes.io/projected/741d0260-3430-4a33-b9ea-1f29891abafb-kube-api-access-plbpt\") pod \"klusterlet-addon-workmgr-64b4fcc589-47tdd\" (UID: \"741d0260-3430-4a33-b9ea-1f29891abafb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.325576 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.323639 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" May 21 14:38:35.325576 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.324672 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn7d6\" (UniqueName: \"kubernetes.io/projected/9e62a23a-6e74-4181-a37b-7404a0095596-kube-api-access-jn7d6\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.325576 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.325388 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zh6f\" (UniqueName: \"kubernetes.io/projected/7308e29d-7eea-4f0e-8981-d62052fb459f-kube-api-access-5zh6f\") pod \"managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6\" (UID: \"7308e29d-7eea-4f0e-8981-d62052fb459f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.326245 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.326132 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-525th\" (UniqueName: \"kubernetes.io/projected/3aa6d295-1eab-4aaf-9496-06b72212e484-kube-api-access-525th\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.352778 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.351178 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" May 21 14:38:35.358774 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.358204 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" May 21 14:38:35.367463 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.366866 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:38:35.392797 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.385948 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:35.454585 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.454503 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj"] May 21 14:38:35.460898 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.460865 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rqlt4"] May 21 14:38:35.478822 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.478790 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25"] May 21 14:38:35.511200 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.511174 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb"] May 21 14:38:35.658882 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.658855 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:38:35.658882 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.658868 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:38:35.661040 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.661005 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:38:35.661487 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.661089 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pnzxq\"" May 21 14:38:35.661487 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.661130 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ns24t\"" May 21 14:38:35.661487 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.661212 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6"] May 21 14:38:35.672091 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.672066 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt"] May 21 14:38:35.675797 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.675769 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd"] May 21 14:38:35.676622 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.676603 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm"] May 21 14:38:35.680160 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:35.680135 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7308e29d_7eea_4f0e_8981_d62052fb459f.slice/crio-8f3e488205e97a66645f8ee2d25bd988a8abbeb3581c7afc085c12c106a2202e WatchSource:0}: Error finding container 8f3e488205e97a66645f8ee2d25bd988a8abbeb3581c7afc085c12c106a2202e: Status 404 returned error can't find the container with id 8f3e488205e97a66645f8ee2d25bd988a8abbeb3581c7afc085c12c106a2202e May 21 14:38:35.680836 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:35.680813 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b6274e1_9635_4291_ad41_32587068ca02.slice/crio-10a1bfc68622ee1f1b9530075090d6a9720b48ba31ff5fb4bbef996b70441de8 WatchSource:0}: Error finding container 10a1bfc68622ee1f1b9530075090d6a9720b48ba31ff5fb4bbef996b70441de8: Status 404 returned error can't find the container with id 10a1bfc68622ee1f1b9530075090d6a9720b48ba31ff5fb4bbef996b70441de8 May 21 14:38:35.681391 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:35.681361 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081ab0d7_19d3_4cfb_ac18_cd5ca93c8b5c.slice/crio-97aabdc3f285f2ede90edee2355428b5d6cfe352885fbfd3f5f5625bb2847afa WatchSource:0}: Error finding container 97aabdc3f285f2ede90edee2355428b5d6cfe352885fbfd3f5f5625bb2847afa: Status 404 returned error can't find the container with id 97aabdc3f285f2ede90edee2355428b5d6cfe352885fbfd3f5f5625bb2847afa May 21 14:38:35.682408 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:35.682166 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741d0260_3430_4a33_b9ea_1f29891abafb.slice/crio-d4c6f24edcfc19203eab3013cbd5bf474a5fd844afffa44cc594b46c11d24607 WatchSource:0}: Error finding container d4c6f24edcfc19203eab3013cbd5bf474a5fd844afffa44cc594b46c11d24607: Status 404 returned error can't find the container with id d4c6f24edcfc19203eab3013cbd5bf474a5fd844afffa44cc594b46c11d24607 May 21 14:38:35.716191 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.716122 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:35.716302 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.716219 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:35.716302 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716275 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:38:35.716302 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.716289 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:35.716422 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716330 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls podName:e0146795-82a0-4a59-a5a3-43ef797c0edd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:36.716315776 +0000 UTC m=+36.692659235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls") pod "cluster-samples-operator-697587599-qc7z2" (UID: "e0146795-82a0-4a59-a5a3-43ef797c0edd") : secret "samples-operator-tls" not found May 21 14:38:35.716422 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716372 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:38:35.716422 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716389 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:38:35.716534 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716431 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert podName:340fcef8-b371-4749-b30c-8d588a4a6403 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:36.716419859 +0000 UTC m=+36.692763318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-blsvd" (UID: "340fcef8-b371-4749-b30c-8d588a4a6403") : secret "networking-console-plugin-cert" not found May 21 14:38:35.716534 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716390 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df44b68dd-qzx8h: secret "image-registry-tls" not found May 21 14:38:35.716534 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.716463 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls podName:6c188d9c-2b57-4122-97dd-ebb743aa6c7a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:36.71645409 +0000 UTC m=+36.692797592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls") pod "image-registry-7df44b68dd-qzx8h" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a") : secret "image-registry-tls" not found May 21 14:38:35.790237 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.790201 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" event={"ID":"7308e29d-7eea-4f0e-8981-d62052fb459f","Type":"ContainerStarted","Data":"8f3e488205e97a66645f8ee2d25bd988a8abbeb3581c7afc085c12c106a2202e"} May 21 14:38:35.791294 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.791269 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" event={"ID":"20718e91-7ead-4bed-80e0-4f12b7883b7a","Type":"ContainerStarted","Data":"1d586a7eaeb18261251dd4365dea1b467b3274c8031aa77519dbf32f83676037"} May 21 14:38:35.792341 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.792320 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" event={"ID":"977808ec-b508-4551-abe3-3e131dd869ac","Type":"ContainerStarted","Data":"8219adcedacee22c30d50e240c912ab8796f881feab8baad76708c0ecad5ae78"} May 21 14:38:35.793483 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.793466 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" event={"ID":"5b6274e1-9635-4291-ad41-32587068ca02","Type":"ContainerStarted","Data":"10a1bfc68622ee1f1b9530075090d6a9720b48ba31ff5fb4bbef996b70441de8"} May 21 14:38:35.795717 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.795690 2572 generic.go:358] "Generic (PLEG): container finished" podID="01a70833-6459-41f6-9abc-47fe11629e33" containerID="5f789f2daaa362e0c0ff17acbb406d57757a7ece2734efecad2287f30a4ca5b9" exitCode=0 May 21 14:38:35.795825 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.795745 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerDied","Data":"5f789f2daaa362e0c0ff17acbb406d57757a7ece2734efecad2287f30a4ca5b9"} May 21 14:38:35.796807 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.796788 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" event={"ID":"081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c","Type":"ContainerStarted","Data":"97aabdc3f285f2ede90edee2355428b5d6cfe352885fbfd3f5f5625bb2847afa"} May 21 14:38:35.797721 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.797703 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" event={"ID":"335ea2a0-a7a0-4814-b032-461ed3fed85d","Type":"ContainerStarted","Data":"a44ccd6579ce58b96db66fb426c55fee1a6bfb26bf350569ea7a856e907a7a2b"} May 21 14:38:35.798571 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.798549 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" event={"ID":"741d0260-3430-4a33-b9ea-1f29891abafb","Type":"ContainerStarted","Data":"d4c6f24edcfc19203eab3013cbd5bf474a5fd844afffa44cc594b46c11d24607"} May 21 14:38:35.799365 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.799347 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" event={"ID":"bfabbbdb-f7d2-4907-aebf-228c094a214f","Type":"ContainerStarted","Data":"47b8a3773e9e369d999a9047af062a7c657a419a5118df68ee9ee36f2f982a62"} May 21 14:38:35.817678 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.817651 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:35.817856 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:35.817696 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:35.817856 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.817808 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:35.817856 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.817829 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:35.817856 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.817849 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls podName:9e62a23a-6e74-4181-a37b-7404a0095596 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:36.817836143 +0000 UTC m=+36.794179601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls") pod "dns-default-c2fdl" (UID: "9e62a23a-6e74-4181-a37b-7404a0095596") : secret "dns-default-metrics-tls" not found May 21 14:38:35.818068 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:35.817969 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert podName:3aa6d295-1eab-4aaf-9496-06b72212e484 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:36.817951277 +0000 UTC m=+36.794294741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert") pod "ingress-canary-cjn7j" (UID: "3aa6d295-1eab-4aaf-9496-06b72212e484") : secret "canary-serving-cert" not found May 21 14:38:36.660732 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.659911 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:36.663605 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.663323 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:38:36.727081 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.727040 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:36.727238 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.727168 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:36.727313 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.727240 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:36.727389 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.727371 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:38:36.727449 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.727440 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert podName:340fcef8-b371-4749-b30c-8d588a4a6403 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:38.727421114 +0000 UTC m=+38.703764575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-blsvd" (UID: "340fcef8-b371-4749-b30c-8d588a4a6403") : secret "networking-console-plugin-cert" not found May 21 14:38:36.727878 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.727860 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:38:36.727962 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.727917 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls podName:e0146795-82a0-4a59-a5a3-43ef797c0edd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:38.727900234 +0000 UTC m=+38.704243709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls") pod "cluster-samples-operator-697587599-qc7z2" (UID: "e0146795-82a0-4a59-a5a3-43ef797c0edd") : secret "samples-operator-tls" not found May 21 14:38:36.728025 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.727978 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:38:36.728025 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.727989 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df44b68dd-qzx8h: secret "image-registry-tls" not found May 21 14:38:36.728025 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.728019 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls podName:6c188d9c-2b57-4122-97dd-ebb743aa6c7a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:38.728008981 +0000 UTC m=+38.704352454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls") pod "image-registry-7df44b68dd-qzx8h" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a") : secret "image-registry-tls" not found May 21 14:38:36.815603 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.815029 2572 generic.go:358] "Generic (PLEG): container finished" podID="01a70833-6459-41f6-9abc-47fe11629e33" containerID="11aeb4bfab8ec7e55830c70d912629ee9cc2197408375137d5bc989bc46adb03" exitCode=0 May 21 14:38:36.815603 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.815121 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerDied","Data":"11aeb4bfab8ec7e55830c70d912629ee9cc2197408375137d5bc989bc46adb03"} May 21 14:38:36.828631 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.828601 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:36.828735 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:36.828680 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:36.829885 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.829743 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:36.829977 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.829930 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert podName:3aa6d295-1eab-4aaf-9496-06b72212e484 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:38.829910268 +0000 UTC m=+38.806253733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert") pod "ingress-canary-cjn7j" (UID: "3aa6d295-1eab-4aaf-9496-06b72212e484") : secret "canary-serving-cert" not found May 21 14:38:36.830305 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.830287 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:36.830383 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:36.830336 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls podName:9e62a23a-6e74-4181-a37b-7404a0095596 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:38.830321989 +0000 UTC m=+38.806665452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls") pod "dns-default-c2fdl" (UID: "9e62a23a-6e74-4181-a37b-7404a0095596") : secret "dns-default-metrics-tls" not found May 21 14:38:37.847126 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:37.846903 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wd44n" event={"ID":"01a70833-6459-41f6-9abc-47fe11629e33","Type":"ContainerStarted","Data":"2ee94f5c070da0af4698f0bf86626aaf9af923fbf88d19c4cf5b2a1313336ee9"} May 21 14:38:37.870399 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:37.870342 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wd44n" podStartSLOduration=6.13708336 podStartE2EDuration="37.870322933s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:38:03.460833637 +0000 UTC m=+3.437177096" lastFinishedPulling="2026-05-21 14:38:35.194073207 +0000 UTC m=+35.170416669" observedRunningTime="2026-05-21 14:38:37.869184389 +0000 UTC m=+37.845527883" watchObservedRunningTime="2026-05-21 14:38:37.870322933 +0000 UTC m=+37.846666411" May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:38.758465 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:38.758570 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:38.758619 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.758740 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.758829 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls podName:e0146795-82a0-4a59-a5a3-43ef797c0edd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.758807619 +0000 UTC m=+42.735151084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls") pod "cluster-samples-operator-697587599-qc7z2" (UID: "e0146795-82a0-4a59-a5a3-43ef797c0edd") : secret "samples-operator-tls" not found May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.759236 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.759253 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df44b68dd-qzx8h: secret "image-registry-tls" not found May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.759297 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls podName:6c188d9c-2b57-4122-97dd-ebb743aa6c7a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.759282065 +0000 UTC m=+42.735625532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls") pod "image-registry-7df44b68dd-qzx8h" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a") : secret "image-registry-tls" not found May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.759358 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:38:38.759420 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.759391 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert podName:340fcef8-b371-4749-b30c-8d588a4a6403 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.759380342 +0000 UTC m=+42.735723806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-blsvd" (UID: "340fcef8-b371-4749-b30c-8d588a4a6403") : secret "networking-console-plugin-cert" not found May 21 14:38:38.859311 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:38.859209 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:38.860870 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.859527 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:38.860870 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.860275 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls podName:9e62a23a-6e74-4181-a37b-7404a0095596 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.860244026 +0000 UTC m=+42.836587489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls") pod "dns-default-c2fdl" (UID: "9e62a23a-6e74-4181-a37b-7404a0095596") : secret "dns-default-metrics-tls" not found May 21 14:38:38.861245 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:38.861230 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:38.861426 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.861365 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:38.861580 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:38.861571 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert podName:3aa6d295-1eab-4aaf-9496-06b72212e484 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:42.861557978 +0000 UTC m=+42.837901437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert") pod "ingress-canary-cjn7j" (UID: "3aa6d295-1eab-4aaf-9496-06b72212e484") : secret "canary-serving-cert" not found May 21 14:38:42.293974 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.293798 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:42.297139 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.297117 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e15a5dca-468f-4b8c-b0d9-980a5e54998a-original-pull-secret\") pod \"global-pull-secret-syncer-hjv2b\" (UID: \"e15a5dca-468f-4b8c-b0d9-980a5e54998a\") " pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:42.375265 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.375220 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjv2b" May 21 14:38:42.798510 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.798474 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:42.798682 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.798553 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:42.798682 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.798594 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:42.798682 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798669 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:38:42.798857 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798690 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df44b68dd-qzx8h: secret "image-registry-tls" not found May 21 14:38:42.798857 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798699 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:38:42.798857 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798787 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:38:42.798857 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798793 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls podName:6c188d9c-2b57-4122-97dd-ebb743aa6c7a nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.798767846 +0000 UTC m=+50.775111325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls") pod "image-registry-7df44b68dd-qzx8h" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a") : secret "image-registry-tls" not found May 21 14:38:42.798857 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798851 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert podName:340fcef8-b371-4749-b30c-8d588a4a6403 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.798839119 +0000 UTC m=+50.775182581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-blsvd" (UID: "340fcef8-b371-4749-b30c-8d588a4a6403") : secret "networking-console-plugin-cert" not found May 21 14:38:42.799072 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.798863 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls podName:e0146795-82a0-4a59-a5a3-43ef797c0edd nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.798856244 +0000 UTC m=+50.775199703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls") pod "cluster-samples-operator-697587599-qc7z2" (UID: "e0146795-82a0-4a59-a5a3-43ef797c0edd") : secret "samples-operator-tls" not found May 21 14:38:42.899507 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.899474 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:42.899703 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:42.899543 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:42.899703 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.899660 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:42.899703 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.899664 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:42.899856 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.899729 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls podName:9e62a23a-6e74-4181-a37b-7404a0095596 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.899710398 +0000 UTC m=+50.876053863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls") pod "dns-default-c2fdl" (UID: "9e62a23a-6e74-4181-a37b-7404a0095596") : secret "dns-default-metrics-tls" not found May 21 14:38:42.899856 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:42.899765 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert podName:3aa6d295-1eab-4aaf-9496-06b72212e484 nodeName:}" failed. No retries permitted until 2026-05-21 14:38:50.899739539 +0000 UTC m=+50.876083001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert") pod "ingress-canary-cjn7j" (UID: "3aa6d295-1eab-4aaf-9496-06b72212e484") : secret "canary-serving-cert" not found May 21 14:38:46.643254 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.643221 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjv2b"] May 21 14:38:46.648623 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:38:46.646890 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15a5dca_468f_4b8c_b0d9_980a5e54998a.slice/crio-5a3adf64b05f02a029b8f605716c70e0a370e29a545cb6c3dc367726e58b4709 WatchSource:0}: Error finding container 5a3adf64b05f02a029b8f605716c70e0a370e29a545cb6c3dc367726e58b4709: Status 404 returned error can't find the container with id 5a3adf64b05f02a029b8f605716c70e0a370e29a545cb6c3dc367726e58b4709 May 21 14:38:46.869651 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.869563 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" event={"ID":"5b6274e1-9635-4291-ad41-32587068ca02","Type":"ContainerStarted","Data":"474b0e71a5fa36e5758eb50499af426719369d2434a4a5cc1cdbf8efab7e8cef"} May 21 14:38:46.870823 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.870748 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" event={"ID":"081ab0d7-19d3-4cfb-ac18-cd5ca93c8b5c","Type":"ContainerStarted","Data":"e32f655996768052031622d15f2da405a81f849d4049c62725b5f4e388b29836"} May 21 14:38:46.871981 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.871960 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" event={"ID":"335ea2a0-a7a0-4814-b032-461ed3fed85d","Type":"ContainerStarted","Data":"4a30ed31b95ca9179f0705c816ed879b5f8ef04fe249ef56caa823259a3b446a"} May 21 14:38:46.872794 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.872775 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjv2b" event={"ID":"e15a5dca-468f-4b8c-b0d9-980a5e54998a","Type":"ContainerStarted","Data":"5a3adf64b05f02a029b8f605716c70e0a370e29a545cb6c3dc367726e58b4709"} May 21 14:38:46.874414 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.873908 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" event={"ID":"741d0260-3430-4a33-b9ea-1f29891abafb","Type":"ContainerStarted","Data":"bdc31dedc07229a27d7d7ec3657c29afbe081b87d853a765d7173f5112cee615"} May 21 14:38:46.874414 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.874373 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:46.876123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.875963 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/0.log" May 21 14:38:46.876123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.875997 2572 generic.go:358] "Generic (PLEG): container finished" podID="bfabbbdb-f7d2-4907-aebf-228c094a214f" containerID="f8226e008db7658d7e27412721e6cf75aef108bf012d3397b8f258ec75452290" exitCode=255 May 21 14:38:46.876123 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.876058 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" event={"ID":"bfabbbdb-f7d2-4907-aebf-228c094a214f","Type":"ContainerDied","Data":"f8226e008db7658d7e27412721e6cf75aef108bf012d3397b8f258ec75452290"} May 21 14:38:46.876340 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.876128 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" May 21 14:38:46.876340 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.876338 2572 scope.go:117] "RemoveContainer" containerID="f8226e008db7658d7e27412721e6cf75aef108bf012d3397b8f258ec75452290" May 21 14:38:46.877558 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.877537 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" event={"ID":"20718e91-7ead-4bed-80e0-4f12b7883b7a","Type":"ContainerStarted","Data":"a6205a5ebf4c839a3bb9508885ec599aefc49a95eae692e8bc381975bafea30e"} May 21 14:38:46.879807 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.879788 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" event={"ID":"977808ec-b508-4551-abe3-3e131dd869ac","Type":"ContainerStarted","Data":"7d58202c72ca9b30859d9c534f08a0626cfd0cc695eec206dfbd3edcb6033f64"} May 21 14:38:46.885628 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.885588 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-cktgt" podStartSLOduration=19.050562365 podStartE2EDuration="29.885577277s" podCreationTimestamp="2026-05-21 14:38:17 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.683579517 +0000 UTC m=+35.659922976" lastFinishedPulling="2026-05-21 14:38:46.518594422 +0000 UTC m=+46.494937888" observedRunningTime="2026-05-21 14:38:46.884551235 +0000 UTC m=+46.860894714" watchObservedRunningTime="2026-05-21 14:38:46.885577277 +0000 UTC m=+46.861920757" May 21 14:38:46.898518 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.898480 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" podStartSLOduration=34.923428887 podStartE2EDuration="45.898469227s" podCreationTimestamp="2026-05-21 14:38:01 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.547151001 +0000 UTC m=+35.523494474" lastFinishedPulling="2026-05-21 14:38:46.522191344 +0000 UTC m=+46.498534814" observedRunningTime="2026-05-21 14:38:46.897435076 +0000 UTC m=+46.873778557" watchObservedRunningTime="2026-05-21 14:38:46.898469227 +0000 UTC m=+46.874812707" May 21 14:38:46.913220 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.913168 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-tzwbj" podStartSLOduration=34.941656611 podStartE2EDuration="45.91315483s" podCreationTimestamp="2026-05-21 14:38:01 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.547062804 +0000 UTC m=+35.523406280" lastFinishedPulling="2026-05-21 14:38:46.518561025 +0000 UTC m=+46.494904499" observedRunningTime="2026-05-21 14:38:46.912636891 +0000 UTC m=+46.888980373" watchObservedRunningTime="2026-05-21 14:38:46.91315483 +0000 UTC m=+46.889498306" May 21 14:38:46.947410 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.947365 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64b4fcc589-47tdd" podStartSLOduration=16.11105653 podStartE2EDuration="26.947347836s" podCreationTimestamp="2026-05-21 14:38:20 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.684237141 +0000 UTC m=+35.660580599" lastFinishedPulling="2026-05-21 14:38:46.520528434 +0000 UTC m=+46.496871905" observedRunningTime="2026-05-21 14:38:46.928945268 +0000 UTC m=+46.905288750" watchObservedRunningTime="2026-05-21 14:38:46.947347836 +0000 UTC m=+46.923691318" May 21 14:38:46.962864 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:46.962814 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" podStartSLOduration=34.999724203 podStartE2EDuration="45.962796455s" podCreationTimestamp="2026-05-21 14:38:01 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.555544336 +0000 UTC m=+35.531887799" lastFinishedPulling="2026-05-21 14:38:46.518616578 +0000 UTC m=+46.494960051" observedRunningTime="2026-05-21 14:38:46.961924756 +0000 UTC m=+46.938268238" watchObservedRunningTime="2026-05-21 14:38:46.962796455 +0000 UTC m=+46.939139938" May 21 14:38:47.885659 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:47.885619 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:38:47.886419 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:47.886392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/0.log" May 21 14:38:47.886532 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:47.886445 2572 generic.go:358] "Generic (PLEG): container finished" podID="bfabbbdb-f7d2-4907-aebf-228c094a214f" containerID="8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906" exitCode=255 May 21 14:38:47.886586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:47.886566 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" event={"ID":"bfabbbdb-f7d2-4907-aebf-228c094a214f","Type":"ContainerDied","Data":"8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906"} May 21 14:38:47.886636 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:47.886602 2572 scope.go:117] "RemoveContainer" containerID="f8226e008db7658d7e27412721e6cf75aef108bf012d3397b8f258ec75452290" May 21 14:38:47.886878 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:47.886829 2572 scope.go:117] "RemoveContainer" containerID="8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906" May 21 14:38:47.888628 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:47.887073 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rqlt4_openshift-console-operator(bfabbbdb-f7d2-4907-aebf-228c094a214f)\"" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" podUID="bfabbbdb-f7d2-4907-aebf-228c094a214f" May 21 14:38:48.891392 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:48.891362 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:38:48.891935 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:48.891917 2572 scope.go:117] "RemoveContainer" containerID="8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906" May 21 14:38:48.892127 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:48.892106 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rqlt4_openshift-console-operator(bfabbbdb-f7d2-4907-aebf-228c094a214f)\"" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" podUID="bfabbbdb-f7d2-4907-aebf-228c094a214f" May 21 14:38:50.878345 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:50.878309 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:50.878395 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:50.878441 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878476 2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878502 2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df44b68dd-qzx8h: secret "image-registry-tls" not found May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878545 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878568 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878571 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls podName:6c188d9c-2b57-4122-97dd-ebb743aa6c7a nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.878552576 +0000 UTC m=+66.854896040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls") pod "image-registry-7df44b68dd-qzx8h" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a") : secret "image-registry-tls" not found May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878639 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert podName:340fcef8-b371-4749-b30c-8d588a4a6403 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.878620763 +0000 UTC m=+66.854964226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-blsvd" (UID: "340fcef8-b371-4749-b30c-8d588a4a6403") : secret "networking-console-plugin-cert" not found May 21 14:38:50.878837 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.878656 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls podName:e0146795-82a0-4a59-a5a3-43ef797c0edd nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.878645468 +0000 UTC m=+66.854988929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls") pod "cluster-samples-operator-697587599-qc7z2" (UID: "e0146795-82a0-4a59-a5a3-43ef797c0edd") : secret "samples-operator-tls" not found May 21 14:38:50.979262 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:50.979220 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:38:50.979467 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:50.979291 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:38:50.979467 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.979408 2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:38:50.979569 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.979485 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert podName:3aa6d295-1eab-4aaf-9496-06b72212e484 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.979464828 +0000 UTC m=+66.955808308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert") pod "ingress-canary-cjn7j" (UID: "3aa6d295-1eab-4aaf-9496-06b72212e484") : secret "canary-serving-cert" not found May 21 14:38:50.979569 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.979416 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:38:50.979569 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:50.979558 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls podName:9e62a23a-6e74-4181-a37b-7404a0095596 nodeName:}" failed. No retries permitted until 2026-05-21 14:39:06.979541501 +0000 UTC m=+66.955884962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls") pod "dns-default-c2fdl" (UID: "9e62a23a-6e74-4181-a37b-7404a0095596") : secret "dns-default-metrics-tls" not found May 21 14:38:51.902820 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:51.902778 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" event={"ID":"5b6274e1-9635-4291-ad41-32587068ca02","Type":"ContainerStarted","Data":"006b4c9864cffb63889090dbff83490561695cefe0c71ec3091990edbcb5c7a7"} May 21 14:38:51.903275 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:51.902828 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" event={"ID":"5b6274e1-9635-4291-ad41-32587068ca02","Type":"ContainerStarted","Data":"0e6250ec9214c9a642e856f464fad2834e5a533db8d04cbd567788360a66a31e"} May 21 14:38:51.922652 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:51.922567 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" podStartSLOduration=16.179390990999998 podStartE2EDuration="31.922550301s" podCreationTimestamp="2026-05-21 14:38:20 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.682582903 +0000 UTC m=+35.658926361" lastFinishedPulling="2026-05-21 14:38:51.425742198 +0000 UTC m=+51.402085671" observedRunningTime="2026-05-21 14:38:51.921564911 +0000 UTC m=+51.897908391" watchObservedRunningTime="2026-05-21 14:38:51.922550301 +0000 UTC m=+51.898893815" May 21 14:38:52.907392 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:52.907348 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjv2b" event={"ID":"e15a5dca-468f-4b8c-b0d9-980a5e54998a","Type":"ContainerStarted","Data":"496cee2ff79556c19accf3fde5c8c3fca9d3ee7560c689a6c432aa51827f02ff"} May 21 14:38:52.922611 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:52.922554 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hjv2b" podStartSLOduration=37.805810543 podStartE2EDuration="42.922534942s" podCreationTimestamp="2026-05-21 14:38:10 +0000 UTC" firstStartedPulling="2026-05-21 14:38:46.649078694 +0000 UTC m=+46.625422153" lastFinishedPulling="2026-05-21 14:38:51.76580308 +0000 UTC m=+51.742146552" observedRunningTime="2026-05-21 14:38:52.922148047 +0000 UTC m=+52.898491542" watchObservedRunningTime="2026-05-21 14:38:52.922534942 +0000 UTC m=+52.898878424" May 21 14:38:53.910609 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:53.910573 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" event={"ID":"7308e29d-7eea-4f0e-8981-d62052fb459f","Type":"ContainerStarted","Data":"716537ad3025b4811085006037711b422e7d1ffc2c2ccd5aa3ff8409cdcf79f0"} May 21 14:38:53.926025 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:53.925971 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f8dffb6d8-nzhn6" podStartSLOduration=16.204546006 podStartE2EDuration="33.925956952s" podCreationTimestamp="2026-05-21 14:38:20 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.682600347 +0000 UTC m=+35.658943805" lastFinishedPulling="2026-05-21 14:38:53.404011292 +0000 UTC m=+53.380354751" observedRunningTime="2026-05-21 14:38:53.925957821 +0000 UTC m=+53.902301302" watchObservedRunningTime="2026-05-21 14:38:53.925956952 +0000 UTC m=+53.902300432" May 21 14:38:55.251605 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:55.251564 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:55.251605 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:55.251612 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:38:55.252051 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:55.251992 2572 scope.go:117] "RemoveContainer" containerID="8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906" May 21 14:38:55.252182 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:55.252162 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rqlt4_openshift-console-operator(bfabbbdb-f7d2-4907-aebf-228c094a214f)\"" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" podUID="bfabbbdb-f7d2-4907-aebf-228c094a214f" May 21 14:38:55.915235 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:55.915197 2572 scope.go:117] "RemoveContainer" containerID="8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906" May 21 14:38:55.915472 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:38:55.915450 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rqlt4_openshift-console-operator(bfabbbdb-f7d2-4907-aebf-228c094a214f)\"" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" podUID="bfabbbdb-f7d2-4907-aebf-228c094a214f" May 21 14:38:59.796861 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:38:59.796830 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64v5f" May 21 14:39:06.319595 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.319562 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:39:06.321849 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.321826 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:39:06.332413 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.332379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d32dc8d-e310-47db-be24-075dad49de57-metrics-certs\") pod \"network-metrics-daemon-2lgcw\" (UID: \"5d32dc8d-e310-47db-be24-075dad49de57\") " pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:39:06.420390 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.420361 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:39:06.422903 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.422876 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bktlr\" (UniqueName: \"kubernetes.io/projected/30a2a08b-17e0-48cf-91e3-bf51b09bb7c1-kube-api-access-bktlr\") pod \"network-check-target-cklkr\" (UID: \"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1\") " pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:39:06.571700 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.571634 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ns24t\"" May 21 14:39:06.576878 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.576858 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pnzxq\"" May 21 14:39:06.580331 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.580314 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lgcw" May 21 14:39:06.586039 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.586016 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:39:06.709673 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.709640 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lgcw"] May 21 14:39:06.712713 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:39:06.712687 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d32dc8d_e310_47db_be24_075dad49de57.slice/crio-5cb9604c89174398a0cea2a59981eaf8ea69d098e1fd2c93fd2587e5a0b9f244 WatchSource:0}: Error finding container 5cb9604c89174398a0cea2a59981eaf8ea69d098e1fd2c93fd2587e5a0b9f244: Status 404 returned error can't find the container with id 5cb9604c89174398a0cea2a59981eaf8ea69d098e1fd2c93fd2587e5a0b9f244 May 21 14:39:06.726041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.726016 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cklkr"] May 21 14:39:06.728934 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:39:06.728913 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a2a08b_17e0_48cf_91e3_bf51b09bb7c1.slice/crio-f17c9307faa19dd8cb555cae454e788c3e8cf74bb586d4cd1b5fda2ddd45c5a5 WatchSource:0}: Error finding container f17c9307faa19dd8cb555cae454e788c3e8cf74bb586d4cd1b5fda2ddd45c5a5: Status 404 returned error can't find the container with id f17c9307faa19dd8cb555cae454e788c3e8cf74bb586d4cd1b5fda2ddd45c5a5 May 21 14:39:06.925808 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.925772 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:39:06.925954 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.925849 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:39:06.925954 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.925895 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:39:06.928117 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.928078 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"image-registry-7df44b68dd-qzx8h\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:39:06.928219 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.928137 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/340fcef8-b371-4749-b30c-8d588a4a6403-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-blsvd\" (UID: \"340fcef8-b371-4749-b30c-8d588a4a6403\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:39:06.928219 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.928152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0146795-82a0-4a59-a5a3-43ef797c0edd-samples-operator-tls\") pod \"cluster-samples-operator-697587599-qc7z2\" (UID: \"e0146795-82a0-4a59-a5a3-43ef797c0edd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:39:06.943835 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.943803 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lgcw" event={"ID":"5d32dc8d-e310-47db-be24-075dad49de57","Type":"ContainerStarted","Data":"5cb9604c89174398a0cea2a59981eaf8ea69d098e1fd2c93fd2587e5a0b9f244"} May 21 14:39:06.945164 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.945143 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cklkr" event={"ID":"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1","Type":"ContainerStarted","Data":"3c8383207ceae9c651cd686c09ed5bf5e155f17531b7a218eab75965e3e04915"} May 21 14:39:06.945246 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.945170 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cklkr" event={"ID":"30a2a08b-17e0-48cf-91e3-bf51b09bb7c1","Type":"ContainerStarted","Data":"f17c9307faa19dd8cb555cae454e788c3e8cf74bb586d4cd1b5fda2ddd45c5a5"} May 21 14:39:06.945292 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.945254 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:39:06.958766 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:06.958715 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cklkr" podStartSLOduration=66.958702238 podStartE2EDuration="1m6.958702238s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:39:06.958310453 +0000 UTC m=+66.934653935" watchObservedRunningTime="2026-05-21 14:39:06.958702238 +0000 UTC m=+66.935045719" May 21 14:39:07.026275 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.026239 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:39:07.026473 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.026285 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:39:07.028645 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.028615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e62a23a-6e74-4181-a37b-7404a0095596-metrics-tls\") pod \"dns-default-c2fdl\" (UID: \"9e62a23a-6e74-4181-a37b-7404a0095596\") " pod="openshift-dns/dns-default-c2fdl" May 21 14:39:07.028828 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.028807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3aa6d295-1eab-4aaf-9496-06b72212e484-cert\") pod \"ingress-canary-cjn7j\" (UID: \"3aa6d295-1eab-4aaf-9496-06b72212e484\") " pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:39:07.069815 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.069777 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rbggp\"" May 21 14:39:07.078054 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.078023 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" May 21 14:39:07.104126 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.104061 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6kdzp\"" May 21 14:39:07.111596 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.111564 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wtfz9\"" May 21 14:39:07.112626 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.112609 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:39:07.120349 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.120325 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" May 21 14:39:07.197312 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.197098 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-86l7j\"" May 21 14:39:07.199174 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.198991 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsm8g\"" May 21 14:39:07.205371 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.204967 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c2fdl" May 21 14:39:07.219175 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.217474 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cjn7j" May 21 14:39:07.239612 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.239074 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2"] May 21 14:39:07.281881 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.280092 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df44b68dd-qzx8h"] May 21 14:39:07.316058 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.316012 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd"] May 21 14:39:07.368476 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.367994 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cjn7j"] May 21 14:39:07.372568 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:39:07.372535 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa6d295_1eab_4aaf_9496_06b72212e484.slice/crio-cdc06e2d5896551f852c733f587f423a4b79543c8dcf70ea9cbed66f9e7d3100 WatchSource:0}: Error finding container cdc06e2d5896551f852c733f587f423a4b79543c8dcf70ea9cbed66f9e7d3100: Status 404 returned error can't find the container with id cdc06e2d5896551f852c733f587f423a4b79543c8dcf70ea9cbed66f9e7d3100 May 21 14:39:07.388830 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.388788 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c2fdl"] May 21 14:39:07.394347 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:39:07.394318 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e62a23a_6e74_4181_a37b_7404a0095596.slice/crio-5dba2ca160d95c91f246db8e1c414cca3d048cdf1989ededcb92d1649f8435bd WatchSource:0}: Error finding container 5dba2ca160d95c91f246db8e1c414cca3d048cdf1989ededcb92d1649f8435bd: Status 404 returned error can't find the container with id 5dba2ca160d95c91f246db8e1c414cca3d048cdf1989ededcb92d1649f8435bd May 21 14:39:07.660060 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.660032 2572 scope.go:117] "RemoveContainer" containerID="8f30aa72ec680f53150cfb52026e94b3007cf72960d7f23d36d500fa1f916906" May 21 14:39:07.951956 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.951890 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:39:07.952081 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.951983 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" event={"ID":"bfabbbdb-f7d2-4907-aebf-228c094a214f","Type":"ContainerStarted","Data":"f334b75f5496bd9ed739583a9ba4a5dacad9fe76d6d7b27011de56f512a79ff4"} May 21 14:39:07.952520 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.952450 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:39:07.953993 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.953969 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjn7j" event={"ID":"3aa6d295-1eab-4aaf-9496-06b72212e484","Type":"ContainerStarted","Data":"cdc06e2d5896551f852c733f587f423a4b79543c8dcf70ea9cbed66f9e7d3100"} May 21 14:39:07.955393 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.955304 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c2fdl" event={"ID":"9e62a23a-6e74-4181-a37b-7404a0095596","Type":"ContainerStarted","Data":"5dba2ca160d95c91f246db8e1c414cca3d048cdf1989ededcb92d1649f8435bd"} May 21 14:39:07.956563 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.956540 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" event={"ID":"340fcef8-b371-4749-b30c-8d588a4a6403","Type":"ContainerStarted","Data":"3a9902978fe55d06821771633a30bfc8110a3e92d62bc5168791850b99a05db1"} May 21 14:39:07.958152 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.958117 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" event={"ID":"6c188d9c-2b57-4122-97dd-ebb743aa6c7a","Type":"ContainerStarted","Data":"dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7"} May 21 14:39:07.958152 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.958149 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" event={"ID":"6c188d9c-2b57-4122-97dd-ebb743aa6c7a","Type":"ContainerStarted","Data":"3fbf3ba023f7a4ba6165a2a08afb2c73ccb10be08f8597a5b9793defc108fd3c"} May 21 14:39:07.958310 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.958258 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:39:07.959453 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.959431 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" event={"ID":"e0146795-82a0-4a59-a5a3-43ef797c0edd","Type":"ContainerStarted","Data":"a5a8bb9d3c14a558c586cbc3b56a0d0f1ee436e417edbadc84fd9397a1662f3a"} May 21 14:39:07.969126 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.969080 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" podStartSLOduration=56.00471105 podStartE2EDuration="1m6.969068668s" podCreationTimestamp="2026-05-21 14:38:01 +0000 UTC" firstStartedPulling="2026-05-21 14:38:35.554231236 +0000 UTC m=+35.530574708" lastFinishedPulling="2026-05-21 14:38:46.518588867 +0000 UTC m=+46.494932326" observedRunningTime="2026-05-21 14:39:07.967587693 +0000 UTC m=+67.943931194" watchObservedRunningTime="2026-05-21 14:39:07.969068668 +0000 UTC m=+67.945412142" May 21 14:39:07.986166 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:07.986111 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" podStartSLOduration=54.986093996 podStartE2EDuration="54.986093996s" podCreationTimestamp="2026-05-21 14:38:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:39:07.984833619 +0000 UTC m=+67.961177122" watchObservedRunningTime="2026-05-21 14:39:07.986093996 +0000 UTC m=+67.962437478" May 21 14:39:08.841448 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:08.841410 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-rqlt4" May 21 14:39:11.973980 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.973880 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lgcw" event={"ID":"5d32dc8d-e310-47db-be24-075dad49de57","Type":"ContainerStarted","Data":"fca3e7a5c2fb2b1d75daa5fe9c39f800e49f37334d72465d8c43972d4d2dabd8"} May 21 14:39:11.973980 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.973930 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lgcw" event={"ID":"5d32dc8d-e310-47db-be24-075dad49de57","Type":"ContainerStarted","Data":"c5ef4650444cfb22b656f13922ca1936c3619ba65c6bf13dcb70fa2570e4d368"} May 21 14:39:11.975135 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.975108 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cjn7j" event={"ID":"3aa6d295-1eab-4aaf-9496-06b72212e484","Type":"ContainerStarted","Data":"bd9cc29b06d9403152d2ecebc45f8a8cf697f6b6e49bcda1cd77cf507476aa14"} May 21 14:39:11.976676 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.976645 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c2fdl" event={"ID":"9e62a23a-6e74-4181-a37b-7404a0095596","Type":"ContainerStarted","Data":"fe0f95383bc834f0f95bf8cb5cbde359d4d3b0c788410ce0084cfa534688c315"} May 21 14:39:11.976823 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.976681 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c2fdl" event={"ID":"9e62a23a-6e74-4181-a37b-7404a0095596","Type":"ContainerStarted","Data":"1b3672a9d43dd39c954b6ed32113fce4c0db6807e0565132708e50cc92c05c6d"} May 21 14:39:11.976823 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.976724 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c2fdl" May 21 14:39:11.977913 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.977890 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" event={"ID":"340fcef8-b371-4749-b30c-8d588a4a6403","Type":"ContainerStarted","Data":"fd0dced685cd9b5abbbbdeadcde9ef0d2adf232e540e3c7962e5de3892017e2d"} May 21 14:39:11.979309 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.979284 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" event={"ID":"e0146795-82a0-4a59-a5a3-43ef797c0edd","Type":"ContainerStarted","Data":"ab7ebbf2c2cee948b3ee238599fbf04e914ad59c1a91acf59783bd8aa5120d9c"} May 21 14:39:11.979406 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.979315 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" event={"ID":"e0146795-82a0-4a59-a5a3-43ef797c0edd","Type":"ContainerStarted","Data":"11480fe76f7631060084d493e06feed3e958ce0898b44caeb34d6b8861a55b38"} May 21 14:39:11.989261 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:11.989218 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2lgcw" podStartSLOduration=67.524566825 podStartE2EDuration="1m11.989206388s" podCreationTimestamp="2026-05-21 14:38:00 +0000 UTC" firstStartedPulling="2026-05-21 14:39:06.71466771 +0000 UTC m=+66.691011170" lastFinishedPulling="2026-05-21 14:39:11.17930726 +0000 UTC m=+71.155650733" observedRunningTime="2026-05-21 14:39:11.988192985 +0000 UTC m=+71.964536467" watchObservedRunningTime="2026-05-21 14:39:11.989206388 +0000 UTC m=+71.965549902" May 21 14:39:12.003251 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:12.003208 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-c2fdl" podStartSLOduration=33.946726484 podStartE2EDuration="38.00317821s" podCreationTimestamp="2026-05-21 14:38:34 +0000 UTC" firstStartedPulling="2026-05-21 14:39:07.39667285 +0000 UTC m=+67.373016324" lastFinishedPulling="2026-05-21 14:39:11.453124591 +0000 UTC m=+71.429468050" observedRunningTime="2026-05-21 14:39:12.0022232 +0000 UTC m=+71.978566681" watchObservedRunningTime="2026-05-21 14:39:12.00317821 +0000 UTC m=+71.979521694" May 21 14:39:12.015703 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:12.015653 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cjn7j" podStartSLOduration=34.211552575 podStartE2EDuration="38.015639845s" podCreationTimestamp="2026-05-21 14:38:34 +0000 UTC" firstStartedPulling="2026-05-21 14:39:07.3763094 +0000 UTC m=+67.352652867" lastFinishedPulling="2026-05-21 14:39:11.180396667 +0000 UTC m=+71.156740137" observedRunningTime="2026-05-21 14:39:12.015192654 +0000 UTC m=+71.991536135" watchObservedRunningTime="2026-05-21 14:39:12.015639845 +0000 UTC m=+71.991983327" May 21 14:39:12.028787 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:12.028723 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-blsvd" podStartSLOduration=41.17195833 podStartE2EDuration="45.028710035s" podCreationTimestamp="2026-05-21 14:38:27 +0000 UTC" firstStartedPulling="2026-05-21 14:39:07.323911298 +0000 UTC m=+67.300254763" lastFinishedPulling="2026-05-21 14:39:11.180662999 +0000 UTC m=+71.157006468" observedRunningTime="2026-05-21 14:39:12.028168599 +0000 UTC m=+72.004512080" watchObservedRunningTime="2026-05-21 14:39:12.028710035 +0000 UTC m=+72.005053542" May 21 14:39:12.043650 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:12.043611 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-qc7z2" podStartSLOduration=67.170830896 podStartE2EDuration="1m11.043599421s" podCreationTimestamp="2026-05-21 14:38:01 +0000 UTC" firstStartedPulling="2026-05-21 14:39:07.308026888 +0000 UTC m=+67.284370360" lastFinishedPulling="2026-05-21 14:39:11.180795423 +0000 UTC m=+71.157138885" observedRunningTime="2026-05-21 14:39:12.042086885 +0000 UTC m=+72.018430368" watchObservedRunningTime="2026-05-21 14:39:12.043599421 +0000 UTC m=+72.019942911" May 21 14:39:21.985160 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:21.985032 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c2fdl" May 21 14:39:22.460941 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:22.460905 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c2fdl_9e62a23a-6e74-4181-a37b-7404a0095596/dns/0.log" May 21 14:39:22.646009 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:22.645977 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c2fdl_9e62a23a-6e74-4181-a37b-7404a0095596/kube-rbac-proxy/0.log" May 21 14:39:23.245563 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:23.245536 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hrr5_ee53d69f-8bed-4661-a837-fca3fd43ab2d/dns-node-resolver/0.log" May 21 14:39:24.046000 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:24.045971 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df44b68dd-qzx8h_6c188d9c-2b57-4122-97dd-ebb743aa6c7a/registry/0.log" May 21 14:39:24.646080 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:24.646050 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9st7g_a4d0dfb2-f250-44a9-9615-4073f948685c/node-ca/0.log" May 21 14:39:25.045368 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:25.045287 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjn7j_3aa6d295-1eab-4aaf-9496-06b72212e484/serve-healthcheck-canary/0.log" May 21 14:39:27.116895 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:27.116859 2572 patch_prober.go:28] interesting pod/image-registry-7df44b68dd-qzx8h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 14:39:27.117365 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:27.116914 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" podUID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 14:39:28.587851 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.587821 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ngj95"] May 21 14:39:28.594429 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.594404 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.596534 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.596504 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:39:28.597272 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.597255 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:39:28.597373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.597255 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:39:28.597373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.597288 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:39:28.597373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.597255 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:39:28.597373 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.597322 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:39:28.597594 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.597256 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-88tch\"" May 21 14:39:28.676997 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.676964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2682372-3bbe-457a-90ee-3d185893f1aa-metrics-client-ca\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.676997 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.676995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f29b\" (UniqueName: \"kubernetes.io/projected/f2682372-3bbe-457a-90ee-3d185893f1aa-kube-api-access-5f29b\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677202 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-tls\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677202 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677202 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-root\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677202 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-sys\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677389 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677214 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677389 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-textfile\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.677389 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.677262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-wtmp\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778518 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778480 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-tls\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778533 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778554 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-root\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778580 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-sys\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778603 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778624 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-textfile\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778644 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-wtmp\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778663 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-root\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778671 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2682372-3bbe-457a-90ee-3d185893f1aa-metrics-client-ca\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.778704 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778690 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-sys\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.779176 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778714 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5f29b\" (UniqueName: \"kubernetes.io/projected/f2682372-3bbe-457a-90ee-3d185893f1aa-kube-api-access-5f29b\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.779176 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.778845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-wtmp\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.779176 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.779130 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-textfile\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.779325 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.779285 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2682372-3bbe-457a-90ee-3d185893f1aa-metrics-client-ca\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.779377 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.779364 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.780943 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.780916 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.781038 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.781021 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2682372-3bbe-457a-90ee-3d185893f1aa-node-exporter-tls\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.785440 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.785420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f29b\" (UniqueName: \"kubernetes.io/projected/f2682372-3bbe-457a-90ee-3d185893f1aa-kube-api-access-5f29b\") pod \"node-exporter-ngj95\" (UID: \"f2682372-3bbe-457a-90ee-3d185893f1aa\") " pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.904625 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.904591 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ngj95" May 21 14:39:28.913210 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:39:28.913177 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2682372_3bbe_457a_90ee_3d185893f1aa.slice/crio-ee772ab9b8f4ef33f7a578ce98a2cb69476fd45e7328eb0c54eb5058c4fd0b38 WatchSource:0}: Error finding container ee772ab9b8f4ef33f7a578ce98a2cb69476fd45e7328eb0c54eb5058c4fd0b38: Status 404 returned error can't find the container with id ee772ab9b8f4ef33f7a578ce98a2cb69476fd45e7328eb0c54eb5058c4fd0b38 May 21 14:39:28.967028 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:28.967007 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:39:29.032315 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:29.032282 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngj95" event={"ID":"f2682372-3bbe-457a-90ee-3d185893f1aa","Type":"ContainerStarted","Data":"ee772ab9b8f4ef33f7a578ce98a2cb69476fd45e7328eb0c54eb5058c4fd0b38"} May 21 14:39:30.038560 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:30.038527 2572 generic.go:358] "Generic (PLEG): container finished" podID="f2682372-3bbe-457a-90ee-3d185893f1aa" containerID="eed4bb37e0c63edda6bcda90612f0e3b0f68bad7bdabc6df03064b03b5f055e7" exitCode=0 May 21 14:39:30.038928 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:30.038587 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngj95" event={"ID":"f2682372-3bbe-457a-90ee-3d185893f1aa","Type":"ContainerDied","Data":"eed4bb37e0c63edda6bcda90612f0e3b0f68bad7bdabc6df03064b03b5f055e7"} May 21 14:39:31.043314 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:31.043276 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngj95" event={"ID":"f2682372-3bbe-457a-90ee-3d185893f1aa","Type":"ContainerStarted","Data":"b2c6f1c5b96fd2f8c699a08d186ac5fcce91ad80e0cf88a528cf4592cb5919a7"} May 21 14:39:31.043314 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:31.043321 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ngj95" event={"ID":"f2682372-3bbe-457a-90ee-3d185893f1aa","Type":"ContainerStarted","Data":"b9b2576dc50e3e6e77ab096c137c8537db13e9017c2a5989060d8ad6fab25abc"} May 21 14:39:31.062217 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:31.062176 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ngj95" podStartSLOduration=2.095535793 podStartE2EDuration="3.062164696s" podCreationTimestamp="2026-05-21 14:39:28 +0000 UTC" firstStartedPulling="2026-05-21 14:39:28.914835995 +0000 UTC m=+88.891179457" lastFinishedPulling="2026-05-21 14:39:29.881464901 +0000 UTC m=+89.857808360" observedRunningTime="2026-05-21 14:39:31.060999406 +0000 UTC m=+91.037342887" watchObservedRunningTime="2026-05-21 14:39:31.062164696 +0000 UTC m=+91.038508176" May 21 14:39:32.451307 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.451265 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mndnd"] May 21 14:39:32.454997 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.454974 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.457329 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.457304 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:39:32.457572 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.457551 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-klsxf\"" May 21 14:39:32.457660 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.457571 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:39:32.457870 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.457853 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:39:32.457919 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.457856 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:39:32.461513 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.461492 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mndnd"] May 21 14:39:32.507661 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.507627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b488757b-8675-404c-83a2-9f9f2af0e079-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.507829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.507671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b488757b-8675-404c-83a2-9f9f2af0e079-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.507829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.507693 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7n67\" (UniqueName: \"kubernetes.io/projected/b488757b-8675-404c-83a2-9f9f2af0e079-kube-api-access-b7n67\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.507829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.507783 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b488757b-8675-404c-83a2-9f9f2af0e079-crio-socket\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.507829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.507822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b488757b-8675-404c-83a2-9f9f2af0e079-data-volume\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.608932 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.608888 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b488757b-8675-404c-83a2-9f9f2af0e079-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.608932 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.608943 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b488757b-8675-404c-83a2-9f9f2af0e079-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.608932 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.608965 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7n67\" (UniqueName: \"kubernetes.io/projected/b488757b-8675-404c-83a2-9f9f2af0e079-kube-api-access-b7n67\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.609232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.608989 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b488757b-8675-404c-83a2-9f9f2af0e079-crio-socket\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.609232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.609029 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b488757b-8675-404c-83a2-9f9f2af0e079-data-volume\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.609232 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.609169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b488757b-8675-404c-83a2-9f9f2af0e079-crio-socket\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.609376 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.609366 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b488757b-8675-404c-83a2-9f9f2af0e079-data-volume\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.609559 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.609537 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b488757b-8675-404c-83a2-9f9f2af0e079-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.611345 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.611326 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b488757b-8675-404c-83a2-9f9f2af0e079-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.615846 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.615817 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7n67\" (UniqueName: \"kubernetes.io/projected/b488757b-8675-404c-83a2-9f9f2af0e079-kube-api-access-b7n67\") pod \"insights-runtime-extractor-mndnd\" (UID: \"b488757b-8675-404c-83a2-9f9f2af0e079\") " pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.765741 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.765646 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mndnd" May 21 14:39:32.893193 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:32.893035 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mndnd"] May 21 14:39:32.895916 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:39:32.895880 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb488757b_8675_404c_83a2_9f9f2af0e079.slice/crio-9876d11a8f0974439d24009937a7a30bb344d4a4cedb9a43d6d4b3fc537165c6 WatchSource:0}: Error finding container 9876d11a8f0974439d24009937a7a30bb344d4a4cedb9a43d6d4b3fc537165c6: Status 404 returned error can't find the container with id 9876d11a8f0974439d24009937a7a30bb344d4a4cedb9a43d6d4b3fc537165c6 May 21 14:39:33.049783 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:33.049674 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mndnd" event={"ID":"b488757b-8675-404c-83a2-9f9f2af0e079","Type":"ContainerStarted","Data":"acf49d43f91c254d4870cf19e0d7018dba50d1c90726c042333471bf44377164"} May 21 14:39:33.049783 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:33.049714 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mndnd" event={"ID":"b488757b-8675-404c-83a2-9f9f2af0e079","Type":"ContainerStarted","Data":"9876d11a8f0974439d24009937a7a30bb344d4a4cedb9a43d6d4b3fc537165c6"} May 21 14:39:34.053707 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:34.053621 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mndnd" event={"ID":"b488757b-8675-404c-83a2-9f9f2af0e079","Type":"ContainerStarted","Data":"8ddf88b7b9f0814ed6338a8d61e1a46e20592e289cbcfde0766b4145724686ce"} May 21 14:39:35.429261 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:35.429228 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df44b68dd-qzx8h"] May 21 14:39:36.060916 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:36.060880 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mndnd" event={"ID":"b488757b-8675-404c-83a2-9f9f2af0e079","Type":"ContainerStarted","Data":"e2ca47c3b2d360baf4987fb3d18ce8026113aba587d1009d8a56555cc5c11c32"} May 21 14:39:36.077846 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:36.077792 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mndnd" podStartSLOduration=1.589218083 podStartE2EDuration="4.077775867s" podCreationTimestamp="2026-05-21 14:39:32 +0000 UTC" firstStartedPulling="2026-05-21 14:39:32.955438314 +0000 UTC m=+92.931781786" lastFinishedPulling="2026-05-21 14:39:35.443996102 +0000 UTC m=+95.420339570" observedRunningTime="2026-05-21 14:39:36.077090005 +0000 UTC m=+96.053433486" watchObservedRunningTime="2026-05-21 14:39:36.077775867 +0000 UTC m=+96.054119347" May 21 14:39:37.962586 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:37.962559 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cklkr" May 21 14:39:57.122070 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:57.122037 2572 generic.go:358] "Generic (PLEG): container finished" podID="20718e91-7ead-4bed-80e0-4f12b7883b7a" containerID="a6205a5ebf4c839a3bb9508885ec599aefc49a95eae692e8bc381975bafea30e" exitCode=0 May 21 14:39:57.122587 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:57.122109 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" event={"ID":"20718e91-7ead-4bed-80e0-4f12b7883b7a","Type":"ContainerDied","Data":"a6205a5ebf4c839a3bb9508885ec599aefc49a95eae692e8bc381975bafea30e"} May 21 14:39:57.122587 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:57.122506 2572 scope.go:117] "RemoveContainer" containerID="a6205a5ebf4c839a3bb9508885ec599aefc49a95eae692e8bc381975bafea30e" May 21 14:39:58.126827 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:39:58.126790 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9btvb" event={"ID":"20718e91-7ead-4bed-80e0-4f12b7883b7a","Type":"ContainerStarted","Data":"705d61f80cd6fa9489320ff34e35ed0790af41a8b4b677145fd8abc630420595"} May 21 14:40:00.448523 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.448457 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" podUID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" containerName="registry" containerID="cri-o://dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7" gracePeriod=30 May 21 14:40:00.691830 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.691807 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:40:00.844102 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844012 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-ca-trust-extracted\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844102 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844052 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-installation-pull-secrets\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844102 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844080 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-bound-sa-token\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844378 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844130 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-certificates\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844378 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844159 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8mjq\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-kube-api-access-x8mjq\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844378 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844189 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844378 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844213 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-image-registry-private-configuration\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.844647 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844625 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-trusted-ca\") pod \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\" (UID: \"6c188d9c-2b57-4122-97dd-ebb743aa6c7a\") " May 21 14:40:00.845139 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.844626 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:40:00.845293 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.845123 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:40:00.846889 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.846848 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:40:00.846889 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.846861 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:40:00.847023 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.846940 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 14:40:00.847023 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.846975 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:40:00.847142 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.847124 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-kube-api-access-x8mjq" (OuterVolumeSpecName: "kube-api-access-x8mjq") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "kube-api-access-x8mjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:40:00.852127 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.852103 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6c188d9c-2b57-4122-97dd-ebb743aa6c7a" (UID: "6c188d9c-2b57-4122-97dd-ebb743aa6c7a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:40:00.946008 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.945974 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-ca-trust-extracted\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946008 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946003 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-installation-pull-secrets\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946008 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946013 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-bound-sa-token\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946235 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946023 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-certificates\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946235 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946032 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8mjq\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-kube-api-access-x8mjq\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946235 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946043 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-registry-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946235 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946052 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-image-registry-private-configuration\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:00.946235 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:00.946061 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c188d9c-2b57-4122-97dd-ebb743aa6c7a-trusted-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:40:01.137605 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.137576 2572 generic.go:358] "Generic (PLEG): container finished" podID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" containerID="dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7" exitCode=0 May 21 14:40:01.137803 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.137639 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" May 21 14:40:01.137803 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.137657 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" event={"ID":"6c188d9c-2b57-4122-97dd-ebb743aa6c7a","Type":"ContainerDied","Data":"dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7"} May 21 14:40:01.137803 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.137693 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df44b68dd-qzx8h" event={"ID":"6c188d9c-2b57-4122-97dd-ebb743aa6c7a","Type":"ContainerDied","Data":"3fbf3ba023f7a4ba6165a2a08afb2c73ccb10be08f8597a5b9793defc108fd3c"} May 21 14:40:01.137803 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.137708 2572 scope.go:117] "RemoveContainer" containerID="dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7" May 21 14:40:01.152609 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.152584 2572 scope.go:117] "RemoveContainer" containerID="dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7" May 21 14:40:01.152917 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:40:01.152897 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7\": container with ID starting with dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7 not found: ID does not exist" containerID="dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7" May 21 14:40:01.152993 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.152922 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7"} err="failed to get container status \"dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7\": rpc error: code = NotFound desc = could not find container \"dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7\": container with ID starting with dbda15b5c8f939204c0e3815a8c8d5951ba4ae98c309b101466864b3698b3fa7 not found: ID does not exist" May 21 14:40:01.160456 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.160432 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df44b68dd-qzx8h"] May 21 14:40:01.165702 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:01.165680 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df44b68dd-qzx8h"] May 21 14:40:02.663545 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:02.663511 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" path="/var/lib/kubelet/pods/6c188d9c-2b57-4122-97dd-ebb743aa6c7a/volumes" May 21 14:40:03.145194 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:03.145159 2572 generic.go:358] "Generic (PLEG): container finished" podID="977808ec-b508-4551-abe3-3e131dd869ac" containerID="7d58202c72ca9b30859d9c534f08a0626cfd0cc695eec206dfbd3edcb6033f64" exitCode=0 May 21 14:40:03.145361 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:03.145234 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" event={"ID":"977808ec-b508-4551-abe3-3e131dd869ac","Type":"ContainerDied","Data":"7d58202c72ca9b30859d9c534f08a0626cfd0cc695eec206dfbd3edcb6033f64"} May 21 14:40:03.145562 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:03.145548 2572 scope.go:117] "RemoveContainer" containerID="7d58202c72ca9b30859d9c534f08a0626cfd0cc695eec206dfbd3edcb6033f64" May 21 14:40:04.149290 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:04.149257 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-kns25" event={"ID":"977808ec-b508-4551-abe3-3e131dd869ac","Type":"ContainerStarted","Data":"5859c1a0bf163b1f41805ee32fd5682bf69e90a910bb4d0ad00760da01308b15"} May 21 14:40:15.369423 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:15.369382 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" podUID="5b6274e1-9635-4291-ad41-32587068ca02" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 14:40:25.369177 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:25.369138 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" podUID="5b6274e1-9635-4291-ad41-32587068ca02" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 14:40:35.369206 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:35.369168 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" podUID="5b6274e1-9635-4291-ad41-32587068ca02" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 14:40:35.369652 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:35.369231 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" May 21 14:40:35.369745 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:35.369727 2572 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"006b4c9864cffb63889090dbff83490561695cefe0c71ec3091990edbcb5c7a7"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 14:40:35.369804 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:35.369787 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" podUID="5b6274e1-9635-4291-ad41-32587068ca02" containerName="service-proxy" containerID="cri-o://006b4c9864cffb63889090dbff83490561695cefe0c71ec3091990edbcb5c7a7" gracePeriod=30 May 21 14:40:36.236522 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:36.236485 2572 generic.go:358] "Generic (PLEG): container finished" podID="5b6274e1-9635-4291-ad41-32587068ca02" containerID="006b4c9864cffb63889090dbff83490561695cefe0c71ec3091990edbcb5c7a7" exitCode=2 May 21 14:40:36.236692 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:36.236543 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" event={"ID":"5b6274e1-9635-4291-ad41-32587068ca02","Type":"ContainerDied","Data":"006b4c9864cffb63889090dbff83490561695cefe0c71ec3091990edbcb5c7a7"} May 21 14:40:36.236692 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:40:36.236569 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78665757b-sxcrm" event={"ID":"5b6274e1-9635-4291-ad41-32587068ca02","Type":"ContainerStarted","Data":"3a356e8bb9c8500c71265ee54c1c763c4beb4d1f59f11bc63d38b72c0c03b892"} May 21 14:43:00.524168 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.524132 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6"] May 21 14:43:00.524727 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.524489 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" containerName="registry" May 21 14:43:00.524727 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.524503 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" containerName="registry" May 21 14:43:00.524727 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.524588 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c188d9c-2b57-4122-97dd-ebb743aa6c7a" containerName="registry" May 21 14:43:00.527567 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.527548 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.529834 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.529809 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 14:43:00.529957 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.529829 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 14:43:00.529957 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.529854 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 14:43:00.529957 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.529943 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 14:43:00.530145 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.530015 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7l8mj\"" May 21 14:43:00.532010 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.531975 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:43:00.532254 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.532236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:43:00.542101 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.542074 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6"] May 21 14:43:00.551460 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.551439 2572 kubelet.go:1628] "Image garbage collection succeeded" May 21 14:43:00.663963 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.663923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08b714ca-6369-4655-ada0-7212da161163-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.665949 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.664003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5blc\" (UniqueName: \"kubernetes.io/projected/08b714ca-6369-4655-ada0-7212da161163-kube-api-access-n5blc\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.665949 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.664030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08b714ca-6369-4655-ada0-7212da161163-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.764839 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.764799 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08b714ca-6369-4655-ada0-7212da161163-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.765017 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.764890 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5blc\" (UniqueName: \"kubernetes.io/projected/08b714ca-6369-4655-ada0-7212da161163-kube-api-access-n5blc\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.765017 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.764922 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08b714ca-6369-4655-ada0-7212da161163-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.767185 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.767151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08b714ca-6369-4655-ada0-7212da161163-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.767325 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.767302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08b714ca-6369-4655-ada0-7212da161163-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.773139 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.773115 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5blc\" (UniqueName: \"kubernetes.io/projected/08b714ca-6369-4655-ada0-7212da161163-kube-api-access-n5blc\") pod \"opendatahub-operator-controller-manager-64d8b6f58-ht2j6\" (UID: \"08b714ca-6369-4655-ada0-7212da161163\") " pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.842004 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.841910 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:00.970822 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:00.970746 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6"] May 21 14:43:00.974236 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:43:00.974204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b714ca_6369_4655_ada0_7212da161163.slice/crio-f27b3d9656125245946c2c9a1c8e5b9da7f4767603d28564b22f58118ef91989 WatchSource:0}: Error finding container f27b3d9656125245946c2c9a1c8e5b9da7f4767603d28564b22f58118ef91989: Status 404 returned error can't find the container with id f27b3d9656125245946c2c9a1c8e5b9da7f4767603d28564b22f58118ef91989 May 21 14:43:01.622718 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:01.622682 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" event={"ID":"08b714ca-6369-4655-ada0-7212da161163","Type":"ContainerStarted","Data":"f27b3d9656125245946c2c9a1c8e5b9da7f4767603d28564b22f58118ef91989"} May 21 14:43:03.630691 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:03.630660 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" event={"ID":"08b714ca-6369-4655-ada0-7212da161163","Type":"ContainerStarted","Data":"deb043a5e68b6fb617266fde91da66f3234b8d16ab0198ffc2d338a3e2fe5a71"} May 21 14:43:03.631083 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:03.630716 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:03.653608 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:03.653554 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" podStartSLOduration=1.14925308 podStartE2EDuration="3.653539058s" podCreationTimestamp="2026-05-21 14:43:00 +0000 UTC" firstStartedPulling="2026-05-21 14:43:00.975810736 +0000 UTC m=+300.952154196" lastFinishedPulling="2026-05-21 14:43:03.480096698 +0000 UTC m=+303.456440174" observedRunningTime="2026-05-21 14:43:03.652291764 +0000 UTC m=+303.628635246" watchObservedRunningTime="2026-05-21 14:43:03.653539058 +0000 UTC m=+303.629882538" May 21 14:43:14.635387 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:14.635358 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64d8b6f58-ht2j6" May 21 14:43:20.820034 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.819999 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f8585948-vbf6m"] May 21 14:43:20.826348 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.826328 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:20.828680 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.828657 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:43:20.828808 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.828659 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 14:43:20.829265 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.829243 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:43:20.829382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.829298 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 14:43:20.829382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.829246 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x4l7j\"" May 21 14:43:20.832448 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.832427 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f8585948-vbf6m"] May 21 14:43:20.918014 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.917962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-tls-certs\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:20.918202 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.918036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk9th\" (UniqueName: \"kubernetes.io/projected/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-kube-api-access-jk9th\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:20.918202 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:20.918066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-tmp\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.019346 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.019309 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jk9th\" (UniqueName: \"kubernetes.io/projected/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-kube-api-access-jk9th\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.019346 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.019351 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-tmp\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.019544 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.019411 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-tls-certs\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.021782 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.021735 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-tmp\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.021923 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.021914 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-tls-certs\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.026216 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.026192 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk9th\" (UniqueName: \"kubernetes.io/projected/54130316-4340-4aaa-b0d0-fa8e2cbe76ba-kube-api-access-jk9th\") pod \"kube-auth-proxy-f8585948-vbf6m\" (UID: \"54130316-4340-4aaa-b0d0-fa8e2cbe76ba\") " pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.136093 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.136064 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" May 21 14:43:21.258255 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.258229 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f8585948-vbf6m"] May 21 14:43:21.261474 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:43:21.261444 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54130316_4340_4aaa_b0d0_fa8e2cbe76ba.slice/crio-46f93343f7b384ead5f1b2457ba5d36622560c0fb59b914514822a0b78e8421c WatchSource:0}: Error finding container 46f93343f7b384ead5f1b2457ba5d36622560c0fb59b914514822a0b78e8421c: Status 404 returned error can't find the container with id 46f93343f7b384ead5f1b2457ba5d36622560c0fb59b914514822a0b78e8421c May 21 14:43:21.263650 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.263631 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:43:21.680890 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:21.680846 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" event={"ID":"54130316-4340-4aaa-b0d0-fa8e2cbe76ba","Type":"ContainerStarted","Data":"46f93343f7b384ead5f1b2457ba5d36622560c0fb59b914514822a0b78e8421c"} May 21 14:43:22.993178 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:22.993145 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-wrpnd"] May 21 14:43:23.001923 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.001894 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.002894 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.002864 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-wrpnd"] May 21 14:43:23.004288 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.004265 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 14:43:23.004288 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.004275 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qsdmn\"" May 21 14:43:23.139849 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.139807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-cert\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.140044 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.139865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5j7p\" (UniqueName: \"kubernetes.io/projected/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-kube-api-access-w5j7p\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.241105 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.241058 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-cert\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.241105 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.241113 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5j7p\" (UniqueName: \"kubernetes.io/projected/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-kube-api-access-w5j7p\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.241350 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:23.241218 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 14:43:23.241350 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:23.241306 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-cert podName:12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:23.741283875 +0000 UTC m=+323.717627345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-cert") pod "odh-model-controller-858dbf95b8-wrpnd" (UID: "12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4") : secret "odh-model-controller-webhook-cert" not found May 21 14:43:23.249981 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.249908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5j7p\" (UniqueName: \"kubernetes.io/projected/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-kube-api-access-w5j7p\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.744522 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.744477 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-cert\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.747038 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.747003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4-cert\") pod \"odh-model-controller-858dbf95b8-wrpnd\" (UID: \"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4\") " pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:23.914914 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:23.914872 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:24.045052 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:24.045014 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-wrpnd"] May 21 14:43:24.653587 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:43:24.653553 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12cfe2aa_eff0_4bdc_b2f1_d95c1cca5ab4.slice/crio-ea19cf3820bb9bfad9fd4f725c9a8dba3091e6d3db400d1baaf403ddb3fc36f0 WatchSource:0}: Error finding container ea19cf3820bb9bfad9fd4f725c9a8dba3091e6d3db400d1baaf403ddb3fc36f0: Status 404 returned error can't find the container with id ea19cf3820bb9bfad9fd4f725c9a8dba3091e6d3db400d1baaf403ddb3fc36f0 May 21 14:43:24.690856 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:24.690823 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" event={"ID":"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4","Type":"ContainerStarted","Data":"ea19cf3820bb9bfad9fd4f725c9a8dba3091e6d3db400d1baaf403ddb3fc36f0"} May 21 14:43:25.696985 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:25.696941 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" event={"ID":"54130316-4340-4aaa-b0d0-fa8e2cbe76ba","Type":"ContainerStarted","Data":"11ab441a38766bb5a734ad90c336200977ed5e987f5e9162ecfe736306585949"} May 21 14:43:25.716731 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:25.716668 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f8585948-vbf6m" podStartSLOduration=2.273789309 podStartE2EDuration="5.716649716s" podCreationTimestamp="2026-05-21 14:43:20 +0000 UTC" firstStartedPulling="2026-05-21 14:43:21.263824187 +0000 UTC m=+321.240167650" lastFinishedPulling="2026-05-21 14:43:24.706684584 +0000 UTC m=+324.683028057" observedRunningTime="2026-05-21 14:43:25.713894245 +0000 UTC m=+325.690237727" watchObservedRunningTime="2026-05-21 14:43:25.716649716 +0000 UTC m=+325.692993189" May 21 14:43:28.710575 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:28.710540 2572 generic.go:358] "Generic (PLEG): container finished" podID="12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4" containerID="bec867aecffac7b87ef253a8cf7fd2563da3b2703d244630d3e01061acc860b5" exitCode=1 May 21 14:43:28.710986 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:28.710602 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" event={"ID":"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4","Type":"ContainerDied","Data":"bec867aecffac7b87ef253a8cf7fd2563da3b2703d244630d3e01061acc860b5"} May 21 14:43:28.710986 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:28.710854 2572 scope.go:117] "RemoveContainer" containerID="bec867aecffac7b87ef253a8cf7fd2563da3b2703d244630d3e01061acc860b5" May 21 14:43:29.228040 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.228001 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-mcb5r"] May 21 14:43:29.231071 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.231055 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.233254 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.233234 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 14:43:29.233806 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.233788 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xxths\"" May 21 14:43:29.241969 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.241944 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-mcb5r"] May 21 14:43:29.288527 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.288500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3919f92-62e2-47e7-ac6b-956e00d506e3-cert\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.288630 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.288561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p95l\" (UniqueName: \"kubernetes.io/projected/e3919f92-62e2-47e7-ac6b-956e00d506e3-kube-api-access-6p95l\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.389262 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.389230 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3919f92-62e2-47e7-ac6b-956e00d506e3-cert\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.389436 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.389302 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6p95l\" (UniqueName: \"kubernetes.io/projected/e3919f92-62e2-47e7-ac6b-956e00d506e3-kube-api-access-6p95l\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.389436 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:29.389371 2572 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 14:43:29.389507 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:29.389438 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3919f92-62e2-47e7-ac6b-956e00d506e3-cert podName:e3919f92-62e2-47e7-ac6b-956e00d506e3 nodeName:}" failed. No retries permitted until 2026-05-21 14:43:29.889420462 +0000 UTC m=+329.865763922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e3919f92-62e2-47e7-ac6b-956e00d506e3-cert") pod "kserve-controller-manager-856948b99f-mcb5r" (UID: "e3919f92-62e2-47e7-ac6b-956e00d506e3") : secret "kserve-webhook-server-cert" not found May 21 14:43:29.401196 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.401168 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p95l\" (UniqueName: \"kubernetes.io/projected/e3919f92-62e2-47e7-ac6b-956e00d506e3-kube-api-access-6p95l\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.715728 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.715636 2572 generic.go:358] "Generic (PLEG): container finished" podID="12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4" containerID="e181b59318f4140d83bf766eda0a2535e6390f6e0dfaaabdeedbf4611cf03b37" exitCode=1 May 21 14:43:29.716157 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.715724 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" event={"ID":"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4","Type":"ContainerDied","Data":"e181b59318f4140d83bf766eda0a2535e6390f6e0dfaaabdeedbf4611cf03b37"} May 21 14:43:29.716157 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.715795 2572 scope.go:117] "RemoveContainer" containerID="bec867aecffac7b87ef253a8cf7fd2563da3b2703d244630d3e01061acc860b5" May 21 14:43:29.716157 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.715992 2572 scope.go:117] "RemoveContainer" containerID="e181b59318f4140d83bf766eda0a2535e6390f6e0dfaaabdeedbf4611cf03b37" May 21 14:43:29.716302 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:29.716187 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-wrpnd_opendatahub(12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4)\"" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" podUID="12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4" May 21 14:43:29.893681 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.893651 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3919f92-62e2-47e7-ac6b-956e00d506e3-cert\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:29.896026 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:29.896000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3919f92-62e2-47e7-ac6b-956e00d506e3-cert\") pod \"kserve-controller-manager-856948b99f-mcb5r\" (UID: \"e3919f92-62e2-47e7-ac6b-956e00d506e3\") " pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:30.142505 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:30.142473 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:30.268637 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:30.268603 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-mcb5r"] May 21 14:43:30.271613 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:43:30.271588 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3919f92_62e2_47e7_ac6b_956e00d506e3.slice/crio-6ac064cd1f6c1c2bea2c7d7e3a919e81d3f7b6fe0d5ade995232428a833a38a9 WatchSource:0}: Error finding container 6ac064cd1f6c1c2bea2c7d7e3a919e81d3f7b6fe0d5ade995232428a833a38a9: Status 404 returned error can't find the container with id 6ac064cd1f6c1c2bea2c7d7e3a919e81d3f7b6fe0d5ade995232428a833a38a9 May 21 14:43:30.720587 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:30.720561 2572 scope.go:117] "RemoveContainer" containerID="e181b59318f4140d83bf766eda0a2535e6390f6e0dfaaabdeedbf4611cf03b37" May 21 14:43:30.721042 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:30.720827 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-wrpnd_opendatahub(12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4)\"" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" podUID="12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4" May 21 14:43:30.721398 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:30.721377 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" event={"ID":"e3919f92-62e2-47e7-ac6b-956e00d506e3","Type":"ContainerStarted","Data":"6ac064cd1f6c1c2bea2c7d7e3a919e81d3f7b6fe0d5ade995232428a833a38a9"} May 21 14:43:33.915609 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:33.915565 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:33.916095 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:33.916082 2572 scope.go:117] "RemoveContainer" containerID="e181b59318f4140d83bf766eda0a2535e6390f6e0dfaaabdeedbf4611cf03b37" May 21 14:43:33.916299 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:43:33.916275 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-wrpnd_opendatahub(12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4)\"" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" podUID="12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4" May 21 14:43:34.737239 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.737201 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" event={"ID":"e3919f92-62e2-47e7-ac6b-956e00d506e3","Type":"ContainerStarted","Data":"200db055e1e82a9a4b53fa1a4e924c902e3c59be05661609736cc828a745015e"} May 21 14:43:34.737423 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.737278 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:43:34.757811 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.757720 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" podStartSLOduration=2.022912194 podStartE2EDuration="5.757704114s" podCreationTimestamp="2026-05-21 14:43:29 +0000 UTC" firstStartedPulling="2026-05-21 14:43:30.273268801 +0000 UTC m=+330.249612260" lastFinishedPulling="2026-05-21 14:43:34.008060709 +0000 UTC m=+333.984404180" observedRunningTime="2026-05-21 14:43:34.755856148 +0000 UTC m=+334.732199630" watchObservedRunningTime="2026-05-21 14:43:34.757704114 +0000 UTC m=+334.734047618" May 21 14:43:34.973233 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.973192 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9jh74"] May 21 14:43:34.976764 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.976735 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:34.979136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.979111 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 14:43:34.979136 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.979127 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-8rtp8\"" May 21 14:43:34.979310 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.979116 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 14:43:34.992374 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:34.992296 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9jh74"] May 21 14:43:35.037424 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.037365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/52a4bd8f-2108-4036-a48f-7cdd0ca19a07-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9jh74\" (UID: \"52a4bd8f-2108-4036-a48f-7cdd0ca19a07\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.037630 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.037484 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mxp9\" (UniqueName: \"kubernetes.io/projected/52a4bd8f-2108-4036-a48f-7cdd0ca19a07-kube-api-access-8mxp9\") pod \"servicemesh-operator3-55f49c5f94-9jh74\" (UID: \"52a4bd8f-2108-4036-a48f-7cdd0ca19a07\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.138699 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.138648 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mxp9\" (UniqueName: \"kubernetes.io/projected/52a4bd8f-2108-4036-a48f-7cdd0ca19a07-kube-api-access-8mxp9\") pod \"servicemesh-operator3-55f49c5f94-9jh74\" (UID: \"52a4bd8f-2108-4036-a48f-7cdd0ca19a07\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.138937 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.138783 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/52a4bd8f-2108-4036-a48f-7cdd0ca19a07-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9jh74\" (UID: \"52a4bd8f-2108-4036-a48f-7cdd0ca19a07\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.141265 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.141239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/52a4bd8f-2108-4036-a48f-7cdd0ca19a07-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9jh74\" (UID: \"52a4bd8f-2108-4036-a48f-7cdd0ca19a07\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.147009 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.146980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mxp9\" (UniqueName: \"kubernetes.io/projected/52a4bd8f-2108-4036-a48f-7cdd0ca19a07-kube-api-access-8mxp9\") pod \"servicemesh-operator3-55f49c5f94-9jh74\" (UID: \"52a4bd8f-2108-4036-a48f-7cdd0ca19a07\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.287143 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.287007 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:35.424529 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.424493 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9jh74"] May 21 14:43:35.426838 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:43:35.426808 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a4bd8f_2108_4036_a48f_7cdd0ca19a07.slice/crio-3f9cc17089a3aec131ef46c8b34d2b2763419af2822209ae4e2a5be22c5d0a74 WatchSource:0}: Error finding container 3f9cc17089a3aec131ef46c8b34d2b2763419af2822209ae4e2a5be22c5d0a74: Status 404 returned error can't find the container with id 3f9cc17089a3aec131ef46c8b34d2b2763419af2822209ae4e2a5be22c5d0a74 May 21 14:43:35.741477 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:35.741443 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" event={"ID":"52a4bd8f-2108-4036-a48f-7cdd0ca19a07","Type":"ContainerStarted","Data":"3f9cc17089a3aec131ef46c8b34d2b2763419af2822209ae4e2a5be22c5d0a74"} May 21 14:43:38.754481 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:38.754447 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" event={"ID":"52a4bd8f-2108-4036-a48f-7cdd0ca19a07","Type":"ContainerStarted","Data":"002bd254222c28a539a1cbfcbe7ae0241ed0248dbddb49e835ac16f7b19aa329"} May 21 14:43:38.754985 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:38.754585 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:38.772982 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:38.772928 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" podStartSLOduration=2.083996933 podStartE2EDuration="4.77291461s" podCreationTimestamp="2026-05-21 14:43:34 +0000 UTC" firstStartedPulling="2026-05-21 14:43:35.429505992 +0000 UTC m=+335.405849463" lastFinishedPulling="2026-05-21 14:43:38.118423681 +0000 UTC m=+338.094767140" observedRunningTime="2026-05-21 14:43:38.771223339 +0000 UTC m=+338.747566820" watchObservedRunningTime="2026-05-21 14:43:38.77291461 +0000 UTC m=+338.749258091" May 21 14:43:43.915215 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:43.915128 2572 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:43.915559 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:43.915517 2572 scope.go:117] "RemoveContainer" containerID="e181b59318f4140d83bf766eda0a2535e6390f6e0dfaaabdeedbf4611cf03b37" May 21 14:43:44.775380 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:44.775348 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" event={"ID":"12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4","Type":"ContainerStarted","Data":"7694063c02d8a7a3f8439d71edc1bc9f36ebec965208c9193ae18853bf2dec57"} May 21 14:43:44.775571 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:44.775552 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:43:44.819669 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:44.819610 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" podStartSLOduration=3.300107581 podStartE2EDuration="22.819594274s" podCreationTimestamp="2026-05-21 14:43:22 +0000 UTC" firstStartedPulling="2026-05-21 14:43:24.654836248 +0000 UTC m=+324.631179707" lastFinishedPulling="2026-05-21 14:43:44.174322942 +0000 UTC m=+344.150666400" observedRunningTime="2026-05-21 14:43:44.816729511 +0000 UTC m=+344.793072991" watchObservedRunningTime="2026-05-21 14:43:44.819594274 +0000 UTC m=+344.795937754" May 21 14:43:45.558268 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.558219 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh"] May 21 14:43:45.563449 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.563421 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.566662 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.566633 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 14:43:45.566821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.566765 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 14:43:45.566821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.566777 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 14:43:45.566942 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.566782 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qdzrv\"" May 21 14:43:45.566942 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.566886 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 14:43:45.578767 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.578720 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh"] May 21 14:43:45.627745 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtt95\" (UniqueName: \"kubernetes.io/projected/e5e80560-91b9-4325-aea6-9706c339531d-kube-api-access-dtt95\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.627745 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e80560-91b9-4325-aea6-9706c339531d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.627962 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.627962 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5e80560-91b9-4325-aea6-9706c339531d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.627962 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e80560-91b9-4325-aea6-9706c339531d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.627962 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.627962 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.627955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.728718 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728679 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtt95\" (UniqueName: \"kubernetes.io/projected/e5e80560-91b9-4325-aea6-9706c339531d-kube-api-access-dtt95\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.728718 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728722 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e80560-91b9-4325-aea6-9706c339531d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.728956 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728833 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.728956 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728866 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5e80560-91b9-4325-aea6-9706c339531d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.728956 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728921 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e80560-91b9-4325-aea6-9706c339531d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.728956 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728947 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.729146 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.728968 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.729526 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.729500 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e5e80560-91b9-4325-aea6-9706c339531d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.731140 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.731112 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e80560-91b9-4325-aea6-9706c339531d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.731273 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.731255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.731420 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.731396 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.731459 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.731431 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5e80560-91b9-4325-aea6-9706c339531d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.742502 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.742473 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtt95\" (UniqueName: \"kubernetes.io/projected/e5e80560-91b9-4325-aea6-9706c339531d-kube-api-access-dtt95\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.748249 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.748218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e80560-91b9-4325-aea6-9706c339531d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-h7zsh\" (UID: \"e5e80560-91b9-4325-aea6-9706c339531d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:45.874854 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:45.874818 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:46.015664 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:46.015635 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh"] May 21 14:43:46.018191 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:43:46.018158 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e80560_91b9_4325_aea6_9706c339531d.slice/crio-fc7058dd12ce44c42169c23224875aeba160f96ae17743e1c9ba9a6d83c9f387 WatchSource:0}: Error finding container fc7058dd12ce44c42169c23224875aeba160f96ae17743e1c9ba9a6d83c9f387: Status 404 returned error can't find the container with id fc7058dd12ce44c42169c23224875aeba160f96ae17743e1c9ba9a6d83c9f387 May 21 14:43:46.784568 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:46.784525 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" event={"ID":"e5e80560-91b9-4325-aea6-9706c339531d","Type":"ContainerStarted","Data":"fc7058dd12ce44c42169c23224875aeba160f96ae17743e1c9ba9a6d83c9f387"} May 21 14:43:48.599541 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:48.599506 2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 14:43:48.599801 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:48.599591 2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 14:43:48.795042 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:48.794998 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" event={"ID":"e5e80560-91b9-4325-aea6-9706c339531d","Type":"ContainerStarted","Data":"8e5a7728a18675c54d18fdf1ef8c1441f8dbabf186dcbf00354401cdbf0b77bc"} May 21 14:43:48.795473 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:48.795163 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:48.816799 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:48.816737 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" podStartSLOduration=1.237629873 podStartE2EDuration="3.816723905s" podCreationTimestamp="2026-05-21 14:43:45 +0000 UTC" firstStartedPulling="2026-05-21 14:43:46.020199228 +0000 UTC m=+345.996542700" lastFinishedPulling="2026-05-21 14:43:48.599293265 +0000 UTC m=+348.575636732" observedRunningTime="2026-05-21 14:43:48.814780483 +0000 UTC m=+348.791123960" watchObservedRunningTime="2026-05-21 14:43:48.816723905 +0000 UTC m=+348.793067385" May 21 14:43:49.760561 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:49.760530 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jh74" May 21 14:43:49.801954 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:49.801853 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-h7zsh" May 21 14:43:55.781801 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:43:55.781748 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-wrpnd" May 21 14:44:05.747452 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:05.747421 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-mcb5r" May 21 14:44:56.431498 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.431464 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wxzw6"] May 21 14:44:56.434596 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.434581 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:44:56.436851 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.436820 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 14:44:56.436851 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.436838 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 14:44:56.437570 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.437550 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6pnkn\"" May 21 14:44:56.446971 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.446949 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wxzw6"] May 21 14:44:56.515779 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.515731 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjv46\" (UniqueName: \"kubernetes.io/projected/f920844c-b7ac-40d1-a294-5910b9aad6f7-kube-api-access-wjv46\") pod \"authorino-operator-657f44b778-wxzw6\" (UID: \"f920844c-b7ac-40d1-a294-5910b9aad6f7\") " pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:44:56.616584 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.616545 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjv46\" (UniqueName: \"kubernetes.io/projected/f920844c-b7ac-40d1-a294-5910b9aad6f7-kube-api-access-wjv46\") pod \"authorino-operator-657f44b778-wxzw6\" (UID: \"f920844c-b7ac-40d1-a294-5910b9aad6f7\") " pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:44:56.624813 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.624778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjv46\" (UniqueName: \"kubernetes.io/projected/f920844c-b7ac-40d1-a294-5910b9aad6f7-kube-api-access-wjv46\") pod \"authorino-operator-657f44b778-wxzw6\" (UID: \"f920844c-b7ac-40d1-a294-5910b9aad6f7\") " pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:44:56.746849 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.744247 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:44:56.882159 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:56.882134 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-wxzw6"] May 21 14:44:56.884265 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:44:56.884234 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf920844c_b7ac_40d1_a294_5910b9aad6f7.slice/crio-ddd3795d0f0eb26d015bd607cf9440e0b1958fa7110dbe79d12cc6c25b9228b5 WatchSource:0}: Error finding container ddd3795d0f0eb26d015bd607cf9440e0b1958fa7110dbe79d12cc6c25b9228b5: Status 404 returned error can't find the container with id ddd3795d0f0eb26d015bd607cf9440e0b1958fa7110dbe79d12cc6c25b9228b5 May 21 14:44:57.012687 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:57.012586 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" event={"ID":"f920844c-b7ac-40d1-a294-5910b9aad6f7","Type":"ContainerStarted","Data":"ddd3795d0f0eb26d015bd607cf9440e0b1958fa7110dbe79d12cc6c25b9228b5"} May 21 14:44:59.020571 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:59.020535 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" event={"ID":"f920844c-b7ac-40d1-a294-5910b9aad6f7","Type":"ContainerStarted","Data":"80b2690ae20fd686b5881de043630915f2b73b49df5392b7eaaaae386998006e"} May 21 14:44:59.020966 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:59.020655 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:44:59.040625 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:44:59.040501 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" podStartSLOduration=1.143785988 podStartE2EDuration="3.040479565s" podCreationTimestamp="2026-05-21 14:44:56 +0000 UTC" firstStartedPulling="2026-05-21 14:44:56.886053675 +0000 UTC m=+416.862397133" lastFinishedPulling="2026-05-21 14:44:58.78274724 +0000 UTC m=+418.759090710" observedRunningTime="2026-05-21 14:44:59.039323528 +0000 UTC m=+419.015667021" watchObservedRunningTime="2026-05-21 14:44:59.040479565 +0000 UTC m=+419.016823046" May 21 14:45:01.210003 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.209967 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx"] May 21 14:45:01.213483 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.213463 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:01.216070 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.216044 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 14:45:01.216223 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.216098 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5tngh\"" May 21 14:45:01.224653 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.224615 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx"] May 21 14:45:01.358921 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.358865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p4zq\" (UniqueName: \"kubernetes.io/projected/e1217ae8-05ed-4203-b2e1-5f2310a9c058-kube-api-access-9p4zq\") pod \"dns-operator-controller-manager-648d5c98bc-mtvzx\" (UID: \"e1217ae8-05ed-4203-b2e1-5f2310a9c058\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:01.460371 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.460277 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9p4zq\" (UniqueName: \"kubernetes.io/projected/e1217ae8-05ed-4203-b2e1-5f2310a9c058-kube-api-access-9p4zq\") pod \"dns-operator-controller-manager-648d5c98bc-mtvzx\" (UID: \"e1217ae8-05ed-4203-b2e1-5f2310a9c058\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:01.468301 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.468272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p4zq\" (UniqueName: \"kubernetes.io/projected/e1217ae8-05ed-4203-b2e1-5f2310a9c058-kube-api-access-9p4zq\") pod \"dns-operator-controller-manager-648d5c98bc-mtvzx\" (UID: \"e1217ae8-05ed-4203-b2e1-5f2310a9c058\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:01.524296 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.524253 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:01.655171 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:01.655133 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx"] May 21 14:45:01.659594 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:45:01.659560 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1217ae8_05ed_4203_b2e1_5f2310a9c058.slice/crio-2a9e573ded3fc1e0819573db8270cb476f0088f5d825cf649d8c835f879cc135 WatchSource:0}: Error finding container 2a9e573ded3fc1e0819573db8270cb476f0088f5d825cf649d8c835f879cc135: Status 404 returned error can't find the container with id 2a9e573ded3fc1e0819573db8270cb476f0088f5d825cf649d8c835f879cc135 May 21 14:45:02.032374 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:02.032335 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" event={"ID":"e1217ae8-05ed-4203-b2e1-5f2310a9c058","Type":"ContainerStarted","Data":"2a9e573ded3fc1e0819573db8270cb476f0088f5d825cf649d8c835f879cc135"} May 21 14:45:05.044042 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:05.043995 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" event={"ID":"e1217ae8-05ed-4203-b2e1-5f2310a9c058","Type":"ContainerStarted","Data":"fde99fe2eb86c62cef997d99e520fde3ad82e7123d258953caee8412b3542559"} May 21 14:45:05.044465 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:05.044247 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:05.061457 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:05.061396 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" podStartSLOduration=1.462724931 podStartE2EDuration="4.061382443s" podCreationTimestamp="2026-05-21 14:45:01 +0000 UTC" firstStartedPulling="2026-05-21 14:45:01.662006102 +0000 UTC m=+421.638349561" lastFinishedPulling="2026-05-21 14:45:04.260663602 +0000 UTC m=+424.237007073" observedRunningTime="2026-05-21 14:45:05.060366287 +0000 UTC m=+425.036709769" watchObservedRunningTime="2026-05-21 14:45:05.061382443 +0000 UTC m=+425.037725923" May 21 14:45:10.026478 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:10.026444 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-wxzw6" May 21 14:45:11.834321 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:11.834288 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9"] May 21 14:45:11.837683 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:11.837659 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:11.839944 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:11.839927 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gkqbh\"" May 21 14:45:11.848266 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:11.848244 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9"] May 21 14:45:11.948743 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:11.948701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6svm\" (UniqueName: \"kubernetes.io/projected/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-kube-api-access-m6svm\") pod \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:11.948960 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:11.948868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:12.050183 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.050141 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:12.050379 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.050200 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6svm\" (UniqueName: \"kubernetes.io/projected/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-kube-api-access-m6svm\") pod \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:12.050569 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.050543 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:12.061317 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.061293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6svm\" (UniqueName: \"kubernetes.io/projected/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-kube-api-access-m6svm\") pod \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:12.148867 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.148831 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:12.279648 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.279623 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9"] May 21 14:45:12.282426 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:45:12.282397 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4fc0fdd_2b3e_4aca_99d0_ffe5b82c044e.slice/crio-3c2b9321d8b40a45b7b770e80804566e2e787c715856f69aa10d121bcb49f3e5 WatchSource:0}: Error finding container 3c2b9321d8b40a45b7b770e80804566e2e787c715856f69aa10d121bcb49f3e5: Status 404 returned error can't find the container with id 3c2b9321d8b40a45b7b770e80804566e2e787c715856f69aa10d121bcb49f3e5 May 21 14:45:12.363273 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.363233 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9"] May 21 14:45:12.374703 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.374664 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9"] May 21 14:45:12.387209 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.387172 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk"] May 21 14:45:12.392041 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.392016 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.404095 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.403836 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk"] May 21 14:45:12.552877 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.552834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcjt\" (UniqueName: \"kubernetes.io/projected/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-kube-api-access-pwcjt\") pod \"kuadrant-operator-controller-manager-84b657d985-f9dpk\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.553059 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.552931 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-f9dpk\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.654289 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.654194 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcjt\" (UniqueName: \"kubernetes.io/projected/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-kube-api-access-pwcjt\") pod \"kuadrant-operator-controller-manager-84b657d985-f9dpk\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.654457 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.654293 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-f9dpk\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.654725 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.654700 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-f9dpk\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.662940 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.662913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcjt\" (UniqueName: \"kubernetes.io/projected/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-kube-api-access-pwcjt\") pod \"kuadrant-operator-controller-manager-84b657d985-f9dpk\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.705093 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.705053 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:12.869893 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:12.869858 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk"] May 21 14:45:12.873379 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:45:12.873355 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ed8398_6f05_4d29_9b63_5b2185b5a7ee.slice/crio-c06fc63db7f1c4071331d38816618d86018d32b968009087e071eb89906dc7fc WatchSource:0}: Error finding container c06fc63db7f1c4071331d38816618d86018d32b968009087e071eb89906dc7fc: Status 404 returned error can't find the container with id c06fc63db7f1c4071331d38816618d86018d32b968009087e071eb89906dc7fc May 21 14:45:13.073056 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:13.072965 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" event={"ID":"08ed8398-6f05-4d29-9b63-5b2185b5a7ee","Type":"ContainerStarted","Data":"c06fc63db7f1c4071331d38816618d86018d32b968009087e071eb89906dc7fc"} May 21 14:45:16.051159 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:16.051047 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mtvzx" May 21 14:45:17.091110 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.091023 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" event={"ID":"08ed8398-6f05-4d29-9b63-5b2185b5a7ee","Type":"ContainerStarted","Data":"fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1"} May 21 14:45:17.091110 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.091098 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:17.092542 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.092494 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" containerName="manager" containerID="cri-o://ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6" gracePeriod=2 May 21 14:45:17.122587 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.122540 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" podStartSLOduration=1.297656907 podStartE2EDuration="5.122524391s" podCreationTimestamp="2026-05-21 14:45:12 +0000 UTC" firstStartedPulling="2026-05-21 14:45:12.875627987 +0000 UTC m=+432.851971447" lastFinishedPulling="2026-05-21 14:45:16.700495468 +0000 UTC m=+436.676838931" observedRunningTime="2026-05-21 14:45:17.121487643 +0000 UTC m=+437.097831123" watchObservedRunningTime="2026-05-21 14:45:17.122524391 +0000 UTC m=+437.098867873" May 21 14:45:17.323304 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.323281 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:17.325169 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.325143 2572 status_manager.go:895] "Failed to get status for pod" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" err="pods \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" May 21 14:45:17.399269 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.399240 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-extensions-socket-volume\") pod \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " May 21 14:45:17.399423 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.399293 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6svm\" (UniqueName: \"kubernetes.io/projected/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-kube-api-access-m6svm\") pod \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\" (UID: \"d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e\") " May 21 14:45:17.399486 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.399466 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" (UID: "d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:45:17.401442 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.401418 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-kube-api-access-m6svm" (OuterVolumeSpecName: "kube-api-access-m6svm") pod "d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" (UID: "d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e"). InnerVolumeSpecName "kube-api-access-m6svm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:45:17.500277 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.500239 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6svm\" (UniqueName: \"kubernetes.io/projected/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-kube-api-access-m6svm\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:45:17.500277 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:17.500270 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e-extensions-socket-volume\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:45:18.096389 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.096304 2572 generic.go:358] "Generic (PLEG): container finished" podID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" containerID="ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6" exitCode=2 May 21 14:45:18.096389 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.096353 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" May 21 14:45:18.096894 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.096401 2572 scope.go:117] "RemoveContainer" containerID="ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6" May 21 14:45:18.098388 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.098361 2572 status_manager.go:895] "Failed to get status for pod" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" err="pods \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" May 21 14:45:18.105182 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.105163 2572 scope.go:117] "RemoveContainer" containerID="ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6" May 21 14:45:18.105435 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:45:18.105416 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6\": container with ID starting with ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6 not found: ID does not exist" containerID="ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6" May 21 14:45:18.105495 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.105448 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6"} err="failed to get container status \"ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6\": rpc error: code = NotFound desc = could not find container \"ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6\": container with ID starting with ea16427b26d585f274ec1d6c9a92a1150603bb2446289a42ec3975d1064b27a6 not found: ID does not exist" May 21 14:45:18.106785 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.106737 2572 status_manager.go:895] "Failed to get status for pod" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-dtpj9" err="pods \"kuadrant-operator-controller-manager-84b657d985-dtpj9\" is forbidden: User \"system:node:ip-10-0-129-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-1.ec2.internal' and this object" May 21 14:45:18.663695 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:18.663662 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" path="/var/lib/kubelet/pods/d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e/volumes" May 21 14:45:28.099211 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:28.099181 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:40.809769 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:40.809715 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk"] May 21 14:45:40.810421 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:40.810046 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" podUID="08ed8398-6f05-4d29-9b63-5b2185b5a7ee" containerName="manager" containerID="cri-o://fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1" gracePeriod=10 May 21 14:45:41.050705 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.050683 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:41.092397 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.092318 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwcjt\" (UniqueName: \"kubernetes.io/projected/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-kube-api-access-pwcjt\") pod \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " May 21 14:45:41.092520 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.092485 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-extensions-socket-volume\") pod \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\" (UID: \"08ed8398-6f05-4d29-9b63-5b2185b5a7ee\") " May 21 14:45:41.092970 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.092951 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "08ed8398-6f05-4d29-9b63-5b2185b5a7ee" (UID: "08ed8398-6f05-4d29-9b63-5b2185b5a7ee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 14:45:41.094310 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.094285 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-kube-api-access-pwcjt" (OuterVolumeSpecName: "kube-api-access-pwcjt") pod "08ed8398-6f05-4d29-9b63-5b2185b5a7ee" (UID: "08ed8398-6f05-4d29-9b63-5b2185b5a7ee"). InnerVolumeSpecName "kube-api-access-pwcjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:45:41.178646 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.178609 2572 generic.go:358] "Generic (PLEG): container finished" podID="08ed8398-6f05-4d29-9b63-5b2185b5a7ee" containerID="fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1" exitCode=0 May 21 14:45:41.178829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.178661 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" event={"ID":"08ed8398-6f05-4d29-9b63-5b2185b5a7ee","Type":"ContainerDied","Data":"fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1"} May 21 14:45:41.178829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.178700 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" May 21 14:45:41.178829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.178711 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk" event={"ID":"08ed8398-6f05-4d29-9b63-5b2185b5a7ee","Type":"ContainerDied","Data":"c06fc63db7f1c4071331d38816618d86018d32b968009087e071eb89906dc7fc"} May 21 14:45:41.178829 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.178730 2572 scope.go:117] "RemoveContainer" containerID="fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1" May 21 14:45:41.187178 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.187158 2572 scope.go:117] "RemoveContainer" containerID="fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1" May 21 14:45:41.187404 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:45:41.187385 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1\": container with ID starting with fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1 not found: ID does not exist" containerID="fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1" May 21 14:45:41.187461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.187411 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1"} err="failed to get container status \"fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1\": rpc error: code = NotFound desc = could not find container \"fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1\": container with ID starting with fb2ff66ca4a26ed570cc850a4ddc881013495ddbcfe5861866a6ef4f501ac8f1 not found: ID does not exist" May 21 14:45:41.193466 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.193446 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwcjt\" (UniqueName: \"kubernetes.io/projected/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-kube-api-access-pwcjt\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:45:41.193466 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.193466 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/08ed8398-6f05-4d29-9b63-5b2185b5a7ee-extensions-socket-volume\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:45:41.198076 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.198054 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk"] May 21 14:45:41.206870 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:41.206847 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-f9dpk"] May 21 14:45:42.663494 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:45:42.663461 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08ed8398-6f05-4d29-9b63-5b2185b5a7ee" path="/var/lib/kubelet/pods/08ed8398-6f05-4d29-9b63-5b2185b5a7ee/volumes" May 21 14:46:00.773682 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.773644 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:00.774159 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.774110 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08ed8398-6f05-4d29-9b63-5b2185b5a7ee" containerName="manager" May 21 14:46:00.774159 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.774129 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="08ed8398-6f05-4d29-9b63-5b2185b5a7ee" containerName="manager" May 21 14:46:00.774159 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.774145 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" containerName="manager" May 21 14:46:00.774159 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.774153 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" containerName="manager" May 21 14:46:00.774356 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.774254 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4fc0fdd-2b3e-4aca-99d0-ffe5b82c044e" containerName="manager" May 21 14:46:00.774356 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.774267 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="08ed8398-6f05-4d29-9b63-5b2185b5a7ee" containerName="manager" May 21 14:46:00.778145 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.778123 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:00.780146 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.780125 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 14:46:00.780250 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.780222 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8vzmb\"" May 21 14:46:00.783745 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.783726 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:00.867856 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.867775 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:00.867856 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.867802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2478e3b2-8404-43a6-89da-3153f31811cc-config-file\") pod \"limitador-limitador-7d549b5b-npkrc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:00.868075 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.867912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flz7w\" (UniqueName: \"kubernetes.io/projected/2478e3b2-8404-43a6-89da-3153f31811cc-kube-api-access-flz7w\") pod \"limitador-limitador-7d549b5b-npkrc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:00.969264 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.969231 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2478e3b2-8404-43a6-89da-3153f31811cc-config-file\") pod \"limitador-limitador-7d549b5b-npkrc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:00.969456 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.969313 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flz7w\" (UniqueName: \"kubernetes.io/projected/2478e3b2-8404-43a6-89da-3153f31811cc-kube-api-access-flz7w\") pod \"limitador-limitador-7d549b5b-npkrc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:00.970001 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.969982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2478e3b2-8404-43a6-89da-3153f31811cc-config-file\") pod \"limitador-limitador-7d549b5b-npkrc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:00.976484 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:00.976462 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flz7w\" (UniqueName: \"kubernetes.io/projected/2478e3b2-8404-43a6-89da-3153f31811cc-kube-api-access-flz7w\") pod \"limitador-limitador-7d549b5b-npkrc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:01.089122 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:01.089091 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:01.218325 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:01.218295 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:01.220839 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:46:01.220804 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2478e3b2_8404_43a6_89da_3153f31811cc.slice/crio-c4ec3a7b4f0a60722d9eb8feb9f363520c4b0ed6fc2551c0afe0c30675aa33fc WatchSource:0}: Error finding container c4ec3a7b4f0a60722d9eb8feb9f363520c4b0ed6fc2551c0afe0c30675aa33fc: Status 404 returned error can't find the container with id c4ec3a7b4f0a60722d9eb8feb9f363520c4b0ed6fc2551c0afe0c30675aa33fc May 21 14:46:01.248968 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:01.248936 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" event={"ID":"2478e3b2-8404-43a6-89da-3153f31811cc","Type":"ContainerStarted","Data":"c4ec3a7b4f0a60722d9eb8feb9f363520c4b0ed6fc2551c0afe0c30675aa33fc"} May 21 14:46:04.262792 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:04.262697 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" event={"ID":"2478e3b2-8404-43a6-89da-3153f31811cc","Type":"ContainerStarted","Data":"a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3"} May 21 14:46:04.263189 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:04.262811 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:04.279396 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:04.279345 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" podStartSLOduration=1.519686849 podStartE2EDuration="4.279331363s" podCreationTimestamp="2026-05-21 14:46:00 +0000 UTC" firstStartedPulling="2026-05-21 14:46:01.222581003 +0000 UTC m=+481.198924463" lastFinishedPulling="2026-05-21 14:46:03.982225515 +0000 UTC m=+483.958568977" observedRunningTime="2026-05-21 14:46:04.277136481 +0000 UTC m=+484.253479963" watchObservedRunningTime="2026-05-21 14:46:04.279331363 +0000 UTC m=+484.255674844" May 21 14:46:15.267119 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:15.267082 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:16.005071 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.005039 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:16.005311 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.005265 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" podUID="2478e3b2-8404-43a6-89da-3153f31811cc" containerName="limitador" containerID="cri-o://a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3" gracePeriod=30 May 21 14:46:16.544324 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.544301 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:16.595290 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.595214 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2478e3b2-8404-43a6-89da-3153f31811cc-config-file\") pod \"2478e3b2-8404-43a6-89da-3153f31811cc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " May 21 14:46:16.595290 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.595253 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flz7w\" (UniqueName: \"kubernetes.io/projected/2478e3b2-8404-43a6-89da-3153f31811cc-kube-api-access-flz7w\") pod \"2478e3b2-8404-43a6-89da-3153f31811cc\" (UID: \"2478e3b2-8404-43a6-89da-3153f31811cc\") " May 21 14:46:16.595639 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.595612 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2478e3b2-8404-43a6-89da-3153f31811cc-config-file" (OuterVolumeSpecName: "config-file") pod "2478e3b2-8404-43a6-89da-3153f31811cc" (UID: "2478e3b2-8404-43a6-89da-3153f31811cc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 14:46:16.597312 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.597283 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2478e3b2-8404-43a6-89da-3153f31811cc-kube-api-access-flz7w" (OuterVolumeSpecName: "kube-api-access-flz7w") pod "2478e3b2-8404-43a6-89da-3153f31811cc" (UID: "2478e3b2-8404-43a6-89da-3153f31811cc"). InnerVolumeSpecName "kube-api-access-flz7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:46:16.696689 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.696656 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2478e3b2-8404-43a6-89da-3153f31811cc-config-file\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:46:16.696689 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:16.696683 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flz7w\" (UniqueName: \"kubernetes.io/projected/2478e3b2-8404-43a6-89da-3153f31811cc-kube-api-access-flz7w\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:46:17.307155 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.307118 2572 generic.go:358] "Generic (PLEG): container finished" podID="2478e3b2-8404-43a6-89da-3153f31811cc" containerID="a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3" exitCode=0 May 21 14:46:17.307155 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.307156 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" event={"ID":"2478e3b2-8404-43a6-89da-3153f31811cc","Type":"ContainerDied","Data":"a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3"} May 21 14:46:17.307358 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.307174 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" May 21 14:46:17.307358 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.307182 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-npkrc" event={"ID":"2478e3b2-8404-43a6-89da-3153f31811cc","Type":"ContainerDied","Data":"c4ec3a7b4f0a60722d9eb8feb9f363520c4b0ed6fc2551c0afe0c30675aa33fc"} May 21 14:46:17.307358 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.307201 2572 scope.go:117] "RemoveContainer" containerID="a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3" May 21 14:46:17.315268 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.315246 2572 scope.go:117] "RemoveContainer" containerID="a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3" May 21 14:46:17.315517 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:46:17.315498 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3\": container with ID starting with a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3 not found: ID does not exist" containerID="a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3" May 21 14:46:17.315587 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.315524 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3"} err="failed to get container status \"a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3\": rpc error: code = NotFound desc = could not find container \"a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3\": container with ID starting with a59d524750543c50c3307cd5c42b8145781c569dca46a81c05dc431c44497cb3 not found: ID does not exist" May 21 14:46:17.322766 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.322734 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:17.325550 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:17.325528 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-npkrc"] May 21 14:46:18.663785 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:18.663735 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2478e3b2-8404-43a6-89da-3153f31811cc" path="/var/lib/kubelet/pods/2478e3b2-8404-43a6-89da-3153f31811cc/volumes" May 21 14:46:20.201122 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.201083 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qwvr7"] May 21 14:46:20.201500 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.201453 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2478e3b2-8404-43a6-89da-3153f31811cc" containerName="limitador" May 21 14:46:20.201500 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.201480 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2478e3b2-8404-43a6-89da-3153f31811cc" containerName="limitador" May 21 14:46:20.201583 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.201547 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="2478e3b2-8404-43a6-89da-3153f31811cc" containerName="limitador" May 21 14:46:20.206188 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.206165 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.208171 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.208146 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bwxpr\"" May 21 14:46:20.208171 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.208165 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 14:46:20.212635 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.212608 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qwvr7"] May 21 14:46:20.226313 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.226289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88eff955-38b4-46f8-9794-3021ae8612ea-data\") pod \"postgres-68c4fbbd6f-qwvr7\" (UID: \"88eff955-38b4-46f8-9794-3021ae8612ea\") " pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.226461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.226326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg87g\" (UniqueName: \"kubernetes.io/projected/88eff955-38b4-46f8-9794-3021ae8612ea-kube-api-access-rg87g\") pod \"postgres-68c4fbbd6f-qwvr7\" (UID: \"88eff955-38b4-46f8-9794-3021ae8612ea\") " pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.326737 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.326702 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88eff955-38b4-46f8-9794-3021ae8612ea-data\") pod \"postgres-68c4fbbd6f-qwvr7\" (UID: \"88eff955-38b4-46f8-9794-3021ae8612ea\") " pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.326938 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.326744 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rg87g\" (UniqueName: \"kubernetes.io/projected/88eff955-38b4-46f8-9794-3021ae8612ea-kube-api-access-rg87g\") pod \"postgres-68c4fbbd6f-qwvr7\" (UID: \"88eff955-38b4-46f8-9794-3021ae8612ea\") " pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.327130 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.327105 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88eff955-38b4-46f8-9794-3021ae8612ea-data\") pod \"postgres-68c4fbbd6f-qwvr7\" (UID: \"88eff955-38b4-46f8-9794-3021ae8612ea\") " pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.334603 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.334577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg87g\" (UniqueName: \"kubernetes.io/projected/88eff955-38b4-46f8-9794-3021ae8612ea-kube-api-access-rg87g\") pod \"postgres-68c4fbbd6f-qwvr7\" (UID: \"88eff955-38b4-46f8-9794-3021ae8612ea\") " pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.520153 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.520068 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:20.646010 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:20.645843 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qwvr7"] May 21 14:46:20.648503 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:46:20.648479 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eff955_38b4_46f8_9794_3021ae8612ea.slice/crio-53016657b0632a00d8418176fd60b85343f052b0e1bb9b8db27c90fd0bf840b2 WatchSource:0}: Error finding container 53016657b0632a00d8418176fd60b85343f052b0e1bb9b8db27c90fd0bf840b2: Status 404 returned error can't find the container with id 53016657b0632a00d8418176fd60b85343f052b0e1bb9b8db27c90fd0bf840b2 May 21 14:46:21.321452 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:21.321420 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" event={"ID":"88eff955-38b4-46f8-9794-3021ae8612ea","Type":"ContainerStarted","Data":"53016657b0632a00d8418176fd60b85343f052b0e1bb9b8db27c90fd0bf840b2"} May 21 14:46:26.342067 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:26.342030 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" event={"ID":"88eff955-38b4-46f8-9794-3021ae8612ea","Type":"ContainerStarted","Data":"fbddc9d8a1c8dc849d5ed9a5773a1170b41faeb4ca31969c7abcc134c71461f3"} May 21 14:46:26.342479 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:26.342158 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:26.356302 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:26.356253 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" podStartSLOduration=1.24833072 podStartE2EDuration="6.35623719s" podCreationTimestamp="2026-05-21 14:46:20 +0000 UTC" firstStartedPulling="2026-05-21 14:46:20.649655237 +0000 UTC m=+500.625998697" lastFinishedPulling="2026-05-21 14:46:25.757561706 +0000 UTC m=+505.733905167" observedRunningTime="2026-05-21 14:46:26.355284947 +0000 UTC m=+506.331628445" watchObservedRunningTime="2026-05-21 14:46:26.35623719 +0000 UTC m=+506.332580684" May 21 14:46:32.374810 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:32.374779 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-qwvr7" May 21 14:46:37.995000 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:37.994965 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-485jw"] May 21 14:46:38.081520 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.081481 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-485jw"] May 21 14:46:38.081682 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.081639 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:38.083767 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.083683 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 14:46:38.083767 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.083722 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bvd4q\"" May 21 14:46:38.130067 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.130035 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57dc5c79b4-7sbxp"] May 21 14:46:38.164766 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.164725 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57dc5c79b4-7sbxp"] May 21 14:46:38.164919 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.164870 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:38.182827 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.182800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hh9k\" (UniqueName: \"kubernetes.io/projected/42708f67-9143-4c82-859f-2f2703e92558-kube-api-access-7hh9k\") pod \"maas-controller-7df575f8c9-485jw\" (UID: \"42708f67-9143-4c82-859f-2f2703e92558\") " pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:38.252140 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.252109 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-485jw"] May 21 14:46:38.252338 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:46:38.252318 2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7hh9k], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-7df575f8c9-485jw" podUID="42708f67-9143-4c82-859f-2f2703e92558" May 21 14:46:38.279526 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.279484 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c4cdffbb6-6xcpr"] May 21 14:46:38.283975 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.283951 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hh9k\" (UniqueName: \"kubernetes.io/projected/42708f67-9143-4c82-859f-2f2703e92558-kube-api-access-7hh9k\") pod \"maas-controller-7df575f8c9-485jw\" (UID: \"42708f67-9143-4c82-859f-2f2703e92558\") " pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:38.284104 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.284001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwdq\" (UniqueName: \"kubernetes.io/projected/5060e864-ba3d-4b6c-8ba1-96d5334b3de7-kube-api-access-fvwdq\") pod \"maas-controller-57dc5c79b4-7sbxp\" (UID: \"5060e864-ba3d-4b6c-8ba1-96d5334b3de7\") " pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:38.294716 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.294687 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hh9k\" (UniqueName: \"kubernetes.io/projected/42708f67-9143-4c82-859f-2f2703e92558-kube-api-access-7hh9k\") pod \"maas-controller-7df575f8c9-485jw\" (UID: \"42708f67-9143-4c82-859f-2f2703e92558\") " pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:38.322945 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.322911 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c4cdffbb6-6xcpr"] May 21 14:46:38.323080 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.323029 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:38.384667 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.384591 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:38.384870 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.384848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89wk\" (UniqueName: \"kubernetes.io/projected/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd-kube-api-access-r89wk\") pod \"maas-controller-5c4cdffbb6-6xcpr\" (UID: \"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd\") " pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:38.384949 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.384892 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwdq\" (UniqueName: \"kubernetes.io/projected/5060e864-ba3d-4b6c-8ba1-96d5334b3de7-kube-api-access-fvwdq\") pod \"maas-controller-57dc5c79b4-7sbxp\" (UID: \"5060e864-ba3d-4b6c-8ba1-96d5334b3de7\") " pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:38.388936 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.388916 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:38.394545 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.394523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwdq\" (UniqueName: \"kubernetes.io/projected/5060e864-ba3d-4b6c-8ba1-96d5334b3de7-kube-api-access-fvwdq\") pod \"maas-controller-57dc5c79b4-7sbxp\" (UID: \"5060e864-ba3d-4b6c-8ba1-96d5334b3de7\") " pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:38.474647 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.474615 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:38.485564 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.485530 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hh9k\" (UniqueName: \"kubernetes.io/projected/42708f67-9143-4c82-859f-2f2703e92558-kube-api-access-7hh9k\") pod \"42708f67-9143-4c82-859f-2f2703e92558\" (UID: \"42708f67-9143-4c82-859f-2f2703e92558\") " May 21 14:46:38.485880 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.485858 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r89wk\" (UniqueName: \"kubernetes.io/projected/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd-kube-api-access-r89wk\") pod \"maas-controller-5c4cdffbb6-6xcpr\" (UID: \"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd\") " pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:38.487555 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.487532 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42708f67-9143-4c82-859f-2f2703e92558-kube-api-access-7hh9k" (OuterVolumeSpecName: "kube-api-access-7hh9k") pod "42708f67-9143-4c82-859f-2f2703e92558" (UID: "42708f67-9143-4c82-859f-2f2703e92558"). InnerVolumeSpecName "kube-api-access-7hh9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:46:38.493862 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.493824 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89wk\" (UniqueName: \"kubernetes.io/projected/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd-kube-api-access-r89wk\") pod \"maas-controller-5c4cdffbb6-6xcpr\" (UID: \"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd\") " pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:38.587185 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.587156 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hh9k\" (UniqueName: \"kubernetes.io/projected/42708f67-9143-4c82-859f-2f2703e92558-kube-api-access-7hh9k\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:46:38.603036 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.602884 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57dc5c79b4-7sbxp"] May 21 14:46:38.605856 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:46:38.605827 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5060e864_ba3d_4b6c_8ba1_96d5334b3de7.slice/crio-3f825ab0c05f614fe1fe9c7118485bbb9b1efa1c5b6e80f762a93d084d5c1b56 WatchSource:0}: Error finding container 3f825ab0c05f614fe1fe9c7118485bbb9b1efa1c5b6e80f762a93d084d5c1b56: Status 404 returned error can't find the container with id 3f825ab0c05f614fe1fe9c7118485bbb9b1efa1c5b6e80f762a93d084d5c1b56 May 21 14:46:38.632983 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.632944 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:38.766375 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:38.766350 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c4cdffbb6-6xcpr"] May 21 14:46:38.768698 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:46:38.768669 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ae2c9b_9d38_4e74_a71f_ed82df30fdcd.slice/crio-2b542b7da95bc33039feb8fe0d684ec5a490d45e284048c299823152845592f8 WatchSource:0}: Error finding container 2b542b7da95bc33039feb8fe0d684ec5a490d45e284048c299823152845592f8: Status 404 returned error can't find the container with id 2b542b7da95bc33039feb8fe0d684ec5a490d45e284048c299823152845592f8 May 21 14:46:39.392620 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:39.392544 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" event={"ID":"5060e864-ba3d-4b6c-8ba1-96d5334b3de7","Type":"ContainerStarted","Data":"3f825ab0c05f614fe1fe9c7118485bbb9b1efa1c5b6e80f762a93d084d5c1b56"} May 21 14:46:39.397230 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:39.394627 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-485jw" May 21 14:46:39.397230 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:39.395261 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" event={"ID":"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd","Type":"ContainerStarted","Data":"2b542b7da95bc33039feb8fe0d684ec5a490d45e284048c299823152845592f8"} May 21 14:46:39.427564 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:39.427196 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-485jw"] May 21 14:46:39.429721 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:39.429683 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-485jw"] May 21 14:46:40.665139 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:40.665107 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42708f67-9143-4c82-859f-2f2703e92558" path="/var/lib/kubelet/pods/42708f67-9143-4c82-859f-2f2703e92558/volumes" May 21 14:46:42.405483 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:42.405444 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" event={"ID":"5060e864-ba3d-4b6c-8ba1-96d5334b3de7","Type":"ContainerStarted","Data":"303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571"} May 21 14:46:42.405989 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:42.405552 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:42.406663 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:42.406641 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" event={"ID":"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd","Type":"ContainerStarted","Data":"a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba"} May 21 14:46:42.406821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:42.406808 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:42.421695 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:42.421651 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" podStartSLOduration=1.61705452 podStartE2EDuration="4.421640117s" podCreationTimestamp="2026-05-21 14:46:38 +0000 UTC" firstStartedPulling="2026-05-21 14:46:38.607154548 +0000 UTC m=+518.583498007" lastFinishedPulling="2026-05-21 14:46:41.411740143 +0000 UTC m=+521.388083604" observedRunningTime="2026-05-21 14:46:42.420827656 +0000 UTC m=+522.397171137" watchObservedRunningTime="2026-05-21 14:46:42.421640117 +0000 UTC m=+522.397983598" May 21 14:46:42.434739 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:42.434681 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" podStartSLOduration=1.7833715620000001 podStartE2EDuration="4.43465875s" podCreationTimestamp="2026-05-21 14:46:38 +0000 UTC" firstStartedPulling="2026-05-21 14:46:38.770087609 +0000 UTC m=+518.746431068" lastFinishedPulling="2026-05-21 14:46:41.421374783 +0000 UTC m=+521.397718256" observedRunningTime="2026-05-21 14:46:42.434267145 +0000 UTC m=+522.410610636" watchObservedRunningTime="2026-05-21 14:46:42.43465875 +0000 UTC m=+522.411002231" May 21 14:46:53.416182 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.416143 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:53.416627 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.416200 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:46:53.466064 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.466026 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57dc5c79b4-7sbxp"] May 21 14:46:53.466275 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.466249 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" podUID="5060e864-ba3d-4b6c-8ba1-96d5334b3de7" containerName="manager" containerID="cri-o://303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571" gracePeriod=30 May 21 14:46:53.642441 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.642411 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65595d7c68-b4grl"] May 21 14:46:53.646286 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.646264 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:46:53.659544 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.656537 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65595d7c68-b4grl"] May 21 14:46:53.711079 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.711055 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:53.829403 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.829369 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvwdq\" (UniqueName: \"kubernetes.io/projected/5060e864-ba3d-4b6c-8ba1-96d5334b3de7-kube-api-access-fvwdq\") pod \"5060e864-ba3d-4b6c-8ba1-96d5334b3de7\" (UID: \"5060e864-ba3d-4b6c-8ba1-96d5334b3de7\") " May 21 14:46:53.829583 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.829522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4wnk\" (UniqueName: \"kubernetes.io/projected/a0156ded-575d-46d9-9703-59fd16bb1013-kube-api-access-q4wnk\") pod \"maas-controller-65595d7c68-b4grl\" (UID: \"a0156ded-575d-46d9-9703-59fd16bb1013\") " pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:46:53.831581 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.831551 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5060e864-ba3d-4b6c-8ba1-96d5334b3de7-kube-api-access-fvwdq" (OuterVolumeSpecName: "kube-api-access-fvwdq") pod "5060e864-ba3d-4b6c-8ba1-96d5334b3de7" (UID: "5060e864-ba3d-4b6c-8ba1-96d5334b3de7"). InnerVolumeSpecName "kube-api-access-fvwdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:46:53.930122 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.930065 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4wnk\" (UniqueName: \"kubernetes.io/projected/a0156ded-575d-46d9-9703-59fd16bb1013-kube-api-access-q4wnk\") pod \"maas-controller-65595d7c68-b4grl\" (UID: \"a0156ded-575d-46d9-9703-59fd16bb1013\") " pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:46:53.930303 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.930176 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvwdq\" (UniqueName: \"kubernetes.io/projected/5060e864-ba3d-4b6c-8ba1-96d5334b3de7-kube-api-access-fvwdq\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:46:53.938584 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.938548 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4wnk\" (UniqueName: \"kubernetes.io/projected/a0156ded-575d-46d9-9703-59fd16bb1013-kube-api-access-q4wnk\") pod \"maas-controller-65595d7c68-b4grl\" (UID: \"a0156ded-575d-46d9-9703-59fd16bb1013\") " pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:46:53.963350 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:53.963268 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:46:54.091317 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.091155 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65595d7c68-b4grl"] May 21 14:46:54.093446 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:46:54.093420 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0156ded_575d_46d9_9703_59fd16bb1013.slice/crio-1edba6c4a482317dd1b02058e5dde86759d30f9d73d4897e66990be7136e96d1 WatchSource:0}: Error finding container 1edba6c4a482317dd1b02058e5dde86759d30f9d73d4897e66990be7136e96d1: Status 404 returned error can't find the container with id 1edba6c4a482317dd1b02058e5dde86759d30f9d73d4897e66990be7136e96d1 May 21 14:46:54.446949 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.446916 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65595d7c68-b4grl" event={"ID":"a0156ded-575d-46d9-9703-59fd16bb1013","Type":"ContainerStarted","Data":"1edba6c4a482317dd1b02058e5dde86759d30f9d73d4897e66990be7136e96d1"} May 21 14:46:54.447970 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.447948 2572 generic.go:358] "Generic (PLEG): container finished" podID="5060e864-ba3d-4b6c-8ba1-96d5334b3de7" containerID="303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571" exitCode=0 May 21 14:46:54.448076 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.448008 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" event={"ID":"5060e864-ba3d-4b6c-8ba1-96d5334b3de7","Type":"ContainerDied","Data":"303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571"} May 21 14:46:54.448076 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.448039 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" event={"ID":"5060e864-ba3d-4b6c-8ba1-96d5334b3de7","Type":"ContainerDied","Data":"3f825ab0c05f614fe1fe9c7118485bbb9b1efa1c5b6e80f762a93d084d5c1b56"} May 21 14:46:54.448076 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.448059 2572 scope.go:117] "RemoveContainer" containerID="303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571" May 21 14:46:54.448212 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.448009 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57dc5c79b4-7sbxp" May 21 14:46:54.456461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.456438 2572 scope.go:117] "RemoveContainer" containerID="303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571" May 21 14:46:54.456726 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:46:54.456707 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571\": container with ID starting with 303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571 not found: ID does not exist" containerID="303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571" May 21 14:46:54.456814 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.456733 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571"} err="failed to get container status \"303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571\": rpc error: code = NotFound desc = could not find container \"303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571\": container with ID starting with 303f98591d6ead5a30f9efe687bea0a07beef55c58ebd07bf6e506be21d9a571 not found: ID does not exist" May 21 14:46:54.467659 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.467633 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57dc5c79b4-7sbxp"] May 21 14:46:54.471422 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.471401 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57dc5c79b4-7sbxp"] May 21 14:46:54.666637 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:54.666606 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5060e864-ba3d-4b6c-8ba1-96d5334b3de7" path="/var/lib/kubelet/pods/5060e864-ba3d-4b6c-8ba1-96d5334b3de7/volumes" May 21 14:46:55.453485 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:55.453449 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65595d7c68-b4grl" event={"ID":"a0156ded-575d-46d9-9703-59fd16bb1013","Type":"ContainerStarted","Data":"bb1f19c216b1971fb68e64aae0346d2937c61bff3ed3a71fd24497b0a2f24493"} May 21 14:46:55.453877 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:55.453566 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:46:55.469504 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:46:55.469458 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-65595d7c68-b4grl" podStartSLOduration=2.050787187 podStartE2EDuration="2.469444748s" podCreationTimestamp="2026-05-21 14:46:53 +0000 UTC" firstStartedPulling="2026-05-21 14:46:54.094736387 +0000 UTC m=+534.071079849" lastFinishedPulling="2026-05-21 14:46:54.513393952 +0000 UTC m=+534.489737410" observedRunningTime="2026-05-21 14:46:55.467941417 +0000 UTC m=+535.444284897" watchObservedRunningTime="2026-05-21 14:46:55.469444748 +0000 UTC m=+535.445788228" May 21 14:47:06.463727 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.463695 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:47:06.502476 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.502440 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c4cdffbb6-6xcpr"] May 21 14:47:06.502726 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.502702 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" podUID="a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" containerName="manager" containerID="cri-o://a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba" gracePeriod=30 May 21 14:47:06.753679 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.753653 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:47:06.840156 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.840116 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r89wk\" (UniqueName: \"kubernetes.io/projected/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd-kube-api-access-r89wk\") pod \"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd\" (UID: \"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd\") " May 21 14:47:06.842243 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.842211 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd-kube-api-access-r89wk" (OuterVolumeSpecName: "kube-api-access-r89wk") pod "a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" (UID: "a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd"). InnerVolumeSpecName "kube-api-access-r89wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:47:06.941462 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:06.941430 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r89wk\" (UniqueName: \"kubernetes.io/projected/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd-kube-api-access-r89wk\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:47:07.497294 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.497261 2572 generic.go:358] "Generic (PLEG): container finished" podID="a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" containerID="a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba" exitCode=0 May 21 14:47:07.497681 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.497318 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" May 21 14:47:07.497681 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.497342 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" event={"ID":"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd","Type":"ContainerDied","Data":"a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba"} May 21 14:47:07.497681 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.497391 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c4cdffbb6-6xcpr" event={"ID":"a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd","Type":"ContainerDied","Data":"2b542b7da95bc33039feb8fe0d684ec5a490d45e284048c299823152845592f8"} May 21 14:47:07.497681 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.497409 2572 scope.go:117] "RemoveContainer" containerID="a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba" May 21 14:47:07.506233 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.506108 2572 scope.go:117] "RemoveContainer" containerID="a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba" May 21 14:47:07.506392 ip-10-0-129-1 kubenswrapper[2572]: E0521 14:47:07.506363 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba\": container with ID starting with a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba not found: ID does not exist" containerID="a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba" May 21 14:47:07.506452 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.506404 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba"} err="failed to get container status \"a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba\": rpc error: code = NotFound desc = could not find container \"a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba\": container with ID starting with a39a27c95ce2f527cc3b2526887ac9e279012d15477b0d5d874274444aa60aba not found: ID does not exist" May 21 14:47:07.518461 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.518439 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c4cdffbb6-6xcpr"] May 21 14:47:07.521862 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:07.521842 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c4cdffbb6-6xcpr"] May 21 14:47:08.664005 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:08.663973 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" path="/var/lib/kubelet/pods/a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd/volumes" May 21 14:47:26.506196 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506160 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69b654c78c-q79ml"] May 21 14:47:26.506655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506508 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" containerName="manager" May 21 14:47:26.506655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506520 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" containerName="manager" May 21 14:47:26.506655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506531 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5060e864-ba3d-4b6c-8ba1-96d5334b3de7" containerName="manager" May 21 14:47:26.506655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506537 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5060e864-ba3d-4b6c-8ba1-96d5334b3de7" containerName="manager" May 21 14:47:26.506655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506593 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2ae2c9b-9d38-4e74-a71f-ed82df30fdcd" containerName="manager" May 21 14:47:26.506655 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.506602 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5060e864-ba3d-4b6c-8ba1-96d5334b3de7" containerName="manager" May 21 14:47:26.509615 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.509598 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.512634 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.512608 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-qckk7\"" May 21 14:47:26.512786 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.512614 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 14:47:26.520236 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.520209 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69b654c78c-q79ml"] May 21 14:47:26.613508 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.613476 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8kp9\" (UniqueName: \"kubernetes.io/projected/fb56558f-5829-483d-b868-4dd5426b6b50-kube-api-access-l8kp9\") pod \"maas-api-69b654c78c-q79ml\" (UID: \"fb56558f-5829-483d-b868-4dd5426b6b50\") " pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.613684 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.613527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb56558f-5829-483d-b868-4dd5426b6b50-maas-api-tls\") pod \"maas-api-69b654c78c-q79ml\" (UID: \"fb56558f-5829-483d-b868-4dd5426b6b50\") " pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.714890 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.714858 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb56558f-5829-483d-b868-4dd5426b6b50-maas-api-tls\") pod \"maas-api-69b654c78c-q79ml\" (UID: \"fb56558f-5829-483d-b868-4dd5426b6b50\") " pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.715077 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.714942 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8kp9\" (UniqueName: \"kubernetes.io/projected/fb56558f-5829-483d-b868-4dd5426b6b50-kube-api-access-l8kp9\") pod \"maas-api-69b654c78c-q79ml\" (UID: \"fb56558f-5829-483d-b868-4dd5426b6b50\") " pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.717793 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.717769 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb56558f-5829-483d-b868-4dd5426b6b50-maas-api-tls\") pod \"maas-api-69b654c78c-q79ml\" (UID: \"fb56558f-5829-483d-b868-4dd5426b6b50\") " pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.722318 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.722293 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8kp9\" (UniqueName: \"kubernetes.io/projected/fb56558f-5829-483d-b868-4dd5426b6b50-kube-api-access-l8kp9\") pod \"maas-api-69b654c78c-q79ml\" (UID: \"fb56558f-5829-483d-b868-4dd5426b6b50\") " pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.821532 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.821460 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:26.829242 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.829215 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fwpd9"] May 21 14:47:26.833708 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.833687 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:26.835698 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.835665 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 14:47:26.843286 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.843251 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fwpd9"] May 21 14:47:26.916465 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.916432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jnbh\" (UniqueName: \"kubernetes.io/projected/9fe32c92-7aba-4f76-93e8-d946987621a5-kube-api-access-7jnbh\") pod \"payload-processing-58b6c8fdc7-fwpd9\" (UID: \"9fe32c92-7aba-4f76-93e8-d946987621a5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:26.955657 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:26.955623 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69b654c78c-q79ml"] May 21 14:47:26.958594 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:47:26.958561 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb56558f_5829_483d_b868_4dd5426b6b50.slice/crio-828424b5c732abcdb64ded09c069b6ae3d0eada5ff77604360270d0bb4cace55 WatchSource:0}: Error finding container 828424b5c732abcdb64ded09c069b6ae3d0eada5ff77604360270d0bb4cace55: Status 404 returned error can't find the container with id 828424b5c732abcdb64ded09c069b6ae3d0eada5ff77604360270d0bb4cace55 May 21 14:47:27.017509 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:27.017465 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jnbh\" (UniqueName: \"kubernetes.io/projected/9fe32c92-7aba-4f76-93e8-d946987621a5-kube-api-access-7jnbh\") pod \"payload-processing-58b6c8fdc7-fwpd9\" (UID: \"9fe32c92-7aba-4f76-93e8-d946987621a5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:27.025233 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:27.025201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jnbh\" (UniqueName: \"kubernetes.io/projected/9fe32c92-7aba-4f76-93e8-d946987621a5-kube-api-access-7jnbh\") pod \"payload-processing-58b6c8fdc7-fwpd9\" (UID: \"9fe32c92-7aba-4f76-93e8-d946987621a5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:27.154424 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:27.154380 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:27.289386 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:27.289344 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fwpd9"] May 21 14:47:27.292135 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:47:27.292106 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe32c92_7aba_4f76_93e8_d946987621a5.slice/crio-2911fe4486dde5079c52c28c1b3fb420e5eca2ce5885bb8c287eb45888c5067a WatchSource:0}: Error finding container 2911fe4486dde5079c52c28c1b3fb420e5eca2ce5885bb8c287eb45888c5067a: Status 404 returned error can't find the container with id 2911fe4486dde5079c52c28c1b3fb420e5eca2ce5885bb8c287eb45888c5067a May 21 14:47:27.570877 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:27.570778 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" event={"ID":"9fe32c92-7aba-4f76-93e8-d946987621a5","Type":"ContainerStarted","Data":"2911fe4486dde5079c52c28c1b3fb420e5eca2ce5885bb8c287eb45888c5067a"} May 21 14:47:27.571801 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:27.571732 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69b654c78c-q79ml" event={"ID":"fb56558f-5829-483d-b868-4dd5426b6b50","Type":"ContainerStarted","Data":"828424b5c732abcdb64ded09c069b6ae3d0eada5ff77604360270d0bb4cace55"} May 21 14:47:29.580728 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:29.580692 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" event={"ID":"9fe32c92-7aba-4f76-93e8-d946987621a5","Type":"ContainerStarted","Data":"c8f376ca095395f35315e59b74d88c39dedd7f2e055e7f3802c532a06b26d44f"} May 21 14:47:29.581186 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:29.580779 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:29.582126 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:29.582099 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69b654c78c-q79ml" event={"ID":"fb56558f-5829-483d-b868-4dd5426b6b50","Type":"ContainerStarted","Data":"a94bcbca202ca36336d25a1adb62d89247fa1e51f5e51011cd9abb5c0724b0b0"} May 21 14:47:29.582254 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:29.582223 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:29.597238 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:29.597178 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" podStartSLOduration=2.022668887 podStartE2EDuration="3.597164842s" podCreationTimestamp="2026-05-21 14:47:26 +0000 UTC" firstStartedPulling="2026-05-21 14:47:27.293847305 +0000 UTC m=+567.270190777" lastFinishedPulling="2026-05-21 14:47:28.86834327 +0000 UTC m=+568.844686732" observedRunningTime="2026-05-21 14:47:29.595098062 +0000 UTC m=+569.571441538" watchObservedRunningTime="2026-05-21 14:47:29.597164842 +0000 UTC m=+569.573508323" May 21 14:47:29.609732 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:29.609679 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-69b654c78c-q79ml" podStartSLOduration=1.703725146 podStartE2EDuration="3.609660489s" podCreationTimestamp="2026-05-21 14:47:26 +0000 UTC" firstStartedPulling="2026-05-21 14:47:26.960215929 +0000 UTC m=+566.936559390" lastFinishedPulling="2026-05-21 14:47:28.866151264 +0000 UTC m=+568.842494733" observedRunningTime="2026-05-21 14:47:29.608449192 +0000 UTC m=+569.584792664" watchObservedRunningTime="2026-05-21 14:47:29.609660489 +0000 UTC m=+569.586003969" May 21 14:47:35.591560 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:35.591530 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69b654c78c-q79ml" May 21 14:47:40.588247 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:40.588212 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fwpd9" May 21 14:47:43.093121 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.093083 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf"] May 21 14:47:43.096653 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.096630 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.098981 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.098961 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 14:47:43.099765 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.099732 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 14:47:43.099876 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.099734 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 14:47:43.099876 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.099738 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-86tpb\"" May 21 14:47:43.104647 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.104628 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf"] May 21 14:47:43.261935 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.261901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.261935 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.261937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.262125 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.261975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvbpk\" (UniqueName: \"kubernetes.io/projected/b158213c-397a-49d6-9b3c-9ebf51937a5a-kube-api-access-lvbpk\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.262125 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.262028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b158213c-397a-49d6-9b3c-9ebf51937a5a-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.262125 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.262108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.262222 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.262148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363087 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.362998 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b158213c-397a-49d6-9b3c-9ebf51937a5a-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363087 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363058 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363314 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363099 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363314 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363122 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363314 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363149 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363314 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363184 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvbpk\" (UniqueName: \"kubernetes.io/projected/b158213c-397a-49d6-9b3c-9ebf51937a5a-kube-api-access-lvbpk\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363556 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363533 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363649 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363626 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.363707 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.363651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.365513 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.365491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b158213c-397a-49d6-9b3c-9ebf51937a5a-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.365784 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.365739 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b158213c-397a-49d6-9b3c-9ebf51937a5a-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.371377 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.371352 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvbpk\" (UniqueName: \"kubernetes.io/projected/b158213c-397a-49d6-9b3c-9ebf51937a5a-kube-api-access-lvbpk\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf\" (UID: \"b158213c-397a-49d6-9b3c-9ebf51937a5a\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.408121 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.408081 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:43.573867 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.573842 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf"] May 21 14:47:43.575975 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:47:43.575945 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb158213c_397a_49d6_9b3c_9ebf51937a5a.slice/crio-e0e963cb4f98ffc1b3457d9ddd60216d82e18616c6efc498989cc41268e9f2f1 WatchSource:0}: Error finding container e0e963cb4f98ffc1b3457d9ddd60216d82e18616c6efc498989cc41268e9f2f1: Status 404 returned error can't find the container with id e0e963cb4f98ffc1b3457d9ddd60216d82e18616c6efc498989cc41268e9f2f1 May 21 14:47:43.641206 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:43.641166 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" event={"ID":"b158213c-397a-49d6-9b3c-9ebf51937a5a","Type":"ContainerStarted","Data":"e0e963cb4f98ffc1b3457d9ddd60216d82e18616c6efc498989cc41268e9f2f1"} May 21 14:47:50.674735 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:50.674696 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" event={"ID":"b158213c-397a-49d6-9b3c-9ebf51937a5a","Type":"ContainerStarted","Data":"d994596f8c8fdf5aa0aaf349b36904ebd5a5bc72b807d2cf3893bb6d6869b057"} May 21 14:47:56.697550 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:56.697513 2572 generic.go:358] "Generic (PLEG): container finished" podID="b158213c-397a-49d6-9b3c-9ebf51937a5a" containerID="d994596f8c8fdf5aa0aaf349b36904ebd5a5bc72b807d2cf3893bb6d6869b057" exitCode=0 May 21 14:47:56.697975 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:56.697547 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" event={"ID":"b158213c-397a-49d6-9b3c-9ebf51937a5a","Type":"ContainerDied","Data":"d994596f8c8fdf5aa0aaf349b36904ebd5a5bc72b807d2cf3893bb6d6869b057"} May 21 14:47:58.706624 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:58.706589 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" event={"ID":"b158213c-397a-49d6-9b3c-9ebf51937a5a","Type":"ContainerStarted","Data":"d9d4d984c23e7bd9dc3c5002db95bb56611451883c1253aecb962e748140baa6"} May 21 14:47:58.707066 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:58.706811 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:47:58.724840 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:47:58.724793 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" podStartSLOduration=1.236881352 podStartE2EDuration="15.72477823s" podCreationTimestamp="2026-05-21 14:47:43 +0000 UTC" firstStartedPulling="2026-05-21 14:47:43.577909019 +0000 UTC m=+583.554252481" lastFinishedPulling="2026-05-21 14:47:58.065805897 +0000 UTC m=+598.042149359" observedRunningTime="2026-05-21 14:47:58.72347637 +0000 UTC m=+598.699819863" watchObservedRunningTime="2026-05-21 14:47:58.72477823 +0000 UTC m=+598.701121707" May 21 14:48:00.572053 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:00.572024 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:48:00.575365 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:00.575333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:48:09.724023 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:09.723995 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf" May 21 14:48:20.693485 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.693398 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4"] May 21 14:48:20.724883 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.724845 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4"] May 21 14:48:20.725058 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.724983 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.727457 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.727435 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 14:48:20.893147 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.893107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.893147 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.893153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c664c809-bf17-4676-8e2f-0ae8bfc99587-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.893361 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.893221 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.893361 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.893269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g457\" (UniqueName: \"kubernetes.io/projected/c664c809-bf17-4676-8e2f-0ae8bfc99587-kube-api-access-8g457\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.893361 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.893308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.893477 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.893359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.994473 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994379 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.994473 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994421 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c664c809-bf17-4676-8e2f-0ae8bfc99587-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.994473 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994458 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.994696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994493 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g457\" (UniqueName: \"kubernetes.io/projected/c664c809-bf17-4676-8e2f-0ae8bfc99587-kube-api-access-8g457\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.994696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994538 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.994696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994659 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.995005 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994986 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.995087 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.994984 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.995142 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.995078 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.996728 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.996706 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c664c809-bf17-4676-8e2f-0ae8bfc99587-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:20.996991 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:20.996973 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c664c809-bf17-4676-8e2f-0ae8bfc99587-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:21.002779 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:21.002747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g457\" (UniqueName: \"kubernetes.io/projected/c664c809-bf17-4676-8e2f-0ae8bfc99587-kube-api-access-8g457\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4\" (UID: \"c664c809-bf17-4676-8e2f-0ae8bfc99587\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:21.034839 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:21.034801 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:21.174264 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:21.174240 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4"] May 21 14:48:21.176862 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:48:21.176828 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc664c809_bf17_4676_8e2f_0ae8bfc99587.slice/crio-cc292f0c60e6bd0f0367217c704cb37c6e884224b74ccf8186207abdabca857a WatchSource:0}: Error finding container cc292f0c60e6bd0f0367217c704cb37c6e884224b74ccf8186207abdabca857a: Status 404 returned error can't find the container with id cc292f0c60e6bd0f0367217c704cb37c6e884224b74ccf8186207abdabca857a May 21 14:48:21.792696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:21.792653 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" event={"ID":"c664c809-bf17-4676-8e2f-0ae8bfc99587","Type":"ContainerStarted","Data":"e51ed024a0cd607d800c069b0f26c3454cf33af72fe423b9218725a7cbc7687c"} May 21 14:48:21.792696 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:21.792702 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" event={"ID":"c664c809-bf17-4676-8e2f-0ae8bfc99587","Type":"ContainerStarted","Data":"cc292f0c60e6bd0f0367217c704cb37c6e884224b74ccf8186207abdabca857a"} May 21 14:48:26.810639 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:26.810607 2572 generic.go:358] "Generic (PLEG): container finished" podID="c664c809-bf17-4676-8e2f-0ae8bfc99587" containerID="e51ed024a0cd607d800c069b0f26c3454cf33af72fe423b9218725a7cbc7687c" exitCode=0 May 21 14:48:26.811122 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:26.810667 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" event={"ID":"c664c809-bf17-4676-8e2f-0ae8bfc99587","Type":"ContainerDied","Data":"e51ed024a0cd607d800c069b0f26c3454cf33af72fe423b9218725a7cbc7687c"} May 21 14:48:26.811423 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:26.811403 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:48:27.815336 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:27.815304 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" event={"ID":"c664c809-bf17-4676-8e2f-0ae8bfc99587","Type":"ContainerStarted","Data":"076102f3ccfa2b1ca80b31acef50e58f7f70c1dcce03d679b3637d7e126a6144"} May 21 14:48:27.815694 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:27.815515 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:27.833175 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:27.833133 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" podStartSLOduration=7.519454 podStartE2EDuration="7.833120077s" podCreationTimestamp="2026-05-21 14:48:20 +0000 UTC" firstStartedPulling="2026-05-21 14:48:26.811550969 +0000 UTC m=+626.787894429" lastFinishedPulling="2026-05-21 14:48:27.125217033 +0000 UTC m=+627.101560506" observedRunningTime="2026-05-21 14:48:27.83116093 +0000 UTC m=+627.807504408" watchObservedRunningTime="2026-05-21 14:48:27.833120077 +0000 UTC m=+627.809463559" May 21 14:48:32.097337 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.097299 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm"] May 21 14:48:32.103966 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.103946 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.106080 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.106057 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 14:48:32.110644 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.110621 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm"] May 21 14:48:32.188134 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.188098 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.188134 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.188136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.188326 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.188179 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.188326 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.188207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8160e52b-8c94-48e6-b045-dea0e84bda1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.188326 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.188229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvm4\" (UniqueName: \"kubernetes.io/projected/8160e52b-8c94-48e6-b045-dea0e84bda1e-kube-api-access-4fvm4\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.188326 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.188315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.288805 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.288741 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.288973 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.288844 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.288973 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.288863 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.288973 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.288891 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.288973 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.288908 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8160e52b-8c94-48e6-b045-dea0e84bda1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.289197 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.289126 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvm4\" (UniqueName: \"kubernetes.io/projected/8160e52b-8c94-48e6-b045-dea0e84bda1e-kube-api-access-4fvm4\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.289256 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.289190 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.289256 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.289209 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.289347 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.289330 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.291248 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.291219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8160e52b-8c94-48e6-b045-dea0e84bda1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.291616 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.291596 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8160e52b-8c94-48e6-b045-dea0e84bda1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.299513 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.299491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvm4\" (UniqueName: \"kubernetes.io/projected/8160e52b-8c94-48e6-b045-dea0e84bda1e-kube-api-access-4fvm4\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-96vpm\" (UID: \"8160e52b-8c94-48e6-b045-dea0e84bda1e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.415477 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.415440 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:32.550496 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.550461 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm"] May 21 14:48:32.553570 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:48:32.553341 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8160e52b_8c94_48e6_b045_dea0e84bda1e.slice/crio-408b250fd57bec9f52801e587e13078b8eb11f19e4fd3a42b0a31d86b9195a7a WatchSource:0}: Error finding container 408b250fd57bec9f52801e587e13078b8eb11f19e4fd3a42b0a31d86b9195a7a: Status 404 returned error can't find the container with id 408b250fd57bec9f52801e587e13078b8eb11f19e4fd3a42b0a31d86b9195a7a May 21 14:48:32.840576 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.840482 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" event={"ID":"8160e52b-8c94-48e6-b045-dea0e84bda1e","Type":"ContainerStarted","Data":"ab20fcea59fa2b8244277ab0c2507b19eb1485fd56d396f6247311448ec31d05"} May 21 14:48:32.840576 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:32.840536 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" event={"ID":"8160e52b-8c94-48e6-b045-dea0e84bda1e","Type":"ContainerStarted","Data":"408b250fd57bec9f52801e587e13078b8eb11f19e4fd3a42b0a31d86b9195a7a"} May 21 14:48:38.832241 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:38.832201 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4" May 21 14:48:38.866047 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:38.866015 2572 generic.go:358] "Generic (PLEG): container finished" podID="8160e52b-8c94-48e6-b045-dea0e84bda1e" containerID="ab20fcea59fa2b8244277ab0c2507b19eb1485fd56d396f6247311448ec31d05" exitCode=0 May 21 14:48:38.866199 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:38.866074 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" event={"ID":"8160e52b-8c94-48e6-b045-dea0e84bda1e","Type":"ContainerDied","Data":"ab20fcea59fa2b8244277ab0c2507b19eb1485fd56d396f6247311448ec31d05"} May 21 14:48:39.871161 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:39.871130 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" event={"ID":"8160e52b-8c94-48e6-b045-dea0e84bda1e","Type":"ContainerStarted","Data":"fbdd7607e41fe8d3917c3cdfdf77899a22dd07f08e2b42af6d16f1c332da9810"} May 21 14:48:39.871557 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:39.871353 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:48:39.889937 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:39.889882 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" podStartSLOduration=7.513890072 podStartE2EDuration="7.889869092s" podCreationTimestamp="2026-05-21 14:48:32 +0000 UTC" firstStartedPulling="2026-05-21 14:48:38.86709817 +0000 UTC m=+638.843441648" lastFinishedPulling="2026-05-21 14:48:39.243077196 +0000 UTC m=+639.219420668" observedRunningTime="2026-05-21 14:48:39.887447595 +0000 UTC m=+639.863791075" watchObservedRunningTime="2026-05-21 14:48:39.889869092 +0000 UTC m=+639.866212573" May 21 14:48:50.887860 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:48:50.887825 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-96vpm" May 21 14:50:33.080125 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.080084 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65595d7c68-b4grl"] May 21 14:50:33.080674 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.080351 2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-65595d7c68-b4grl" podUID="a0156ded-575d-46d9-9703-59fd16bb1013" containerName="manager" containerID="cri-o://bb1f19c216b1971fb68e64aae0346d2937c61bff3ed3a71fd24497b0a2f24493" gracePeriod=30 May 21 14:50:33.261420 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.261386 2572 generic.go:358] "Generic (PLEG): container finished" podID="a0156ded-575d-46d9-9703-59fd16bb1013" containerID="bb1f19c216b1971fb68e64aae0346d2937c61bff3ed3a71fd24497b0a2f24493" exitCode=0 May 21 14:50:33.261543 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.261454 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65595d7c68-b4grl" event={"ID":"a0156ded-575d-46d9-9703-59fd16bb1013","Type":"ContainerDied","Data":"bb1f19c216b1971fb68e64aae0346d2937c61bff3ed3a71fd24497b0a2f24493"} May 21 14:50:33.333162 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.333106 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:50:33.436553 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.436525 2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4wnk\" (UniqueName: \"kubernetes.io/projected/a0156ded-575d-46d9-9703-59fd16bb1013-kube-api-access-q4wnk\") pod \"a0156ded-575d-46d9-9703-59fd16bb1013\" (UID: \"a0156ded-575d-46d9-9703-59fd16bb1013\") " May 21 14:50:33.438532 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.438510 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0156ded-575d-46d9-9703-59fd16bb1013-kube-api-access-q4wnk" (OuterVolumeSpecName: "kube-api-access-q4wnk") pod "a0156ded-575d-46d9-9703-59fd16bb1013" (UID: "a0156ded-575d-46d9-9703-59fd16bb1013"). InnerVolumeSpecName "kube-api-access-q4wnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 14:50:33.537362 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:33.537329 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4wnk\" (UniqueName: \"kubernetes.io/projected/a0156ded-575d-46d9-9703-59fd16bb1013-kube-api-access-q4wnk\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\"" May 21 14:50:34.266329 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:34.266301 2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65595d7c68-b4grl" May 21 14:50:34.266777 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:34.266300 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65595d7c68-b4grl" event={"ID":"a0156ded-575d-46d9-9703-59fd16bb1013","Type":"ContainerDied","Data":"1edba6c4a482317dd1b02058e5dde86759d30f9d73d4897e66990be7136e96d1"} May 21 14:50:34.266777 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:34.266414 2572 scope.go:117] "RemoveContainer" containerID="bb1f19c216b1971fb68e64aae0346d2937c61bff3ed3a71fd24497b0a2f24493" May 21 14:50:34.286722 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:34.286692 2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65595d7c68-b4grl"] May 21 14:50:34.290019 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:34.289992 2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65595d7c68-b4grl"] May 21 14:50:34.664806 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:34.664741 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0156ded-575d-46d9-9703-59fd16bb1013" path="/var/lib/kubelet/pods/a0156ded-575d-46d9-9703-59fd16bb1013/volumes" May 21 14:50:35.026695 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.026617 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65595d7c68-5fb5v"] May 21 14:50:35.027008 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.026995 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0156ded-575d-46d9-9703-59fd16bb1013" containerName="manager" May 21 14:50:35.027054 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.027010 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0156ded-575d-46d9-9703-59fd16bb1013" containerName="manager" May 21 14:50:35.027085 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.027068 2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0156ded-575d-46d9-9703-59fd16bb1013" containerName="manager" May 21 14:50:35.031884 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.031863 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:50:35.033960 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.033934 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bvd4q\"" May 21 14:50:35.036040 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.036019 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65595d7c68-5fb5v"] May 21 14:50:35.150701 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.150671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vql76\" (UniqueName: \"kubernetes.io/projected/7f2aa137-0a1a-4f46-9236-295251c43619-kube-api-access-vql76\") pod \"maas-controller-65595d7c68-5fb5v\" (UID: \"7f2aa137-0a1a-4f46-9236-295251c43619\") " pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:50:35.251649 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.251613 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vql76\" (UniqueName: \"kubernetes.io/projected/7f2aa137-0a1a-4f46-9236-295251c43619-kube-api-access-vql76\") pod \"maas-controller-65595d7c68-5fb5v\" (UID: \"7f2aa137-0a1a-4f46-9236-295251c43619\") " pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:50:35.259002 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.258980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vql76\" (UniqueName: \"kubernetes.io/projected/7f2aa137-0a1a-4f46-9236-295251c43619-kube-api-access-vql76\") pod \"maas-controller-65595d7c68-5fb5v\" (UID: \"7f2aa137-0a1a-4f46-9236-295251c43619\") " pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:50:35.342821 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.342730 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:50:35.469911 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:35.469887 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65595d7c68-5fb5v"] May 21 14:50:35.471953 ip-10-0-129-1 kubenswrapper[2572]: W0521 14:50:35.471924 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2aa137_0a1a_4f46_9236_295251c43619.slice/crio-9be90cece13cc15a0d4c4d1ddb5e33895df17b976c66888c777de192bc33a2e0 WatchSource:0}: Error finding container 9be90cece13cc15a0d4c4d1ddb5e33895df17b976c66888c777de192bc33a2e0: Status 404 returned error can't find the container with id 9be90cece13cc15a0d4c4d1ddb5e33895df17b976c66888c777de192bc33a2e0 May 21 14:50:36.274791 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:36.274675 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65595d7c68-5fb5v" event={"ID":"7f2aa137-0a1a-4f46-9236-295251c43619","Type":"ContainerStarted","Data":"61dd65d25a2c9aa1a5d707087e7b1ba7abead39266231f6c41fcd52e41fcc4e2"} May 21 14:50:36.274791 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:36.274716 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65595d7c68-5fb5v" event={"ID":"7f2aa137-0a1a-4f46-9236-295251c43619","Type":"ContainerStarted","Data":"9be90cece13cc15a0d4c4d1ddb5e33895df17b976c66888c777de192bc33a2e0"} May 21 14:50:36.274791 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:36.274776 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:50:36.291801 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:36.291735 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-65595d7c68-5fb5v" podStartSLOduration=0.885698874 podStartE2EDuration="1.291719633s" podCreationTimestamp="2026-05-21 14:50:35 +0000 UTC" firstStartedPulling="2026-05-21 14:50:35.47322303 +0000 UTC m=+755.449566488" lastFinishedPulling="2026-05-21 14:50:35.879243785 +0000 UTC m=+755.855587247" observedRunningTime="2026-05-21 14:50:36.291133155 +0000 UTC m=+756.267476640" watchObservedRunningTime="2026-05-21 14:50:36.291719633 +0000 UTC m=+756.268063164" May 21 14:50:47.284420 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:50:47.284388 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65595d7c68-5fb5v" May 21 14:53:00.599589 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:53:00.599504 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:53:00.604688 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:53:00.604659 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:58:00.624398 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:58:00.624367 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 14:58:00.630382 ip-10-0-129-1 kubenswrapper[2572]: I0521 14:58:00.630358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 15:03:00.654877 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:03:00.654850 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 15:03:00.660838 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:03:00.660814 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 15:08:00.678856 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:08:00.678826 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 15:08:00.686678 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:08:00.686658 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 15:11:45.057396 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:45.057358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-mcb5r_e3919f92-62e2-47e7-ac6b-956e00d506e3/manager/0.log" May 21 15:11:45.199770 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:45.199729 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69b654c78c-q79ml_fb56558f-5829-483d-b868-4dd5426b6b50/maas-api/0.log" May 21 15:11:45.463327 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:45.463295 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65595d7c68-5fb5v_7f2aa137-0a1a-4f46-9236-295251c43619/manager/0.log" May 21 15:11:45.587413 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:45.587375 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-wrpnd_12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4/manager/2.log" May 21 15:11:45.844625 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:45.844546 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d8b6f58-ht2j6_08b714ca-6369-4655-ada0-7212da161163/manager/0.log" May 21 15:11:46.081812 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:46.081780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qwvr7_88eff955-38b4-46f8-9794-3021ae8612ea/postgres/0.log" May 21 15:11:47.523923 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:47.523889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-wxzw6_f920844c-b7ac-40d1-a294-5910b9aad6f7/manager/0.log" May 21 15:11:47.630413 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:47.630384 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-mtvzx_e1217ae8-05ed-4203-b2e1-5f2310a9c058/manager/0.log" May 21 15:11:48.674306 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:48.674272 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-h7zsh_e5e80560-91b9-4325-aea6-9706c339531d/discovery/0.log" May 21 15:11:48.906636 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:48.906601 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f8585948-vbf6m_54130316-4340-4aaa-b0d0-fa8e2cbe76ba/kube-auth-proxy/0.log" May 21 15:11:49.179787 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.179728 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fwpd9_9fe32c92-7aba-4f76-93e8-d946987621a5/payload-processing/0.log" May 21 15:11:49.750838 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.750805 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf_b158213c-397a-49d6-9b3c-9ebf51937a5a/storage-initializer/0.log" May 21 15:11:49.758905 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.758879 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-lpkmf_b158213c-397a-49d6-9b3c-9ebf51937a5a/main/0.log" May 21 15:11:49.867808 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.867774 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-96vpm_8160e52b-8c94-48e6-b045-dea0e84bda1e/storage-initializer/0.log" May 21 15:11:49.875477 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.875453 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-96vpm_8160e52b-8c94-48e6-b045-dea0e84bda1e/main/0.log" May 21 15:11:49.986502 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.986468 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4_c664c809-bf17-4676-8e2f-0ae8bfc99587/storage-initializer/0.log" May 21 15:11:49.994081 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:49.994046 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcch5wf4_c664c809-bf17-4676-8e2f-0ae8bfc99587/main/0.log" May 21 15:11:57.687569 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:57.687517 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hjv2b_e15a5dca-468f-4b8c-b0d9-980a5e54998a/global-pull-secret-syncer/0.log" May 21 15:11:57.818221 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:57.818143 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dtwlc_e0373704-51d6-4a6b-a388-862406573a2a/konnectivity-agent/0.log" May 21 15:11:57.872114 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:11:57.872074 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-1.ec2.internal_3c5b17db4b61eb5d387ece2607db7785/haproxy/0.log" May 21 15:12:01.641544 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:01.641509 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-wxzw6_f920844c-b7ac-40d1-a294-5910b9aad6f7/manager/0.log" May 21 15:12:01.665408 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:01.665379 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-mtvzx_e1217ae8-05ed-4203-b2e1-5f2310a9c058/manager/0.log" May 21 15:12:03.482389 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:03.482356 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngj95_f2682372-3bbe-457a-90ee-3d185893f1aa/node-exporter/0.log" May 21 15:12:03.506247 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:03.506222 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngj95_f2682372-3bbe-457a-90ee-3d185893f1aa/kube-rbac-proxy/0.log" May 21 15:12:03.538379 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:03.538358 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ngj95_f2682372-3bbe-457a-90ee-3d185893f1aa/init-textfile/0.log" May 21 15:12:05.444768 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:05.444710 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-blsvd_340fcef8-b371-4749-b30c-8d588a4a6403/networking-console-plugin/0.log" May 21 15:12:05.984349 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:05.984321 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/1.log" May 21 15:12:05.994469 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:05.994435 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rqlt4_bfabbbdb-f7d2-4907-aebf-228c094a214f/console-operator/2.log" May 21 15:12:06.397130 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.397091 2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt"] May 21 15:12:06.400093 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.400079 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.402638 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.402617 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6k557\"/\"openshift-service-ca.crt\"" May 21 15:12:06.403040 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.403022 2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6k557\"/\"default-dockercfg-mwmkf\"" May 21 15:12:06.403147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.403039 2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6k557\"/\"kube-root-ca.crt\"" May 21 15:12:06.407011 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.406981 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt"] May 21 15:12:06.540711 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.540681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-sys\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.541147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.540747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-proc\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.541147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.540822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-podres\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.541147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.540912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-lib-modules\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.541147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.540951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qpp\" (UniqueName: \"kubernetes.io/projected/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-kube-api-access-r5qpp\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.641830 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.641793 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-podres\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.641995 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.641858 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-lib-modules\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.641995 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.641881 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qpp\" (UniqueName: \"kubernetes.io/projected/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-kube-api-access-r5qpp\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.641995 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.641917 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-sys\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.641995 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.641958 2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-proc\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.641995 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.641960 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-podres\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.642154 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.642025 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-lib-modules\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.642154 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.642034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-sys\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.642154 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.642051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-proc\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.650190 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.650128 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qpp\" (UniqueName: \"kubernetes.io/projected/e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5-kube-api-access-r5qpp\") pod \"perf-node-gather-daemonset-mzxvt\" (UID: \"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5\") " pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.711314 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.711275 2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:06.841802 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.841777 2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt"] May 21 15:12:06.843886 ip-10-0-129-1 kubenswrapper[2572]: W0521 15:12:06.843863 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode60b4aa9_220c_4445_b4e2_0bd1e2a54ac5.slice/crio-31a2bc4d83828ffdd6bcd7717413983357899d7fd20ff4be92d2eb8272c3be05 WatchSource:0}: Error finding container 31a2bc4d83828ffdd6bcd7717413983357899d7fd20ff4be92d2eb8272c3be05: Status 404 returned error can't find the container with id 31a2bc4d83828ffdd6bcd7717413983357899d7fd20ff4be92d2eb8272c3be05 May 21 15:12:06.845346 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:06.845331 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:12:07.030587 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.030552 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-tzwbj_335ea2a0-a7a0-4814-b032-461ed3fed85d/volume-data-source-validator/0.log" May 21 15:12:07.739602 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.739567 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" event={"ID":"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5","Type":"ContainerStarted","Data":"4ecae7798f4b60323fba9a9e172638f8d9c3bd040d9b36bc2ce0ddbce802e2f4"} May 21 15:12:07.739602 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.739603 2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" event={"ID":"e60b4aa9-220c-4445-b4e2-0bd1e2a54ac5","Type":"ContainerStarted","Data":"31a2bc4d83828ffdd6bcd7717413983357899d7fd20ff4be92d2eb8272c3be05"} May 21 15:12:07.740063 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.739704 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:07.756685 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.756624 2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" podStartSLOduration=1.756609831 podStartE2EDuration="1.756609831s" podCreationTimestamp="2026-05-21 15:12:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:12:07.754616606 +0000 UTC m=+2047.730960086" watchObservedRunningTime="2026-05-21 15:12:07.756609831 +0000 UTC m=+2047.732953312" May 21 15:12:07.915273 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.915233 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c2fdl_9e62a23a-6e74-4181-a37b-7404a0095596/dns/0.log" May 21 15:12:07.935911 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:07.935875 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c2fdl_9e62a23a-6e74-4181-a37b-7404a0095596/kube-rbac-proxy/0.log" May 21 15:12:08.006645 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:08.006554 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7hrr5_ee53d69f-8bed-4661-a837-fca3fd43ab2d/dns-node-resolver/0.log" May 21 15:12:08.583645 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:08.583610 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9st7g_a4d0dfb2-f250-44a9-9615-4073f948685c/node-ca/0.log" May 21 15:12:09.500436 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:09.500405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-h7zsh_e5e80560-91b9-4325-aea6-9706c339531d/discovery/0.log" May 21 15:12:09.547633 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:09.547597 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f8585948-vbf6m_54130316-4340-4aaa-b0d0-fa8e2cbe76ba/kube-auth-proxy/0.log" May 21 15:12:09.693313 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:09.693284 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fwpd9_9fe32c92-7aba-4f76-93e8-d946987621a5/payload-processing/0.log" May 21 15:12:10.220221 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:10.220190 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cjn7j_3aa6d295-1eab-4aaf-9496-06b72212e484/serve-healthcheck-canary/0.log" May 21 15:12:10.777644 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:10.777615 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mndnd_b488757b-8675-404c-83a2-9f9f2af0e079/kube-rbac-proxy/0.log" May 21 15:12:10.798225 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:10.798199 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mndnd_b488757b-8675-404c-83a2-9f9f2af0e079/exporter/0.log" May 21 15:12:10.820790 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:10.820746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mndnd_b488757b-8675-404c-83a2-9f9f2af0e079/extractor/0.log" May 21 15:12:12.755322 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:12.755286 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-mcb5r_e3919f92-62e2-47e7-ac6b-956e00d506e3/manager/0.log" May 21 15:12:12.802734 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:12.802664 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69b654c78c-q79ml_fb56558f-5829-483d-b868-4dd5426b6b50/maas-api/0.log" May 21 15:12:12.941129 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:12.941101 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65595d7c68-5fb5v_7f2aa137-0a1a-4f46-9236-295251c43619/manager/0.log" May 21 15:12:12.962142 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:12.962113 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-wrpnd_12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4/manager/1.log" May 21 15:12:12.985497 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:12.985464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-wrpnd_12cfe2aa-eff0-4bdc-b2f1-d95c1cca5ab4/manager/2.log" May 21 15:12:13.063035 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:13.062952 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d8b6f58-ht2j6_08b714ca-6369-4655-ada0-7212da161163/manager/0.log" May 21 15:12:13.112896 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:13.112868 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qwvr7_88eff955-38b4-46f8-9794-3021ae8612ea/postgres/0.log" May 21 15:12:13.753147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:13.753117 2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6k557/perf-node-gather-daemonset-mzxvt" May 21 15:12:18.966450 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:18.966415 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kns25_977808ec-b508-4551-abe3-3e131dd869ac/kube-storage-version-migrator-operator/1.log" May 21 15:12:18.968147 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:18.968125 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-kns25_977808ec-b508-4551-abe3-3e131dd869ac/kube-storage-version-migrator-operator/0.log" May 21 15:12:20.022811 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.022781 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6ckwn_a14260e7-302c-4a4a-8dda-71e933043038/kube-multus/0.log" May 21 15:12:20.365330 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.365260 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/kube-multus-additional-cni-plugins/0.log" May 21 15:12:20.388949 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.388922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/egress-router-binary-copy/0.log" May 21 15:12:20.409416 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.409392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/cni-plugins/0.log" May 21 15:12:20.430156 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.430133 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/bond-cni-plugin/0.log" May 21 15:12:20.453050 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.453032 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/routeoverride-cni/0.log" May 21 15:12:20.476037 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.476018 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/whereabouts-cni-bincopy/0.log" May 21 15:12:20.497720 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.497697 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wd44n_01a70833-6459-41f6-9abc-47fe11629e33/whereabouts-cni/0.log" May 21 15:12:20.582495 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.582456 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lgcw_5d32dc8d-e310-47db-be24-075dad49de57/network-metrics-daemon/0.log" May 21 15:12:20.601643 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:20.601618 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2lgcw_5d32dc8d-e310-47db-be24-075dad49de57/kube-rbac-proxy/0.log" May 21 15:12:21.799256 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.799220 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/ovn-controller/0.log" May 21 15:12:21.834262 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.834222 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/ovn-acl-logging/0.log" May 21 15:12:21.855597 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.855570 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/kube-rbac-proxy-node/0.log" May 21 15:12:21.877796 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.877746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:12:21.895911 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.895877 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/northd/0.log" May 21 15:12:21.916414 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.916379 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/nbdb/0.log" May 21 15:12:21.937517 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:21.937446 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/sbdb/0.log" May 21 15:12:22.101182 ip-10-0-129-1 kubenswrapper[2572]: I0521 15:12:22.101148 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-64v5f_5e551bf2-bd2f-4d36-9f0c-384e0e7380b9/ovnkube-controller/0.log"