Jun 03 16:33:58.477322 ip-10-0-142-172 systemd[1]: Starting Kubernetes Kubelet... Jun 03 16:33:58.879633 ip-10-0-142-172 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:33:58.879633 ip-10-0-142-172 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 16:33:58.879633 ip-10-0-142-172 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:33:58.879633 ip-10-0-142-172 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 16:33:58.879633 ip-10-0-142-172 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:33:58.880369 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.880278 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 16:33:58.884447 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884430 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:58.884447 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884447 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884450 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884455 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884458 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884461 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884465 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884467 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884470 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884474 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884476 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884480 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884483 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884485 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884488 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884491 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884493 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884496 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884499 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884501 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884504 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:58.884512 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884507 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884509 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884512 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884515 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884517 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884520 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884523 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884526 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884529 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884532 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884535 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884537 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884540 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884543 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884545 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884548 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884550 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884553 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884556 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884560 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:58.885005 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884562 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884565 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884567 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884570 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884572 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884575 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884577 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884580 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884582 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884584 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884589 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884592 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884595 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884598 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884601 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884604 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884607 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884610 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884613 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884615 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:58.885489 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884618 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884620 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884623 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884626 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884629 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884631 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884634 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884637 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884640 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884642 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884644 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884647 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884651 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884654 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884656 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884659 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884662 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884664 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884667 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:58.885965 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884669 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884672 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884675 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884677 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884680 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.884682 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885117 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885124 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885127 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885131 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885134 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885138 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885142 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885146 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885149 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885152 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885155 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885158 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885162 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:58.886442 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885165 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885168 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885171 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885174 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885177 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885179 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885182 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885185 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885187 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885190 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885192 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885195 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885197 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885200 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885202 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885205 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885207 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885210 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885212 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885215 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:58.886899 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885218 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885221 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885224 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885226 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885229 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885231 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885233 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885236 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885238 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885241 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885243 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885246 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885249 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885251 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885254 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885257 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885259 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885261 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885264 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885266 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:58.887441 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885269 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885271 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885273 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885276 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885279 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885281 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885283 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885286 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885289 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885292 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885295 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885297 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885300 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885304 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885306 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885309 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885312 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885314 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885317 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885319 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:58.887935 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885322 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885324 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885327 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885329 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885332 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885335 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885338 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885341 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885343 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885346 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885348 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885351 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.885353 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886345 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886356 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886364 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886369 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886373 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886377 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886381 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886385 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 16:33:58.888505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886389 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886392 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886395 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886399 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886402 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886405 2574 flags.go:64] FLAG: --cgroup-root="" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886408 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886411 2574 flags.go:64] FLAG: --client-ca-file="" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886414 2574 flags.go:64] FLAG: --cloud-config="" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886417 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886420 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886424 2574 flags.go:64] FLAG: --cluster-domain="" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886427 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886430 2574 flags.go:64] FLAG: --config-dir="" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886433 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886436 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886440 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886444 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886447 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886450 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886453 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886456 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886459 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886463 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886466 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 16:33:58.889040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886471 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886474 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886477 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886480 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886483 2574 flags.go:64] FLAG: --enable-server="true" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886486 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886491 2574 flags.go:64] FLAG: --event-burst="100" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886494 2574 flags.go:64] FLAG: --event-qps="50" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886497 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886500 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886504 2574 flags.go:64] FLAG: --eviction-hard="" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886507 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886510 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886513 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886516 2574 flags.go:64] FLAG: --eviction-soft="" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886519 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886522 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886524 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886527 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886530 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886533 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886536 2574 flags.go:64] FLAG: --feature-gates="" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886540 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886543 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886546 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 16:33:58.889644 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886549 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886552 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886555 2574 flags.go:64] FLAG: --help="false" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886558 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-172.ec2.internal" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886561 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886564 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886567 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886573 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886576 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886579 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886583 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886586 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886589 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886592 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886595 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886598 2574 flags.go:64] FLAG: --kube-reserved="" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886601 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886604 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886607 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886610 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886613 2574 flags.go:64] FLAG: --lock-file="" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886616 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886619 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886621 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 16:33:58.890257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886627 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886630 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886633 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886636 2574 flags.go:64] FLAG: --logging-format="text" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886639 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886642 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886645 2574 flags.go:64] FLAG: --manifest-url="" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886648 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886652 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886656 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886660 2574 flags.go:64] FLAG: --max-pods="110" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886663 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886667 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886670 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886673 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886677 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886680 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886683 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886691 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886695 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886698 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886701 2574 flags.go:64] FLAG: --pod-cidr="" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886704 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 16:33:58.890833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886710 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886713 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886716 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886719 2574 flags.go:64] FLAG: --port="10250" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886722 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886726 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076d0875fbb3d3212" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886729 2574 flags.go:64] FLAG: --qos-reserved="" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886732 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886735 2574 flags.go:64] FLAG: --register-node="true" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886738 2574 flags.go:64] FLAG: --register-schedulable="true" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886741 2574 flags.go:64] FLAG: --register-with-taints="" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886745 2574 flags.go:64] FLAG: --registry-burst="10" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886747 2574 flags.go:64] FLAG: --registry-qps="5" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886750 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886753 2574 flags.go:64] FLAG: --reserved-memory="" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886757 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886760 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886763 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886766 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886769 2574 flags.go:64] FLAG: --runonce="false" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886772 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886775 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886778 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886781 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886785 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886788 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 16:33:58.891392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886791 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886795 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886797 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886800 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886803 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886806 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886809 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886812 2574 flags.go:64] FLAG: --system-cgroups="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886814 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886820 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886823 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886826 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886830 2574 flags.go:64] FLAG: --tls-min-version="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886832 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886835 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886838 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886841 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886844 2574 flags.go:64] FLAG: --v="2" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886848 2574 flags.go:64] FLAG: --version="false" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886852 2574 flags.go:64] FLAG: --vmodule="" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886856 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.886859 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886957 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886960 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886963 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:58.892038 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886966 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886984 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886986 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886989 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886992 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886996 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.886998 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887001 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887007 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887009 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887012 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887014 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887017 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887019 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887022 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887025 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887027 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887030 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887032 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887035 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:58.892663 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887037 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887040 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887043 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887045 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887048 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887050 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887052 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887055 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887057 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887060 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887062 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887065 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887068 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887070 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887073 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887076 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887079 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887082 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887085 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887087 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:58.893190 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887091 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887094 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887096 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887099 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887102 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887104 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887106 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887109 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887112 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887115 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887118 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887120 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887123 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887126 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887128 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887131 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887133 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887137 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887141 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:58.893675 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887145 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887149 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887152 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887155 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887158 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887161 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887163 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887166 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887174 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887177 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887181 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887183 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887185 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887189 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887192 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887195 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887198 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887201 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887203 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:58.894205 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887206 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887208 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887211 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887214 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.887217 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.887801 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.894024 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.894039 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894097 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894103 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894106 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894109 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894111 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894114 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894116 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:58.894669 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894119 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894122 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894125 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894128 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894130 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894133 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894137 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894140 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894143 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894146 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894149 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894151 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894156 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894160 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894163 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894166 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894169 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894172 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894175 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894178 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:58.895059 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894180 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894183 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894185 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894188 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894191 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894194 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894196 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894199 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894201 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894204 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894207 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894209 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894212 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894215 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894217 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894220 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894223 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894225 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894228 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:58.895544 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894231 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894234 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894237 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894239 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894242 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894245 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894247 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894250 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894253 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894257 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894260 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894263 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894265 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894268 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894271 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894273 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894276 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894278 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894281 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894283 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:58.896064 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894286 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894288 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894291 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894293 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894296 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894298 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894301 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894303 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894306 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894308 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894311 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894313 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894316 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894319 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894322 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894324 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894327 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894330 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894332 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:58.896558 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894335 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.894340 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894441 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894445 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894448 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894452 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894456 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894460 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894462 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894465 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894468 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894470 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894473 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894475 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894478 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:33:58.897087 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894480 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894483 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894485 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894488 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894490 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894493 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894495 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894498 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894501 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894503 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894506 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894508 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894512 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894515 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894517 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894520 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894522 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894525 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894527 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:33:58.897450 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894531 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894534 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894537 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894541 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894543 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894546 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894548 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894550 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894553 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894556 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894558 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894560 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894563 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894565 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894568 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894570 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894572 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894575 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894577 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894580 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:33:58.897918 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894582 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894585 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894587 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894591 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894593 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894596 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894599 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894602 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894604 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894606 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894609 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894611 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894614 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894616 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894619 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894621 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894624 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894627 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894629 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894631 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:33:58.898425 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894634 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894636 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894639 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894642 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894644 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894647 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894649 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894652 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894654 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894656 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894659 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894662 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894664 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:33:58.894669 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.894674 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:33:58.898915 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.895295 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 16:33:58.899337 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.897196 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 16:33:58.899337 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.898446 2574 server.go:1019] "Starting client certificate rotation" Jun 03 16:33:58.899337 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.898553 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:33:58.899337 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.899296 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:33:58.920544 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.920521 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:33:58.922248 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.922220 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:33:58.939010 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.938970 2574 log.go:25] "Validated CRI v1 runtime API" Jun 03 16:33:58.944142 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.944122 2574 log.go:25] "Validated CRI v1 image API" Jun 03 16:33:58.945413 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.945377 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 16:33:58.946712 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.946694 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:33:58.949234 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.949204 2574 fs.go:135] Filesystem UUIDs: map[4b522443-5bea-420a-b43f-bc9815a1b47e:/dev/nvme0n1p3 5cfb9dfa-2302-439e-aa00-2f4f12236e10:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 03 16:33:58.949311 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.949233 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 16:33:58.953871 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.953750 2574 manager.go:217] Machine: {Timestamp:2026-06-03 16:33:58.953223857 +0000 UTC m=+0.367120630 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113592 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27eaf41690b36979be64a3d079b14f SystemUUID:ec27eaf4-1690-b369-79be-64a3d079b14f BootID:48f5f351-ad89-4a50-a363-f58df5a00be2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:f2:ce:89:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:f2:ce:89:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:e6:9f:11:1c:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 16:33:58.954441 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.954429 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 16:33:58.954536 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.954523 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 16:33:58.957450 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.957413 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 16:33:58.957604 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.957453 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 16:33:58.957652 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.957614 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 16:33:58.957652 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.957623 2574 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 16:33:58.957652 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.957630 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:33:58.958509 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.958498 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:33:58.959338 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.959327 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:33:58.959468 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.959459 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 16:33:58.961370 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.961360 2574 kubelet.go:491] "Attempting to sync node with API server" Jun 03 16:33:58.961417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.961376 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 16:33:58.961417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.961391 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 16:33:58.961417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.961401 2574 kubelet.go:397] "Adding apiserver pod source" Jun 03 16:33:58.961417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.961410 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 16:33:58.962480 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.962465 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:33:58.962519 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.962492 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:33:58.965729 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.965710 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 16:33:58.970067 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.970043 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 16:33:58.972282 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972263 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 16:33:58.972282 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972284 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972290 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972296 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972305 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972311 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972318 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972323 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972330 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972337 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972356 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 16:33:58.972401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.972362 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 16:33:58.973148 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.973137 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 16:33:58.973148 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.973147 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 16:33:58.976090 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.976064 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 16:33:58.976090 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.976064 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 16:33:58.976703 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.976690 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 16:33:58.976742 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.976729 2574 server.go:1295] "Started kubelet" Jun 03 16:33:58.976811 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.976787 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 16:33:58.976887 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.976822 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 16:33:58.976941 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.976915 2574 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 16:33:58.977649 ip-10-0-142-172 systemd[1]: Started Kubernetes Kubelet. Jun 03 16:33:58.978068 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.978054 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 16:33:58.979349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.979334 2574 server.go:317] "Adding debug handlers to kubelet server" Jun 03 16:33:58.984863 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.984841 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 16:33:58.985310 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.985295 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 16:33:58.985437 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.985411 2574 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 16:33:58.985499 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.985440 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 16:33:58.985552 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.985508 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 16:33:58.985724 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.985660 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 03 16:33:58.985724 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.985673 2574 reconciler.go:26] "Reconciler: start to sync state" Jun 03 16:33:58.986062 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.986042 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hlsx6" Jun 03 16:33:58.986263 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.986239 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:58.987263 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987093 2574 factory.go:55] Registering systemd factory Jun 03 16:33:58.987341 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987302 2574 factory.go:223] Registration of the systemd container factory successfully Jun 03 16:33:58.987341 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987131 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 16:33:58.987575 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987559 2574 factory.go:153] Registering CRI-O factory Jun 03 16:33:58.987575 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987575 2574 factory.go:223] Registration of the crio container factory successfully Jun 03 16:33:58.987699 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987670 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 16:33:58.987699 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987693 2574 factory.go:103] Registering Raw factory Jun 03 16:33:58.987791 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.987709 2574 manager.go:1196] Started watching for new ooms in manager Jun 03 16:33:58.988042 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.988017 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 16:33:58.988139 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.987132 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-172.ec2.internal.18b59f5a8e367052 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-172.ec2.internal,UID:ip-10-0-142-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-172.ec2.internal,},FirstTimestamp:2026-06-03 16:33:58.976704594 +0000 UTC m=+0.390601367,LastTimestamp:2026-06-03 16:33:58.976704594 +0000 UTC m=+0.390601367,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-172.ec2.internal,}" Jun 03 16:33:58.988530 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.988499 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 16:33:58.988530 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:58.988502 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 16:33:58.988674 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.988546 2574 manager.go:319] Starting recovery of all containers Jun 03 16:33:58.993492 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.993466 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hlsx6" Jun 03 16:33:58.998777 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:58.998755 2574 manager.go:324] Recovery completed Jun 03 16:33:59.000743 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.000725 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 16:33:59.003561 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.003550 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:59.005514 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.005496 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:59.005578 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.005527 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:59.005578 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.005539 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:59.006020 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.006004 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 16:33:59.006020 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.006016 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 16:33:59.006122 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.006054 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:33:59.008212 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.008198 2574 policy_none.go:49] "None policy: Start" Jun 03 16:33:59.008276 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.008215 2574 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 16:33:59.008276 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.008227 2574 state_mem.go:35] "Initializing new in-memory state store" Jun 03 16:33:59.049600 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.049529 2574 manager.go:341] "Starting Device Plugin manager" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.049598 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.049613 2574 server.go:85] "Starting device plugin registration server" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.049842 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.049853 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.049936 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.050074 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 16:33:59.050203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.050084 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 16:33:59.050554 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.050531 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 16:33:59.050609 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.050572 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.117451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.117411 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 16:33:59.118635 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.118622 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 16:33:59.118695 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.118642 2574 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 16:33:59.118695 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.118662 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 16:33:59.118695 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.118671 2574 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 16:33:59.118806 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.118717 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 16:33:59.122252 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.122227 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:33:59.150429 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.150356 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:59.151325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.151310 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:59.151420 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.151343 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:59.151420 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.151357 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:59.151420 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.151400 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.159436 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.159421 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.159507 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.159444 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-172.ec2.internal\": node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.173661 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.173640 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.219817 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.219789 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"] Jun 03 16:33:59.219953 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.219874 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:59.221410 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.221392 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:59.221499 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.221427 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:59.221499 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.221449 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:59.222591 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.222579 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:59.222743 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.222728 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.222776 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.222761 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:59.223302 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.223283 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:59.223364 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.223312 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:59.223364 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.223322 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:59.223364 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.223289 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:59.223450 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.223375 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:59.223450 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.223385 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:59.224374 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.224362 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.224425 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.224384 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:33:59.225013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.224998 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:33:59.225077 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.225026 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:33:59.225077 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.225039 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:33:59.246869 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.246846 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-172.ec2.internal\" not found" node="ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.251504 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.251487 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-172.ec2.internal\" not found" node="ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.273985 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.273938 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.286831 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.286803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50971add79d52e7847ab2b00c1a2ca0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"50971add79d52e7847ab2b00c1a2ca0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.286933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.286831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50971add79d52e7847ab2b00c1a2ca0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"50971add79d52e7847ab2b00c1a2ca0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.286933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.286851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/883d87ae28b7b478c04eee3bfb0d0b62-config\") pod \"kube-apiserver-proxy-ip-10-0-142-172.ec2.internal\" (UID: \"883d87ae28b7b478c04eee3bfb0d0b62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.374219 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.374175 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.387493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.387463 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/883d87ae28b7b478c04eee3bfb0d0b62-config\") pod \"kube-apiserver-proxy-ip-10-0-142-172.ec2.internal\" (UID: \"883d87ae28b7b478c04eee3bfb0d0b62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.387590 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.387497 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50971add79d52e7847ab2b00c1a2ca0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"50971add79d52e7847ab2b00c1a2ca0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.387590 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.387517 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50971add79d52e7847ab2b00c1a2ca0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"50971add79d52e7847ab2b00c1a2ca0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.387590 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.387572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/883d87ae28b7b478c04eee3bfb0d0b62-config\") pod \"kube-apiserver-proxy-ip-10-0-142-172.ec2.internal\" (UID: \"883d87ae28b7b478c04eee3bfb0d0b62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.387590 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.387591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50971add79d52e7847ab2b00c1a2ca0f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"50971add79d52e7847ab2b00c1a2ca0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.387731 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.387579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50971add79d52e7847ab2b00c1a2ca0f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"50971add79d52e7847ab2b00c1a2ca0f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.474904 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.474838 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.549349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.549309 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.554904 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.554882 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" Jun 03 16:33:59.575128 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.575099 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.675651 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.675606 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.776211 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.776123 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.876616 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.876581 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.898045 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.898013 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 16:33:59.898635 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.898185 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 16:33:59.977650 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:33:59.977614 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:33:59.985817 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.985792 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 16:33:59.996340 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.996302 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 16:28:58 +0000 UTC" deadline="2028-03-09 16:26:28.462553048 +0000 UTC" Jun 03 16:33:59.996340 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:33:59.996333 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15479h52m28.466222869s" Jun 03 16:34:00.004632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.004610 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:34:00.026440 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.026385 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2fg6" Jun 03 16:34:00.032640 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:00.032598 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50971add79d52e7847ab2b00c1a2ca0f.slice/crio-81f729172ddd9f34824b66100af70f8487dadb43003ca18bd29abfb49e27c98e WatchSource:0}: Error finding container 81f729172ddd9f34824b66100af70f8487dadb43003ca18bd29abfb49e27c98e: Status 404 returned error can't find the container with id 81f729172ddd9f34824b66100af70f8487dadb43003ca18bd29abfb49e27c98e Jun 03 16:34:00.032808 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:00.032775 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883d87ae28b7b478c04eee3bfb0d0b62.slice/crio-cea08b9c4da9a49b46df209b85d96a322c8200687a6fdfe89fbd2c4bfdd97ab5 WatchSource:0}: Error finding container cea08b9c4da9a49b46df209b85d96a322c8200687a6fdfe89fbd2c4bfdd97ab5: Status 404 returned error can't find the container with id cea08b9c4da9a49b46df209b85d96a322c8200687a6fdfe89fbd2c4bfdd97ab5 Jun 03 16:34:00.033612 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.033592 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2fg6" Jun 03 16:34:00.036773 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.036756 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:34:00.078713 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.078676 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:34:00.103103 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.103081 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:34:00.121594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.121543 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" event={"ID":"883d87ae28b7b478c04eee3bfb0d0b62","Type":"ContainerStarted","Data":"cea08b9c4da9a49b46df209b85d96a322c8200687a6fdfe89fbd2c4bfdd97ab5"} Jun 03 16:34:00.122387 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.122365 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" event={"ID":"50971add79d52e7847ab2b00c1a2ca0f","Type":"ContainerStarted","Data":"81f729172ddd9f34824b66100af70f8487dadb43003ca18bd29abfb49e27c98e"} Jun 03 16:34:00.179595 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.179563 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:34:00.280109 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.280028 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:34:00.380530 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.380492 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:34:00.481193 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.481150 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found" Jun 03 16:34:00.481600 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.481577 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:34:00.486109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.486083 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" Jun 03 16:34:00.496478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.496458 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:34:00.498169 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.498143 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" Jun 03 16:34:00.503713 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.503690 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:34:00.541864 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.541803 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:34:00.962666 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.962628 2574 apiserver.go:52] "Watching apiserver" Jun 03 16:34:00.971162 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.971128 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 16:34:00.973203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.973169 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-z48gx","openshift-ovn-kubernetes/ovnkube-node-9mbgc","openshift-cluster-node-tuning-operator/tuned-cdr2g","openshift-dns/node-resolver-z9g6p","openshift-image-registry/node-ca-qszst","openshift-multus/multus-additional-cni-plugins-pkjn6","openshift-multus/network-metrics-daemon-6xqz7","openshift-network-diagnostics/network-check-target-hmxgz","openshift-network-operator/iptables-alerter-9668q","kube-system/konnectivity-agent-xxm7n","kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"] Jun 03 16:34:00.975300 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.975272 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:00.975416 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.975358 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:00.976710 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.976509 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.977500 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.977469 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.978740 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.978698 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:00.979456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979168 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 16:34:00.979456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979177 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.979456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979263 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 16:34:00.979456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979317 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.979456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979404 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 16:34:00.979456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979417 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kzz9\"" Jun 03 16:34:00.979804 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979755 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.980038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.979961 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.980038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.980017 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 16:34:00.980189 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.980039 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fpcsj\"" Jun 03 16:34:00.980189 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.980041 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:00.980669 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.980648 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9m8t\"" Jun 03 16:34:00.980889 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.980872 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.981502 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.981363 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.981934 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.981915 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.982261 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.982233 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 16:34:00.982261 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.982255 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lqx45\"" Jun 03 16:34:00.982412 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.982265 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.982728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.982706 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.982812 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.982731 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.984098 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.984019 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:00.984098 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:00.984090 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.984826 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.984827 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.984932 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.985068 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.985270 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bc6wv\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.985314 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.985376 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s9mwr\"" Jun 03 16:34:00.985534 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.985441 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.986634 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.986555 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:00.986707 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.986655 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:00.988562 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.988542 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:00.988674 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.988555 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.989001 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.988771 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6jscc\"" Jun 03 16:34:00.989098 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.988771 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 16:34:00.989098 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.989084 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 16:34:00.989582 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.988881 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fjlgl\"" Jun 03 16:34:00.989668 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.988924 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 16:34:00.990276 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.990257 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.990350 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.990312 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 16:34:00.991425 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.991402 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 16:34:00.991943 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.991923 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dgqsw\"" Jun 03 16:34:00.992041 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.991948 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 16:34:00.995465 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-netns\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.995560 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.995560 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.995560 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-host\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.995709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995564 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a537f631-ae03-4d74-ab2a-d3db7f784f58-tmp\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.995709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-run-netns\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.995709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vs9k\" (UniqueName: \"kubernetes.io/projected/89d339aa-77a6-413f-b89b-343e74a2749d-kube-api-access-5vs9k\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.995709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995648 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49t5p\" (UniqueName: \"kubernetes.io/projected/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-kube-api-access-49t5p\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:00.995709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d977b2b-7e3a-43c6-af9c-274aec484078-konnectivity-ca\") pod \"konnectivity-agent-xxm7n\" (UID: \"4d977b2b-7e3a-43c6-af9c-274aec484078\") " pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:00.995709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-ovn\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-node-log\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysconfig\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfm9\" (UniqueName: \"kubernetes.io/projected/e7ef4044-5851-444d-96ee-f44273f52d47-kube-api-access-xkfm9\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-system-cni-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-k8s-cni-cncf-io\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5qln\" (UniqueName: \"kubernetes.io/projected/a537f631-ae03-4d74-ab2a-d3db7f784f58-kube-api-access-j5qln\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f379d1d0-19d7-4e30-89e9-21b07792bfb4-hosts-file\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlbz7\" (UniqueName: \"kubernetes.io/projected/f379d1d0-19d7-4e30-89e9-21b07792bfb4-kube-api-access-wlbz7\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-os-release\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.996013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.995990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-cni-bin\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996034 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-cni-multus\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-var-lib-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysctl-d\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-tuned\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7ef4044-5851-444d-96ee-f44273f52d47-host-slash\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xcgd\" (UniqueName: \"kubernetes.io/projected/8d0d9875-93c9-4a87-9791-e172b02c7f1e-kube-api-access-8xcgd\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-socket-dir-parent\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kftx\" (UniqueName: \"kubernetes.io/projected/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-kube-api-access-9kftx\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d0d9875-93c9-4a87-9791-e172b02c7f1e-host\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-kubelet\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-slash\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.996490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-cni-binary-copy\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-conf-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhlt\" (UniqueName: \"kubernetes.io/projected/94a3326e-2edb-4bc4-a8e4-2513d562535a-kube-api-access-gwhlt\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-var-lib-kubelet\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-hostroot\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d0d9875-93c9-4a87-9791-e172b02c7f1e-serviceca\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996635 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-cni-netd\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovnkube-config\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-sys\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-cni-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-os-release\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7ef4044-5851-444d-96ee-f44273f52d47-iptables-alerter-script\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-etc-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-log-socket\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-kubernetes\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.997201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.996998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-cnibin\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-systemd-units\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-systemd\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-systemd\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-lib-modules\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997161 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-multus-certs\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-cni-bin\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-env-overrides\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f379d1d0-19d7-4e30-89e9-21b07792bfb4-tmp-dir\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d977b2b-7e3a-43c6-af9c-274aec484078-agent-certs\") pod \"konnectivity-agent-xxm7n\" (UID: \"4d977b2b-7e3a-43c6-af9c-274aec484078\") " pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovnkube-script-lib\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-system-cni-dir\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-cnibin\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-daemon-config\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:00.998029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-kubelet\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovn-node-metrics-cert\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:00.998845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-modprobe-d\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.998845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysctl-conf\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.998845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-run\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:00.998845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:00.997607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-etc-kubernetes\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.034405 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.034302 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:29:00 +0000 UTC" deadline="2027-11-30 01:22:13.441719598 +0000 UTC" Jun 03 16:34:01.034405 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.034335 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13064h48m12.407390594s" Jun 03 16:34:01.086623 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.086594 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 16:34:01.098676 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098645 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhlt\" (UniqueName: \"kubernetes.io/projected/94a3326e-2edb-4bc4-a8e4-2513d562535a-kube-api-access-gwhlt\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.098832 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-var-lib-kubelet\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.098832 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098710 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-hostroot\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.098832 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098758 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-hostroot\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.098832 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098793 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d0d9875-93c9-4a87-9791-e172b02c7f1e-serviceca\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.098832 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098816 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-var-lib-kubelet\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098842 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-cni-netd\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-cni-netd\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098893 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098918 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovnkube-config\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.098943 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-sys\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099000 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-cni-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099029 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-os-release\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099055 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7ef4044-5851-444d-96ee-f44273f52d47-iptables-alerter-script\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-sys\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-cni-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.099109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.099553 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-os-release\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.099553 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099117 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-etc-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099553 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099184 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-log-socket\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099553 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099238 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-etc-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.099727 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-kubernetes\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.099858 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099835 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d0d9875-93c9-4a87-9791-e172b02c7f1e-serviceca\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.099954 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.099935 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.100024 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovnkube-config\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.100078 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-kubernetes\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.100125 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.100174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100157 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-cnibin\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.100217 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-systemd-units\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.100264 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100237 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-systemd\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.100306 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100291 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-systemd\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.100355 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100325 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-lib-modules\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.100404 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100355 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-multus-certs\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.100404 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100389 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-cni-bin\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.100494 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7ef4044-5851-444d-96ee-f44273f52d47-iptables-alerter-script\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.100494 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-multus-certs\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.100585 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100495 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-env-overrides\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.100585 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100527 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:01.100585 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100561 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f379d1d0-19d7-4e30-89e9-21b07792bfb4-tmp-dir\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.100714 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100595 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d977b2b-7e3a-43c6-af9c-274aec484078-agent-certs\") pod \"konnectivity-agent-xxm7n\" (UID: \"4d977b2b-7e3a-43c6-af9c-274aec484078\") " pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:01.100714 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100626 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovnkube-script-lib\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.100714 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100652 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-system-cni-dir\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.100944 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100923 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-cnibin\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.101029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.100958 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-daemon-config\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.101029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101008 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:01.101137 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101040 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-kubelet\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101188 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101076 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovn-node-metrics-cert\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101229 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101214 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-modprobe-d\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.101277 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101254 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysctl-conf\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.101319 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101286 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-run\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.101358 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101316 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-etc-kubernetes\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.101433 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.101433 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-socket-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.101433 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101415 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-netns\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.101558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101464 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101497 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101532 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-host\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.101684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101562 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a537f631-ae03-4d74-ab2a-d3db7f784f58-tmp\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.101684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101594 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-run-netns\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101628 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vs9k\" (UniqueName: \"kubernetes.io/projected/89d339aa-77a6-413f-b89b-343e74a2749d-kube-api-access-5vs9k\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.101684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101657 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49t5p\" (UniqueName: \"kubernetes.io/projected/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-kube-api-access-49t5p\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:01.101852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d977b2b-7e3a-43c6-af9c-274aec484078-konnectivity-ca\") pod \"konnectivity-agent-xxm7n\" (UID: \"4d977b2b-7e3a-43c6-af9c-274aec484078\") " pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:01.101852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101727 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-ovn\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101758 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-node-log\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.101852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101788 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysconfig\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.101852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101821 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfm9\" (UniqueName: \"kubernetes.io/projected/e7ef4044-5851-444d-96ee-f44273f52d47-kube-api-access-xkfm9\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101851 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-system-cni-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101878 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-k8s-cni-cncf-io\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101912 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5qln\" (UniqueName: \"kubernetes.io/projected/a537f631-ae03-4d74-ab2a-d3db7f784f58-kube-api-access-j5qln\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101944 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f379d1d0-19d7-4e30-89e9-21b07792bfb4-hosts-file\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.101994 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlbz7\" (UniqueName: \"kubernetes.io/projected/f379d1d0-19d7-4e30-89e9-21b07792bfb4-kube-api-access-wlbz7\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102030 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-os-release\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.102081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102057 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-cni-bin\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102090 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-cni-multus\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-etc-kubernetes\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102125 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-var-lib-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102159 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysctl-d\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102194 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-tuned\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102198 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-cni-bin\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102230 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7ef4044-5851-444d-96ee-f44273f52d47-host-slash\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102234 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-systemd\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102269 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xcgd\" (UniqueName: \"kubernetes.io/projected/8d0d9875-93c9-4a87-9791-e172b02c7f1e-kube-api-access-8xcgd\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102285 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7ef4044-5851-444d-96ee-f44273f52d47-host-slash\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-registration-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.102376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102348 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-netns\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.102848 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.102848 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.102462 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:01.102848 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-host\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.102848 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.102560 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:01.602513057 +0000 UTC m=+3.016409818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:01.102848 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102742 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 16:34:01.102848 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-kubelet\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.103284 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-var-lib-openvswitch\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.103358 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-run-netns\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.103710 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysctl-d\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.103710 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.102160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-system-cni-dir\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.103710 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-cnibin\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.103879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-systemd-units\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.103879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103774 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysctl-conf\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.103879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-modprobe-d\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.103879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-run-k8s-cni-cncf-io\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.104089 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-run-ovn\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.104089 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-lib-modules\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.104089 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104056 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-systemd\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.104089 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-sys-fs\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.104089 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.103998 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-node-log\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.104323 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f379d1d0-19d7-4e30-89e9-21b07792bfb4-tmp-dir\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.104323 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104264 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-run\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.104323 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104308 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-daemon-config\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.104681 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d977b2b-7e3a-43c6-af9c-274aec484078-konnectivity-ca\") pod \"konnectivity-agent-xxm7n\" (UID: \"4d977b2b-7e3a-43c6-af9c-274aec484078\") " pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:01.104762 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.104729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-cnibin\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.105051 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovnkube-script-lib\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.105051 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-sysconfig\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.105181 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ftg8\" (UniqueName: \"kubernetes.io/projected/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-kube-api-access-7ftg8\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.105181 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105152 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.105284 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105192 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-socket-dir-parent\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.105331 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105286 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kftx\" (UniqueName: \"kubernetes.io/projected/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-kube-api-access-9kftx\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.105377 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105327 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d0d9875-93c9-4a87-9791-e172b02c7f1e-host\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.105377 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105362 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-kubelet\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.105463 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-device-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.105508 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105461 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-slash\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.105508 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105496 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.105591 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105534 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.105681 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105661 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-cni-binary-copy\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.105751 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105727 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-conf-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.105903 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.105882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f379d1d0-19d7-4e30-89e9-21b07792bfb4-hosts-file\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.106199 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d0d9875-93c9-4a87-9791-e172b02c7f1e-host\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.106261 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-cni-binary-copy\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.106261 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-kubelet\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.106366 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-slash\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.106366 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-system-cni-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.106456 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.106540 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-socket-dir-parent\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.106687 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106668 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-multus-conf-dir\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.106762 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-host-run-ovn-kubernetes\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.106815 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89d339aa-77a6-413f-b89b-343e74a2749d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.106815 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89d339aa-77a6-413f-b89b-343e74a2749d-os-release\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.106909 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-cni-bin\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.106909 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.106885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-host-var-lib-cni-multus\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.107068 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.107045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94a3326e-2edb-4bc4-a8e4-2513d562535a-ovn-node-metrics-cert\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.107267 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.107242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-cni-binary-copy\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.107337 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.107319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a537f631-ae03-4d74-ab2a-d3db7f784f58-etc-tuned\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.107476 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.107452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94a3326e-2edb-4bc4-a8e4-2513d562535a-log-socket\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.107538 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.107466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a537f631-ae03-4d74-ab2a-d3db7f784f58-tmp\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.108390 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.108357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94a3326e-2edb-4bc4-a8e4-2513d562535a-env-overrides\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.108984 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.108947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d977b2b-7e3a-43c6-af9c-274aec484078-agent-certs\") pod \"konnectivity-agent-xxm7n\" (UID: \"4d977b2b-7e3a-43c6-af9c-274aec484078\") " pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:01.110286 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.110140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhlt\" (UniqueName: \"kubernetes.io/projected/94a3326e-2edb-4bc4-a8e4-2513d562535a-kube-api-access-gwhlt\") pod \"ovnkube-node-9mbgc\" (UID: \"94a3326e-2edb-4bc4-a8e4-2513d562535a\") " pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.111797 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.111491 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:01.111797 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.111514 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:01.111797 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.111529 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:01.111797 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.111596 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:01.611579617 +0000 UTC m=+3.025476394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:01.112183 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.112159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49t5p\" (UniqueName: \"kubernetes.io/projected/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-kube-api-access-49t5p\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:01.112901 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.112663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vs9k\" (UniqueName: \"kubernetes.io/projected/89d339aa-77a6-413f-b89b-343e74a2749d-kube-api-access-5vs9k\") pod \"multus-additional-cni-plugins-pkjn6\" (UID: \"89d339aa-77a6-413f-b89b-343e74a2749d\") " pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.113419 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.113396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfm9\" (UniqueName: \"kubernetes.io/projected/e7ef4044-5851-444d-96ee-f44273f52d47-kube-api-access-xkfm9\") pod \"iptables-alerter-9668q\" (UID: \"e7ef4044-5851-444d-96ee-f44273f52d47\") " pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.113679 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.113646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kftx\" (UniqueName: \"kubernetes.io/projected/9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d-kube-api-access-9kftx\") pod \"multus-z48gx\" (UID: \"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d\") " pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.114342 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.114320 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xcgd\" (UniqueName: \"kubernetes.io/projected/8d0d9875-93c9-4a87-9791-e172b02c7f1e-kube-api-access-8xcgd\") pod \"node-ca-qszst\" (UID: \"8d0d9875-93c9-4a87-9791-e172b02c7f1e\") " pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.114639 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.114620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5qln\" (UniqueName: \"kubernetes.io/projected/a537f631-ae03-4d74-ab2a-d3db7f784f58-kube-api-access-j5qln\") pod \"tuned-cdr2g\" (UID: \"a537f631-ae03-4d74-ab2a-d3db7f784f58\") " pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.116199 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.116148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlbz7\" (UniqueName: \"kubernetes.io/projected/f379d1d0-19d7-4e30-89e9-21b07792bfb4-kube-api-access-wlbz7\") pod \"node-resolver-z9g6p\" (UID: \"f379d1d0-19d7-4e30-89e9-21b07792bfb4\") " pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.206292 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206247 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-registration-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206292 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206291 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-sys-fs\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206314 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ftg8\" (UniqueName: \"kubernetes.io/projected/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-kube-api-access-7ftg8\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206340 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-device-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-registration-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206372 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206415 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-sys-fs\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206446 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206467 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-device-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206493 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206523 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206517 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-socket-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206805 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.206805 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.206628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-socket-dir\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.213904 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.213848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ftg8\" (UniqueName: \"kubernetes.io/projected/9a447d8e-6adb-4bbb-a063-7ca29c67f0a3-kube-api-access-7ftg8\") pod \"aws-ebs-csi-driver-node-xn7j8\" (UID: \"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.292221 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.292169 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:01.301082 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.301058 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" Jun 03 16:34:01.309772 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.309747 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9g6p" Jun 03 16:34:01.315466 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.315439 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qszst" Jun 03 16:34:01.323081 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.323058 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" Jun 03 16:34:01.330755 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.330732 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z48gx" Jun 03 16:34:01.335310 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.335289 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:34:01.338878 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.338853 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9668q" Jun 03 16:34:01.346549 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.346527 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:01.353230 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.353209 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" Jun 03 16:34:01.609697 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.609668 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:01.609874 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.609799 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:01.609874 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.609865 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:02.60984716 +0000 UTC m=+4.023743923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:01.701694 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.701519 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d339aa_77a6_413f_b89b_343e74a2749d.slice/crio-38b18541ab45d959b24711cee65a71a123b8e8201d1c1f311ffa54658ff692f2 WatchSource:0}: Error finding container 38b18541ab45d959b24711cee65a71a123b8e8201d1c1f311ffa54658ff692f2: Status 404 returned error can't find the container with id 38b18541ab45d959b24711cee65a71a123b8e8201d1c1f311ffa54658ff692f2 Jun 03 16:34:01.702522 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.702487 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda537f631_ae03_4d74_ab2a_d3db7f784f58.slice/crio-8cc1a19d14dce30b72f1bb28473d94a1bb195870bcd3c7effe52150497e4808e WatchSource:0}: Error finding container 8cc1a19d14dce30b72f1bb28473d94a1bb195870bcd3c7effe52150497e4808e: Status 404 returned error can't find the container with id 8cc1a19d14dce30b72f1bb28473d94a1bb195870bcd3c7effe52150497e4808e Jun 03 16:34:01.705473 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.705450 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0d9875_93c9_4a87_9791_e172b02c7f1e.slice/crio-915735930ccb8728e7da9399fbe1b0d24d051aa9add369b68867cc9bb918c5f4 WatchSource:0}: Error finding container 915735930ccb8728e7da9399fbe1b0d24d051aa9add369b68867cc9bb918c5f4: Status 404 returned error can't find the container with id 915735930ccb8728e7da9399fbe1b0d24d051aa9add369b68867cc9bb918c5f4 Jun 03 16:34:01.707819 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.707795 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ef4044_5851_444d_96ee_f44273f52d47.slice/crio-704b5d50ef5f5d2f0a68c05648b5d6a611e256d2ef700ba139abcee4c09021dd WatchSource:0}: Error finding container 704b5d50ef5f5d2f0a68c05648b5d6a611e256d2ef700ba139abcee4c09021dd: Status 404 returned error can't find the container with id 704b5d50ef5f5d2f0a68c05648b5d6a611e256d2ef700ba139abcee4c09021dd Jun 03 16:34:01.708815 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.708793 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d977b2b_7e3a_43c6_af9c_274aec484078.slice/crio-bf894af908c2bb1cd4b18a3cefa829ce67e9cd4a5f5f171a76688400e4a7d0f1 WatchSource:0}: Error finding container bf894af908c2bb1cd4b18a3cefa829ce67e9cd4a5f5f171a76688400e4a7d0f1: Status 404 returned error can't find the container with id bf894af908c2bb1cd4b18a3cefa829ce67e9cd4a5f5f171a76688400e4a7d0f1 Jun 03 16:34:01.709825 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.709690 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf379d1d0_19d7_4e30_89e9_21b07792bfb4.slice/crio-1c7b00b7d0933f2ed45259d52fb53c044b19c8c6fdd5438873e066bb2ae1fb94 WatchSource:0}: Error finding container 1c7b00b7d0933f2ed45259d52fb53c044b19c8c6fdd5438873e066bb2ae1fb94: Status 404 returned error can't find the container with id 1c7b00b7d0933f2ed45259d52fb53c044b19c8c6fdd5438873e066bb2ae1fb94 Jun 03 16:34:01.709994 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:01.709932 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:01.710133 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.710118 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:01.710200 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.710140 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:01.710200 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.710152 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:01.710304 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:01.710203 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:02.710185135 +0000 UTC m=+4.124081908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:01.710671 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.710634 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a3326e_2edb_4bc4_a8e4_2513d562535a.slice/crio-66f59dc985148c217bc50de1c8eaa791c0d4392bff04b743934e7d823d79db79 WatchSource:0}: Error finding container 66f59dc985148c217bc50de1c8eaa791c0d4392bff04b743934e7d823d79db79: Status 404 returned error can't find the container with id 66f59dc985148c217bc50de1c8eaa791c0d4392bff04b743934e7d823d79db79 Jun 03 16:34:01.712701 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.712563 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a447d8e_6adb_4bbb_a063_7ca29c67f0a3.slice/crio-6f496d67402df6cbbc9fd736bc963cb2711ddd87d526a599f7a8fe1a8a697013 WatchSource:0}: Error finding container 6f496d67402df6cbbc9fd736bc963cb2711ddd87d526a599f7a8fe1a8a697013: Status 404 returned error can't find the container with id 6f496d67402df6cbbc9fd736bc963cb2711ddd87d526a599f7a8fe1a8a697013 Jun 03 16:34:01.714379 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:34:01.714065 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0957c6_eb4a_4e40_b914_6f1ae7a4a99d.slice/crio-ce3758dc96ce8b671243222368df15eac5f3ebb8209d816655e2e7f8c22c8374 WatchSource:0}: Error finding container ce3758dc96ce8b671243222368df15eac5f3ebb8209d816655e2e7f8c22c8374: Status 404 returned error can't find the container with id ce3758dc96ce8b671243222368df15eac5f3ebb8209d816655e2e7f8c22c8374 Jun 03 16:34:02.035361 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.035312 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:29:00 +0000 UTC" deadline="2027-11-10 18:20:56.557789941 +0000 UTC" Jun 03 16:34:02.035361 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.035353 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12601h46m54.522440646s" Jun 03 16:34:02.129800 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.129761 2574 generic.go:358] "Generic (PLEG): container finished" podID="50971add79d52e7847ab2b00c1a2ca0f" containerID="8a8a05b22a322880283e7587ae9b20538e655bdba8f2c1d8d61b420a8bd9e3b2" exitCode=0 Jun 03 16:34:02.129991 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.129848 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" event={"ID":"50971add79d52e7847ab2b00c1a2ca0f","Type":"ContainerDied","Data":"8a8a05b22a322880283e7587ae9b20538e655bdba8f2c1d8d61b420a8bd9e3b2"} Jun 03 16:34:02.134663 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.134631 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" event={"ID":"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3","Type":"ContainerStarted","Data":"6f496d67402df6cbbc9fd736bc963cb2711ddd87d526a599f7a8fe1a8a697013"} Jun 03 16:34:02.135887 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.135857 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xxm7n" event={"ID":"4d977b2b-7e3a-43c6-af9c-274aec484078","Type":"ContainerStarted","Data":"bf894af908c2bb1cd4b18a3cefa829ce67e9cd4a5f5f171a76688400e4a7d0f1"} Jun 03 16:34:02.137444 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.137391 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9668q" event={"ID":"e7ef4044-5851-444d-96ee-f44273f52d47","Type":"ContainerStarted","Data":"704b5d50ef5f5d2f0a68c05648b5d6a611e256d2ef700ba139abcee4c09021dd"} Jun 03 16:34:02.138720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.138676 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qszst" event={"ID":"8d0d9875-93c9-4a87-9791-e172b02c7f1e","Type":"ContainerStarted","Data":"915735930ccb8728e7da9399fbe1b0d24d051aa9add369b68867cc9bb918c5f4"} Jun 03 16:34:02.144060 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.143868 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" event={"ID":"883d87ae28b7b478c04eee3bfb0d0b62","Type":"ContainerStarted","Data":"bbe69c5c5acdac94b17fb91ba211cab9af9b12bbf8b295691cde984b9bf9eeae"} Jun 03 16:34:02.147038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.146938 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z48gx" event={"ID":"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d","Type":"ContainerStarted","Data":"ce3758dc96ce8b671243222368df15eac5f3ebb8209d816655e2e7f8c22c8374"} Jun 03 16:34:02.150142 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.150116 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"66f59dc985148c217bc50de1c8eaa791c0d4392bff04b743934e7d823d79db79"} Jun 03 16:34:02.151848 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.151825 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9g6p" event={"ID":"f379d1d0-19d7-4e30-89e9-21b07792bfb4","Type":"ContainerStarted","Data":"1c7b00b7d0933f2ed45259d52fb53c044b19c8c6fdd5438873e066bb2ae1fb94"} Jun 03 16:34:02.154517 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.154459 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" podStartSLOduration=2.154444368 podStartE2EDuration="2.154444368s" podCreationTimestamp="2026-06-03 16:34:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:34:02.153731836 +0000 UTC m=+3.567628616" watchObservedRunningTime="2026-06-03 16:34:02.154444368 +0000 UTC m=+3.568341148" Jun 03 16:34:02.155263 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.155210 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" event={"ID":"a537f631-ae03-4d74-ab2a-d3db7f784f58","Type":"ContainerStarted","Data":"8cc1a19d14dce30b72f1bb28473d94a1bb195870bcd3c7effe52150497e4808e"} Jun 03 16:34:02.158876 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.158838 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerStarted","Data":"38b18541ab45d959b24711cee65a71a123b8e8201d1c1f311ffa54658ff692f2"} Jun 03 16:34:02.617590 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.617547 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:02.617782 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:02.617707 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:02.617782 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:02.617775 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:04.617756531 +0000 UTC m=+6.031653303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:02.718301 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:02.718259 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:02.718507 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:02.718491 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:02.718583 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:02.718515 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:02.718583 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:02.718528 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:02.718681 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:02.718588 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:04.718569476 +0000 UTC m=+6.132466240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:03.120167 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:03.120134 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:03.120705 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:03.120271 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:03.123632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:03.120874 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:03.123632 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:03.120989 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:03.184417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:03.184380 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" event={"ID":"50971add79d52e7847ab2b00c1a2ca0f","Type":"ContainerStarted","Data":"05c4c751471fabafabbe3d650d014383a237169901fe3d515a88700727069884"} Jun 03 16:34:04.635660 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:04.635071 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:04.635660 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:04.635239 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:04.635660 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:04.635302 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:08.635283736 +0000 UTC m=+10.049180510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:04.736251 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:04.736204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:04.736442 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:04.736358 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:04.736442 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:04.736379 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:04.736442 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:04.736391 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:04.736589 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:04.736449 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:08.736430339 +0000 UTC m=+10.150327101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:05.119592 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:05.119105 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:05.119592 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:05.119243 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:05.119592 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:05.119263 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:05.119592 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:05.119354 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:07.119084 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:07.118844 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:07.119084 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:07.118997 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:07.119662 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:07.119257 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:07.119662 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:07.119323 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:08.674328 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:08.674147 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:08.674742 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:08.674350 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:08.674742 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:08.674434 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:16.674412223 +0000 UTC m=+18.088309020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:08.774854 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:08.774802 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:08.775050 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:08.775020 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:08.775050 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:08.775039 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:08.775175 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:08.775052 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:08.775175 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:08.775114 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:16.77509683 +0000 UTC m=+18.188993591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:09.121127 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:09.120492 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:09.121127 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:09.120615 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:09.121127 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:09.120993 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:09.121127 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:09.121082 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:11.119226 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:11.119193 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:11.119226 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:11.119220 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:11.119693 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:11.119323 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:11.119693 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:11.119488 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:13.119877 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:13.119841 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:13.120357 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:13.119986 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:13.120357 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:13.120025 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:13.120357 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:13.120149 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:15.119858 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:15.119822 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:15.120289 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:15.119819 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:15.120289 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:15.119966 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:15.120289 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:15.120079 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:16.734941 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:16.734895 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:16.735436 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:16.735058 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:16.735436 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:16.735127 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:32.735111572 +0000 UTC m=+34.149008329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:16.836058 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:16.836011 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:16.836234 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:16.836210 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:16.836300 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:16.836239 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:16.836300 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:16.836250 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:16.836403 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:16.836314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:34:32.83629485 +0000 UTC m=+34.250191634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:17.119186 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:17.119154 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:17.119186 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:17.119172 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:17.119417 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:17.119270 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:17.119477 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:17.119421 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:19.120291 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:19.120257 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:19.120291 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:19.120275 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:19.120730 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:19.120379 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:19.120730 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:19.120463 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:20.215676 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.215386 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z48gx" event={"ID":"9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d","Type":"ContainerStarted","Data":"73cbe1f70fde04b2b17b0897e5f107a94726d7f05aca0c105480252c0dee6f58"} Jun 03 16:34:20.217464 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.217346 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:34:20.217778 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.217755 2574 generic.go:358] "Generic (PLEG): container finished" podID="94a3326e-2edb-4bc4-a8e4-2513d562535a" containerID="80ad26361d98e81459c31cc07f1899ae87213749c7990f557e07db3cf84989d8" exitCode=1 Jun 03 16:34:20.217879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.217830 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerDied","Data":"80ad26361d98e81459c31cc07f1899ae87213749c7990f557e07db3cf84989d8"} Jun 03 16:34:20.217879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.217870 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"0eb99ffaa8f827493184f2beefd449f9889baabffe7888807134ff2457d8e46c"} Jun 03 16:34:20.219382 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.219350 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9g6p" event={"ID":"f379d1d0-19d7-4e30-89e9-21b07792bfb4","Type":"ContainerStarted","Data":"ef06931cd91cebad85e9a29adcbb17ee58ce6344d4e2366e5e57b2fe5f62fb3b"} Jun 03 16:34:20.220905 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.220867 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" event={"ID":"a537f631-ae03-4d74-ab2a-d3db7f784f58","Type":"ContainerStarted","Data":"adfa188e4f6b443f95943b6d3e7fa20d27ca9514ba0160e3f7ec5c253a456201"} Jun 03 16:34:20.222435 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.222409 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerStarted","Data":"99cb59122bec703589b5405247ebc71128f031188e0cdbc8a02476f098bd37b2"} Jun 03 16:34:20.224870 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.224529 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" event={"ID":"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3","Type":"ContainerStarted","Data":"ef502c6646ae4b4d0d29ac72992d4d4befc55b09d8dcff4a77de518a29fee5e4"} Jun 03 16:34:20.226497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.226461 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xxm7n" event={"ID":"4d977b2b-7e3a-43c6-af9c-274aec484078","Type":"ContainerStarted","Data":"aa0568547392eecdfd5e6b1d256efbc81b30e81cd4b5190c6929af248716e8ba"} Jun 03 16:34:20.228193 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.228170 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qszst" event={"ID":"8d0d9875-93c9-4a87-9791-e172b02c7f1e","Type":"ContainerStarted","Data":"1120614a35233a43fdc73d58b292c8e570f8b6227f993569aeba667a9892aa42"} Jun 03 16:34:20.232988 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.232910 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" podStartSLOduration=20.23286966 podStartE2EDuration="20.23286966s" podCreationTimestamp="2026-06-03 16:34:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:34:03.196070816 +0000 UTC m=+4.609967596" watchObservedRunningTime="2026-06-03 16:34:20.23286966 +0000 UTC m=+21.646766443" Jun 03 16:34:20.251615 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.251568 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-z48gx" podStartSLOduration=3.042068319 podStartE2EDuration="21.251549543s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.716689715 +0000 UTC m=+3.130586474" lastFinishedPulling="2026-06-03 16:34:19.926170937 +0000 UTC m=+21.340067698" observedRunningTime="2026-06-03 16:34:20.234044917 +0000 UTC m=+21.647941698" watchObservedRunningTime="2026-06-03 16:34:20.251549543 +0000 UTC m=+21.665446324" Jun 03 16:34:20.251812 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.251792 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cdr2g" podStartSLOduration=3.176230549 podStartE2EDuration="21.251788237s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.704690607 +0000 UTC m=+3.118587370" lastFinishedPulling="2026-06-03 16:34:19.780248285 +0000 UTC m=+21.194145058" observedRunningTime="2026-06-03 16:34:20.251539402 +0000 UTC m=+21.665436179" watchObservedRunningTime="2026-06-03 16:34:20.251788237 +0000 UTC m=+21.665685050" Jun 03 16:34:20.266942 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.266902 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-z9g6p" podStartSLOduration=3.200607887 podStartE2EDuration="21.266887548s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.712195744 +0000 UTC m=+3.126092502" lastFinishedPulling="2026-06-03 16:34:19.7784754 +0000 UTC m=+21.192372163" observedRunningTime="2026-06-03 16:34:20.266593398 +0000 UTC m=+21.680490178" watchObservedRunningTime="2026-06-03 16:34:20.266887548 +0000 UTC m=+21.680784328" Jun 03 16:34:20.280226 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.280183 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qszst" podStartSLOduration=3.209384701 podStartE2EDuration="21.280171325s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.707687719 +0000 UTC m=+3.121584488" lastFinishedPulling="2026-06-03 16:34:19.77847433 +0000 UTC m=+21.192371112" observedRunningTime="2026-06-03 16:34:20.279396966 +0000 UTC m=+21.693293746" watchObservedRunningTime="2026-06-03 16:34:20.280171325 +0000 UTC m=+21.694068162" Jun 03 16:34:20.319284 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:20.319246 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xxm7n" podStartSLOduration=7.09331948 podStartE2EDuration="21.319232812s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.711715227 +0000 UTC m=+3.125611987" lastFinishedPulling="2026-06-03 16:34:15.937628547 +0000 UTC m=+17.351525319" observedRunningTime="2026-06-03 16:34:20.31907872 +0000 UTC m=+21.732975499" watchObservedRunningTime="2026-06-03 16:34:20.319232812 +0000 UTC m=+21.733129591" Jun 03 16:34:21.119405 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.119209 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:21.119602 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.119219 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:21.119602 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:21.119493 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:21.119602 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:21.119585 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:21.129969 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.129944 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:21.130488 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.130460 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:21.231643 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.231613 2574 generic.go:358] "Generic (PLEG): container finished" podID="89d339aa-77a6-413f-b89b-343e74a2749d" containerID="99cb59122bec703589b5405247ebc71128f031188e0cdbc8a02476f098bd37b2" exitCode=0 Jun 03 16:34:21.232135 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.231692 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerDied","Data":"99cb59122bec703589b5405247ebc71128f031188e0cdbc8a02476f098bd37b2"} Jun 03 16:34:21.233136 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.233111 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9668q" event={"ID":"e7ef4044-5851-444d-96ee-f44273f52d47","Type":"ContainerStarted","Data":"cb8067512c76150ce7a0785d681785981592b55eb2933d4e8cd2dd4bdca8a90f"} Jun 03 16:34:21.235282 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.235263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:34:21.235653 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.235638 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"f3b3368b7624535525ba0ff53f30eec420d54b288be3b897bf8ec97105bf5acf"} Jun 03 16:34:21.235728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.235660 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"71ff83a1cfb770f4648db182127ca5e928f96a72647eb46a96cd484ff2ebe6bf"} Jun 03 16:34:21.235728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.235670 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"1e70c44e3d2da5030d55ea6b10a65b0963d1f4602cf2dc8dc530027ed58c071c"} Jun 03 16:34:21.235728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.235678 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"666dfa51c424b563a9b9b330698dcb1388c641c8a12cfe30781e3ccd98c6a79e"} Jun 03 16:34:21.261917 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.261873 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9668q" podStartSLOduration=4.193264878 podStartE2EDuration="22.26186083s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.710258889 +0000 UTC m=+3.124155663" lastFinishedPulling="2026-06-03 16:34:19.778854857 +0000 UTC m=+21.192751615" observedRunningTime="2026-06-03 16:34:21.261216623 +0000 UTC m=+22.675113402" watchObservedRunningTime="2026-06-03 16:34:21.26186083 +0000 UTC m=+22.675757610" Jun 03 16:34:21.464410 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:21.464378 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 16:34:22.064140 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:22.064026 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T16:34:21.464403501Z","UUID":"ff667f73-2f3f-47eb-9209-26f0928d85ed","Handler":null,"Name":"","Endpoint":""} Jun 03 16:34:22.066583 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:22.066535 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 16:34:22.066847 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:22.066775 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 16:34:22.239042 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:22.239003 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" event={"ID":"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3","Type":"ContainerStarted","Data":"e6a28932ae150c2cb4cc4c4a4a8c84484723d7073e663a770378ccd493c8bcee"} Jun 03 16:34:22.239501 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:22.239110 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 16:34:23.119707 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:23.119449 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:23.119893 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:23.119476 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:23.119893 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:23.119831 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:23.119893 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:23.119874 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:23.243376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:23.243332 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" event={"ID":"9a447d8e-6adb-4bbb-a063-7ca29c67f0a3","Type":"ContainerStarted","Data":"b2d99bfd54c9a03e99d2d1cc12938756f68b4beb28607c43dad223734b81be60"} Jun 03 16:34:23.246538 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:23.246506 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:34:23.246908 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:23.246879 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"8ceab92679cb41418b56c5a8b4cc140e83c53b82021aa3c2961bd38b01d88f50"} Jun 03 16:34:23.258551 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:23.258505 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xn7j8" podStartSLOduration=3.317647652 podStartE2EDuration="24.258491459s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.715076266 +0000 UTC m=+3.128973035" lastFinishedPulling="2026-06-03 16:34:22.655920069 +0000 UTC m=+24.069816842" observedRunningTime="2026-06-03 16:34:23.257883483 +0000 UTC m=+24.671780276" watchObservedRunningTime="2026-06-03 16:34:23.258491459 +0000 UTC m=+24.672388240" Jun 03 16:34:24.534301 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:24.534265 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:24.534821 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:24.534438 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 16:34:24.534918 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:24.534896 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xxm7n" Jun 03 16:34:25.119573 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.119282 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:25.119573 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.119287 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:25.119769 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:25.119599 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:25.119769 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:25.119659 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:25.254503 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.254474 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:34:25.254881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.254846 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"ec8c2da167eded04b4e6249bd9c871dd6ce3efe587568cc4ffaaf6e5f973b4c5"} Jun 03 16:34:25.255239 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.255203 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:25.255327 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.255251 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:25.255423 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.255385 2574 scope.go:117] "RemoveContainer" containerID="80ad26361d98e81459c31cc07f1899ae87213749c7990f557e07db3cf84989d8" Jun 03 16:34:25.271640 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:25.271619 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:26.832435 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:26.831822 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmxgz"] Jun 03 16:34:26.832435 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:26.832164 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:26.832435 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:26.832280 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:26.835086 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:26.835057 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xqz7"] Jun 03 16:34:26.835199 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:26.835178 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:26.835303 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:26.835278 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:27.262260 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.262034 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:34:27.262560 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.262538 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" event={"ID":"94a3326e-2edb-4bc4-a8e4-2513d562535a","Type":"ContainerStarted","Data":"ab12e0b2471828bc3842855bdd046a6e5d61fee05030bc9c16f98e8710424979"} Jun 03 16:34:27.262897 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.262859 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:27.264086 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.264060 2574 generic.go:358] "Generic (PLEG): container finished" podID="89d339aa-77a6-413f-b89b-343e74a2749d" containerID="29019b35d9df9ad14561189a1576cfab8690b4a942f3f85783e259942d046b41" exitCode=0 Jun 03 16:34:27.264182 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.264114 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerDied","Data":"29019b35d9df9ad14561189a1576cfab8690b4a942f3f85783e259942d046b41"} Jun 03 16:34:27.278169 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.278150 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:34:27.287618 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:27.287570 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" podStartSLOduration=10.199682893 podStartE2EDuration="28.287556176s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.713376151 +0000 UTC m=+3.127272909" lastFinishedPulling="2026-06-03 16:34:19.80124942 +0000 UTC m=+21.215146192" observedRunningTime="2026-06-03 16:34:27.287132663 +0000 UTC m=+28.701029442" watchObservedRunningTime="2026-06-03 16:34:27.287556176 +0000 UTC m=+28.701452956" Jun 03 16:34:28.119904 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:28.119870 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:28.120280 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:28.120011 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:28.267935 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:28.267845 2574 generic.go:358] "Generic (PLEG): container finished" podID="89d339aa-77a6-413f-b89b-343e74a2749d" containerID="ea8eca8b4d17508e27ea434a4aaec7fec6dd4397c5fc6c6fb6e1170c00e97598" exitCode=0 Jun 03 16:34:28.268086 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:28.267935 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerDied","Data":"ea8eca8b4d17508e27ea434a4aaec7fec6dd4397c5fc6c6fb6e1170c00e97598"} Jun 03 16:34:29.120321 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:29.120291 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:29.120844 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:29.120377 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:29.271632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:29.271540 2574 generic.go:358] "Generic (PLEG): container finished" podID="89d339aa-77a6-413f-b89b-343e74a2749d" containerID="fb76c280ad22c25cbb383d7383d73720169eb0b23a93a2c270103e7511d6c64e" exitCode=0 Jun 03 16:34:29.271632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:29.271588 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerDied","Data":"fb76c280ad22c25cbb383d7383d73720169eb0b23a93a2c270103e7511d6c64e"} Jun 03 16:34:29.282766 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:29.282727 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" podUID="94a3326e-2edb-4bc4-a8e4-2513d562535a" containerName="ovnkube-controller" probeResult="failure" output="" Jun 03 16:34:30.119996 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:30.119941 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:30.120149 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:30.120088 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:31.119914 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:31.119887 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:31.120560 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:31.119994 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmxgz" podUID="7bdb1b84-6ac2-475e-b999-91f288db1cd5" Jun 03 16:34:32.119810 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.119772 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:32.120098 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.119928 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xqz7" podUID="a2c6e2c1-2fef-45f5-bdb9-386cb17371e5" Jun 03 16:34:32.752992 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.752891 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:32.753173 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.753072 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:32.753173 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.753150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:04.753129272 +0000 UTC m=+66.167026044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:34:32.854086 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.854050 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:32.854255 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.854164 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:34:32.854255 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.854178 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:34:32.854255 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.854186 2574 projected.go:194] Error preparing data for projected volume kube-api-access-lzghr for pod openshift-network-diagnostics/network-check-target-hmxgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:32.854255 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:32.854233 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr podName:7bdb1b84-6ac2-475e-b999-91f288db1cd5 nodeName:}" failed. No retries permitted until 2026-06-03 16:35:04.854220649 +0000 UTC m=+66.268117421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lzghr" (UniqueName: "kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr") pod "network-check-target-hmxgz" (UID: "7bdb1b84-6ac2-475e-b999-91f288db1cd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:34:32.939331 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.939298 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeReady" Jun 03 16:34:32.939506 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.939446 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 16:34:32.981844 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.981810 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-svwtw"] Jun 03 16:34:32.984442 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.984417 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vltxp"] Jun 03 16:34:32.984594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.984575 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:32.986619 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.986596 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 16:34:32.986774 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.986663 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6d9kw\"" Jun 03 16:34:32.986904 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.986781 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 16:34:32.987065 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.986952 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:32.988772 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.988752 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kldw8\"" Jun 03 16:34:32.988772 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.988764 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 16:34:32.988968 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.988913 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 16:34:32.989177 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.989157 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 16:34:32.993154 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.993077 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vltxp"] Jun 03 16:34:32.995846 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:32.995809 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svwtw"] Jun 03 16:34:33.119504 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.119472 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:34:33.122640 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.122582 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r657c\"" Jun 03 16:34:33.123023 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.122799 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:34:33.123023 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.122868 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:34:33.156417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.156388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-config-volume\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.156417 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.156418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.156602 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.156468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:33.156602 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.156547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-tmp-dir\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.156602 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.156584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrxk\" (UniqueName: \"kubernetes.io/projected/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-kube-api-access-dsrxk\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.156602 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.156601 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7mgt\" (UniqueName: \"kubernetes.io/projected/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-kube-api-access-w7mgt\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:33.257312 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257273 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-config-volume\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.257312 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257312 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.257554 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.257442 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:33.257554 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257500 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:33.257554 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.257513 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:33.757493232 +0000 UTC m=+35.171390006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:34:33.257676 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257561 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-tmp-dir\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.257676 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.257575 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:33.257676 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257605 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrxk\" (UniqueName: \"kubernetes.io/projected/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-kube-api-access-dsrxk\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.257676 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257638 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7mgt\" (UniqueName: \"kubernetes.io/projected/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-kube-api-access-w7mgt\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:33.257835 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.257686 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:33.757673594 +0000 UTC m=+35.171570365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:34:33.257945 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-tmp-dir\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.258008 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.257968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-config-volume\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.270548 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.270513 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrxk\" (UniqueName: \"kubernetes.io/projected/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-kube-api-access-dsrxk\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.270716 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.270559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7mgt\" (UniqueName: \"kubernetes.io/projected/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-kube-api-access-w7mgt\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:33.760756 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.760723 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:33.760946 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:33.760794 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:33.760946 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.760891 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:33.760946 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.760920 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:33.761119 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.760968 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:34.760947681 +0000 UTC m=+36.174844441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:34:33.761119 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:33.761005 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:34.760991301 +0000 UTC m=+36.174888060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:34:34.119498 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:34.119459 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:34:34.122178 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:34.121993 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:34:34.122295 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:34.122001 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fx9bm\"" Jun 03 16:34:34.769036 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:34.768996 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:34.769486 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:34.769092 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:34.769486 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:34.769157 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:34.769486 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:34.769206 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:34.769486 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:34.769243 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:36.769222289 +0000 UTC m=+38.183119063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:34:34.769486 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:34.769262 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:36.769253656 +0000 UTC m=+38.183150421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:34:36.785865 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:36.785772 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:36.785865 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:36.785847 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:36.786381 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:36.785949 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:36.786381 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:36.786042 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:40.786020077 +0000 UTC m=+42.199916840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:34:36.786381 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:36.785959 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:36.786381 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:36.786140 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:40.786118044 +0000 UTC m=+42.200014805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:34:38.290675 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:38.290642 2574 generic.go:358] "Generic (PLEG): container finished" podID="89d339aa-77a6-413f-b89b-343e74a2749d" containerID="68983315cdc1c4e0b791759f9185759e9d4826c7c9988eef3586516c696f7d35" exitCode=0 Jun 03 16:34:38.291058 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:38.290694 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerDied","Data":"68983315cdc1c4e0b791759f9185759e9d4826c7c9988eef3586516c696f7d35"} Jun 03 16:34:39.294555 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:39.294521 2574 generic.go:358] "Generic (PLEG): container finished" podID="89d339aa-77a6-413f-b89b-343e74a2749d" containerID="325bd1734fd9afd2a7abbfb185b6ddd9aa4d766eee69853a8bae7c8a06a92aef" exitCode=0 Jun 03 16:34:39.294925 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:39.294571 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerDied","Data":"325bd1734fd9afd2a7abbfb185b6ddd9aa4d766eee69853a8bae7c8a06a92aef"} Jun 03 16:34:40.299749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:40.299716 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" event={"ID":"89d339aa-77a6-413f-b89b-343e74a2749d","Type":"ContainerStarted","Data":"63f87cad6a8d18d64b3ad9bb97e107a5d3b800de41dcf17d393f56c948038a1f"} Jun 03 16:34:40.319700 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:40.319657 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pkjn6" podStartSLOduration=5.11909664 podStartE2EDuration="41.319643715s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:34:01.704020779 +0000 UTC m=+3.117917539" lastFinishedPulling="2026-06-03 16:34:37.904567856 +0000 UTC m=+39.318464614" observedRunningTime="2026-06-03 16:34:40.319383266 +0000 UTC m=+41.733280057" watchObservedRunningTime="2026-06-03 16:34:40.319643715 +0000 UTC m=+41.733540494" Jun 03 16:34:40.813214 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:40.813171 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:40.813395 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:40.813235 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:40.813395 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:40.813322 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:40.813395 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:40.813332 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:40.813395 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:40.813373 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:34:48.813359024 +0000 UTC m=+50.227255782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:34:40.813395 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:40.813386 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:34:48.813380127 +0000 UTC m=+50.227276884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:34:48.868908 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:48.868858 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:34:48.869524 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:48.869027 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:34:48.869524 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:48.869029 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:34:48.869524 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:48.869175 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:35:04.869153931 +0000 UTC m=+66.283050694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:34:48.869524 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:48.869069 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:34:48.869524 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:34:48.869227 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:35:04.869218009 +0000 UTC m=+66.283114767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:34:59.281655 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:34:59.281474 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9mbgc" Jun 03 16:35:04.774094 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.774051 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:35:04.776321 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.776301 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:35:04.784809 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:04.784787 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:35:04.784906 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:04.784882 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs podName:a2c6e2c1-2fef-45f5-bdb9-386cb17371e5 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:08.784858022 +0000 UTC m=+130.198754779 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs") pod "network-metrics-daemon-6xqz7" (UID: "a2c6e2c1-2fef-45f5-bdb9-386cb17371e5") : secret "metrics-daemon-secret" not found Jun 03 16:35:04.874855 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.874815 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:35:04.875021 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.874872 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:35:04.875021 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.874914 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:35:04.875021 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:04.875019 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:35:04.875141 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:04.875032 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:35:04.875141 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:04.875096 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:35:36.875080356 +0000 UTC m=+98.288977114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:35:04.875141 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:04.875111 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:35:36.875103731 +0000 UTC m=+98.289000489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:35:04.877253 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.877236 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:35:04.887481 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.887458 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:35:04.900015 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.899988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzghr\" (UniqueName: \"kubernetes.io/projected/7bdb1b84-6ac2-475e-b999-91f288db1cd5-kube-api-access-lzghr\") pod \"network-check-target-hmxgz\" (UID: \"7bdb1b84-6ac2-475e-b999-91f288db1cd5\") " pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:35:04.934201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.934169 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r657c\"" Jun 03 16:35:04.942838 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:04.942814 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:35:05.070515 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:05.070476 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmxgz"] Jun 03 16:35:05.074550 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:35:05.074522 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdb1b84_6ac2_475e_b999_91f288db1cd5.slice/crio-48d8b436f87811bdad36f98b4538a653b325683b4a6e6942f4d1f4d6316d4ad7 WatchSource:0}: Error finding container 48d8b436f87811bdad36f98b4538a653b325683b4a6e6942f4d1f4d6316d4ad7: Status 404 returned error can't find the container with id 48d8b436f87811bdad36f98b4538a653b325683b4a6e6942f4d1f4d6316d4ad7 Jun 03 16:35:05.346478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:05.346442 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmxgz" event={"ID":"7bdb1b84-6ac2-475e-b999-91f288db1cd5","Type":"ContainerStarted","Data":"48d8b436f87811bdad36f98b4538a653b325683b4a6e6942f4d1f4d6316d4ad7"} Jun 03 16:35:08.354010 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:08.353953 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmxgz" event={"ID":"7bdb1b84-6ac2-475e-b999-91f288db1cd5","Type":"ContainerStarted","Data":"477c25da7c4ecd4e51dd01258b61e7a7d73c4121ecfefe528de271b52cff1557"} Jun 03 16:35:08.354391 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:08.354098 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:35:08.369723 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:08.369676 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hmxgz" podStartSLOduration=66.317105214 podStartE2EDuration="1m9.369661316s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:35:05.076537789 +0000 UTC m=+66.490434546" lastFinishedPulling="2026-06-03 16:35:08.12909388 +0000 UTC m=+69.542990648" observedRunningTime="2026-06-03 16:35:08.368130176 +0000 UTC m=+69.782026955" watchObservedRunningTime="2026-06-03 16:35:08.369661316 +0000 UTC m=+69.783558092" Jun 03 16:35:36.896489 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:36.896453 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:35:36.896922 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:36.896517 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:35:36.896922 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:36.896617 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:35:36.896922 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:36.896684 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert podName:fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a nodeName:}" failed. No retries permitted until 2026-06-03 16:36:40.896670228 +0000 UTC m=+162.310566985 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert") pod "ingress-canary-vltxp" (UID: "fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a") : secret "canary-serving-cert" not found Jun 03 16:35:36.896922 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:36.896617 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:35:36.896922 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:36.896787 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls podName:e2a436fb-5a27-4fe4-8b87-56ade6e6370d nodeName:}" failed. No retries permitted until 2026-06-03 16:36:40.89676649 +0000 UTC m=+162.310663268 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls") pod "dns-default-svwtw" (UID: "e2a436fb-5a27-4fe4-8b87-56ade6e6370d") : secret "dns-default-metrics-tls" not found Jun 03 16:35:39.358494 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:39.358463 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hmxgz" Jun 03 16:35:48.676099 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.676066 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64"] Jun 03 16:35:48.678452 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.678434 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:48.679704 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.679677 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq"] Jun 03 16:35:48.680677 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.680651 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.680967 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.680947 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.681085 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.680953 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 16:35:48.681379 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.681362 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.681473 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.681412 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gvd5r\"" Jun 03 16:35:48.683132 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.683117 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.683272 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.683256 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 16:35:48.683436 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.683421 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 16:35:48.683500 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.683456 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dgq2r\"" Jun 03 16:35:48.683500 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.683467 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.689473 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.689456 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64"] Jun 03 16:35:48.692761 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.692742 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq"] Jun 03 16:35:48.772628 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.772590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lswz\" (UniqueName: \"kubernetes.io/projected/a53c3f55-c957-4988-9767-28f32e9bbffb-kube-api-access-8lswz\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:48.772628 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.772633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8e6aaad-859e-443a-8df6-b0c16c961906-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.772844 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.772653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:48.772844 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.772671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclkb\" (UniqueName: \"kubernetes.io/projected/f8e6aaad-859e-443a-8df6-b0c16c961906-kube-api-access-dclkb\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.772844 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.772745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8e6aaad-859e-443a-8df6-b0c16c961906-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.782207 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.782170 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6"] Jun 03 16:35:48.784042 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.784021 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" Jun 03 16:35:48.786098 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.786081 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.786217 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.786120 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cm96p\"" Jun 03 16:35:48.786217 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.786138 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.789647 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.789627 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-ng9qq"] Jun 03 16:35:48.791109 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.791083 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5668b7b467-5ct5h"] Jun 03 16:35:48.791278 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.791262 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.792790 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.792770 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx"] Jun 03 16:35:48.792908 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.792890 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.793274 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.793256 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.793541 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.793526 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 16:35:48.793896 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.793881 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ghh5s\"" Jun 03 16:35:48.793896 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.793887 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.794061 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.793888 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 16:35:48.794322 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.794307 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" Jun 03 16:35:48.796150 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796116 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.796317 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796281 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 16:35:48.796317 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796296 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 16:35:48.796503 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796385 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.796589 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796507 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8s957\"" Jun 03 16:35:48.796714 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796695 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 16:35:48.796784 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.796712 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 16:35:48.797544 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.797509 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mspn6\"" Jun 03 16:35:48.798713 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.798692 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6"] Jun 03 16:35:48.802843 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.802820 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 16:35:48.804513 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.804495 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx"] Jun 03 16:35:48.805548 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.805530 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-ng9qq"] Jun 03 16:35:48.806513 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.806491 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5668b7b467-5ct5h"] Jun 03 16:35:48.873047 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873016 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dclkb\" (UniqueName: \"kubernetes.io/projected/f8e6aaad-859e-443a-8df6-b0c16c961906-kube-api-access-dclkb\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.873047 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252be81c-7dd7-4b62-92a8-143e49405472-service-ca-bundle\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.873257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8hz\" (UniqueName: \"kubernetes.io/projected/252be81c-7dd7-4b62-92a8-143e49405472-kube-api-access-fl8hz\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.873257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.873257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-stats-auth\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.873257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252be81c-7dd7-4b62-92a8-143e49405472-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.873376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjsg\" (UniqueName: \"kubernetes.io/projected/a30bb381-b051-45eb-9bd8-141d33b9c951-kube-api-access-xcjsg\") pod \"volume-data-source-validator-7598fd5bd-f79q6\" (UID: \"a30bb381-b051-45eb-9bd8-141d33b9c951\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" Jun 03 16:35:48.873376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/252be81c-7dd7-4b62-92a8-143e49405472-serving-cert\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.873376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873352 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8e6aaad-859e-443a-8df6-b0c16c961906-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.873376 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-default-certificate\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.873493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252be81c-7dd7-4b62-92a8-143e49405472-tmp\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.873493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/252be81c-7dd7-4b62-92a8-143e49405472-snapshots\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.873493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6b4r\" (UniqueName: \"kubernetes.io/projected/5b6baa9e-6cb5-4477-83e3-6af98dfebaf6-kube-api-access-v6b4r\") pod \"network-check-source-56d84b9f44-qdwsx\" (UID: \"5b6baa9e-6cb5-4477-83e3-6af98dfebaf6\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" Jun 03 16:35:48.873493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.873603 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6ktx\" (UniqueName: \"kubernetes.io/projected/044bd7e8-853d-4544-a307-c4bb808c623e-kube-api-access-b6ktx\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.873603 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873539 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lswz\" (UniqueName: \"kubernetes.io/projected/a53c3f55-c957-4988-9767-28f32e9bbffb-kube-api-access-8lswz\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:48.873603 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873573 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8e6aaad-859e-443a-8df6-b0c16c961906-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.873690 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.873599 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:48.873722 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:48.873707 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:35:48.873793 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:48.873782 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls podName:a53c3f55-c957-4988-9767-28f32e9bbffb nodeName:}" failed. No retries permitted until 2026-06-03 16:35:49.373763872 +0000 UTC m=+110.787660644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-sff64" (UID: "a53c3f55-c957-4988-9767-28f32e9bbffb") : secret "samples-operator-tls" not found Jun 03 16:35:48.874023 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.874004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f8e6aaad-859e-443a-8df6-b0c16c961906-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.875753 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.875735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f8e6aaad-859e-443a-8df6-b0c16c961906-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.883148 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.883124 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-68zcr"] Jun 03 16:35:48.884944 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.884930 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:48.886398 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.886378 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85b9cbbc6b-vpjjt"] Jun 03 16:35:48.886951 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.886932 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4v6j4\"" Jun 03 16:35:48.887152 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.887127 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 16:35:48.887290 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.887173 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 16:35:48.887290 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.887202 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:35:48.887388 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.887292 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 16:35:48.888111 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.888095 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.889478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.889457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclkb\" (UniqueName: \"kubernetes.io/projected/f8e6aaad-859e-443a-8df6-b0c16c961906-kube-api-access-dclkb\") pod \"kube-storage-version-migrator-operator-96ddc787c-wzprq\" (UID: \"f8e6aaad-859e-443a-8df6-b0c16c961906\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:48.889842 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.889817 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 16:35:48.889842 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.889831 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 16:35:48.889954 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.889854 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 16:35:48.889954 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.889872 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pccbg\"" Jun 03 16:35:48.895146 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.895126 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 16:35:48.896611 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.896590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lswz\" (UniqueName: \"kubernetes.io/projected/a53c3f55-c957-4988-9767-28f32e9bbffb-kube-api-access-8lswz\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:48.897626 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.897607 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-68zcr"] Jun 03 16:35:48.901499 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.901466 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85b9cbbc6b-vpjjt"] Jun 03 16:35:48.974112 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-certificates\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.974112 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974061 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-default-certificate\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.974303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974111 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252be81c-7dd7-4b62-92a8-143e49405472-tmp\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.974303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974143 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/252be81c-7dd7-4b62-92a8-143e49405472-snapshots\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.974303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974245 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5h7\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-kube-api-access-xl5h7\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.974303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974280 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6b4r\" (UniqueName: \"kubernetes.io/projected/5b6baa9e-6cb5-4477-83e3-6af98dfebaf6-kube-api-access-v6b4r\") pod \"network-check-source-56d84b9f44-qdwsx\" (UID: \"5b6baa9e-6cb5-4477-83e3-6af98dfebaf6\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" Jun 03 16:35:48.974470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83a442ad-bce0-4e94-ac51-349784e6b5e2-serving-cert\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:48.974470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974338 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ktx\" (UniqueName: \"kubernetes.io/projected/044bd7e8-853d-4544-a307-c4bb808c623e-kube-api-access-b6ktx\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.974470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974419 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252be81c-7dd7-4b62-92a8-143e49405472-service-ca-bundle\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.974613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-image-registry-private-configuration\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.974613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.974613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974526 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-stats-auth\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.974613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252be81c-7dd7-4b62-92a8-143e49405472-tmp\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.974613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974570 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/252be81c-7dd7-4b62-92a8-143e49405472-serving-cert\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.974613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974606 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252be81c-7dd7-4b62-92a8-143e49405472-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.974907 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974636 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjsg\" (UniqueName: \"kubernetes.io/projected/a30bb381-b051-45eb-9bd8-141d33b9c951-kube-api-access-xcjsg\") pod \"volume-data-source-validator-7598fd5bd-f79q6\" (UID: \"a30bb381-b051-45eb-9bd8-141d33b9c951\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" Jun 03 16:35:48.974907 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/273fd345-d13d-4738-8aa4-6fa1fda41bdd-ca-trust-extracted\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.974907 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974705 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.975092 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.974930 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/252be81c-7dd7-4b62-92a8-143e49405472-snapshots\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.975092 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhjml\" (UniqueName: \"kubernetes.io/projected/83a442ad-bce0-4e94-ac51-349784e6b5e2-kube-api-access-jhjml\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:48.975201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252be81c-7dd7-4b62-92a8-143e49405472-service-ca-bundle\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.975201 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:48.975170 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:35:48.975294 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975200 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8hz\" (UniqueName: \"kubernetes.io/projected/252be81c-7dd7-4b62-92a8-143e49405472-kube-api-access-fl8hz\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.975294 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:48.975232 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:49.47521334 +0000 UTC m=+110.889110097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : secret "router-metrics-certs-default" not found Jun 03 16:35:48.975294 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-bound-sa-token\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.975453 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-installation-pull-secrets\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.975453 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975350 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.975453 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83a442ad-bce0-4e94-ac51-349784e6b5e2-config\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:48.975453 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975437 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-trusted-ca\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:48.975636 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:48.975602 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:49.475584672 +0000 UTC m=+110.889481462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : configmap references non-existent config key: service-ca.crt Jun 03 16:35:48.975722 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.975704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252be81c-7dd7-4b62-92a8-143e49405472-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.976852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.976824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-stats-auth\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.977057 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.977040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-default-certificate\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.977169 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.977150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/252be81c-7dd7-4b62-92a8-143e49405472-serving-cert\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.982069 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.982033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjsg\" (UniqueName: \"kubernetes.io/projected/a30bb381-b051-45eb-9bd8-141d33b9c951-kube-api-access-xcjsg\") pod \"volume-data-source-validator-7598fd5bd-f79q6\" (UID: \"a30bb381-b051-45eb-9bd8-141d33b9c951\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" Jun 03 16:35:48.982069 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.982058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6b4r\" (UniqueName: \"kubernetes.io/projected/5b6baa9e-6cb5-4477-83e3-6af98dfebaf6-kube-api-access-v6b4r\") pod \"network-check-source-56d84b9f44-qdwsx\" (UID: \"5b6baa9e-6cb5-4477-83e3-6af98dfebaf6\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" Jun 03 16:35:48.983267 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.983247 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6ktx\" (UniqueName: \"kubernetes.io/projected/044bd7e8-853d-4544-a307-c4bb808c623e-kube-api-access-b6ktx\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:48.983370 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.983314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8hz\" (UniqueName: \"kubernetes.io/projected/252be81c-7dd7-4b62-92a8-143e49405472-kube-api-access-fl8hz\") pod \"insights-operator-788bf58df5-ng9qq\" (UID: \"252be81c-7dd7-4b62-92a8-143e49405472\") " pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:48.994210 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:48.994182 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" Jun 03 16:35:49.076250 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076223 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-image-registry-private-configuration\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076261 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076306 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/273fd345-d13d-4738-8aa4-6fa1fda41bdd-ca-trust-extracted\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076382 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhjml\" (UniqueName: \"kubernetes.io/projected/83a442ad-bce0-4e94-ac51-349784e6b5e2-kube-api-access-jhjml\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.076558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076439 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-bound-sa-token\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076477 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-installation-pull-secrets\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076516 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83a442ad-bce0-4e94-ac51-349784e6b5e2-config\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.076558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-trusted-ca\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076746 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076582 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-certificates\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076746 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076653 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5h7\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-kube-api-access-xl5h7\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.076746 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.076690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83a442ad-bce0-4e94-ac51-349784e6b5e2-serving-cert\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.077056 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.076933 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:35:49.077056 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.076965 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b9cbbc6b-vpjjt: secret "image-registry-tls" not found Jun 03 16:35:49.077056 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.077048 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls podName:273fd345-d13d-4738-8aa4-6fa1fda41bdd nodeName:}" failed. No retries permitted until 2026-06-03 16:35:49.577028599 +0000 UTC m=+110.990925384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls") pod "image-registry-85b9cbbc6b-vpjjt" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd") : secret "image-registry-tls" not found Jun 03 16:35:49.077325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.077303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/273fd345-d13d-4738-8aa4-6fa1fda41bdd-ca-trust-extracted\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.077721 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.077700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83a442ad-bce0-4e94-ac51-349784e6b5e2-config\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.077721 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.077712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-certificates\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.078520 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.078470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-trusted-ca\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.079902 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.079876 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-installation-pull-secrets\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.080379 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.080359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83a442ad-bce0-4e94-ac51-349784e6b5e2-serving-cert\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.080474 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.080428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-image-registry-private-configuration\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.087956 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.087924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhjml\" (UniqueName: \"kubernetes.io/projected/83a442ad-bce0-4e94-ac51-349784e6b5e2-kube-api-access-jhjml\") pod \"service-ca-operator-69877444c-68zcr\" (UID: \"83a442ad-bce0-4e94-ac51-349784e6b5e2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.088128 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.088107 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-bound-sa-token\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.088623 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.088604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5h7\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-kube-api-access-xl5h7\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.093400 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.093384 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" Jun 03 16:35:49.102304 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.102281 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" Jun 03 16:35:49.116865 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.116833 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq"] Jun 03 16:35:49.118696 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.118667 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" Jun 03 16:35:49.120096 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:35:49.120068 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e6aaad_859e_443a_8df6_b0c16c961906.slice/crio-9d29851c84112abcd98c84768f5bd569389d6eaac35d4b38f12eb623d1514186 WatchSource:0}: Error finding container 9d29851c84112abcd98c84768f5bd569389d6eaac35d4b38f12eb623d1514186: Status 404 returned error can't find the container with id 9d29851c84112abcd98c84768f5bd569389d6eaac35d4b38f12eb623d1514186 Jun 03 16:35:49.206632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.206606 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" Jun 03 16:35:49.243150 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.242287 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6"] Jun 03 16:35:49.251328 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:35:49.251281 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30bb381_b051_45eb_9bd8_141d33b9c951.slice/crio-b123dfd022b5fe280a238e8a9f0a428e19a1091508bc72d3adf16eab006a8c2e WatchSource:0}: Error finding container b123dfd022b5fe280a238e8a9f0a428e19a1091508bc72d3adf16eab006a8c2e: Status 404 returned error can't find the container with id b123dfd022b5fe280a238e8a9f0a428e19a1091508bc72d3adf16eab006a8c2e Jun 03 16:35:49.343263 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.343230 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-68zcr"] Jun 03 16:35:49.346159 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:35:49.346131 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a442ad_bce0_4e94_ac51_349784e6b5e2.slice/crio-e10971686b92ca017d860815b331f8f1128028fcf6815d5b1d215efb88935e4d WatchSource:0}: Error finding container e10971686b92ca017d860815b331f8f1128028fcf6815d5b1d215efb88935e4d: Status 404 returned error can't find the container with id e10971686b92ca017d860815b331f8f1128028fcf6815d5b1d215efb88935e4d Jun 03 16:35:49.380310 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.380266 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:49.380483 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.380419 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:35:49.380523 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.380490 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls podName:a53c3f55-c957-4988-9767-28f32e9bbffb nodeName:}" failed. No retries permitted until 2026-06-03 16:35:50.380473166 +0000 UTC m=+111.794369923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-sff64" (UID: "a53c3f55-c957-4988-9767-28f32e9bbffb") : secret "samples-operator-tls" not found Jun 03 16:35:49.432880 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.432841 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" event={"ID":"83a442ad-bce0-4e94-ac51-349784e6b5e2","Type":"ContainerStarted","Data":"e10971686b92ca017d860815b331f8f1128028fcf6815d5b1d215efb88935e4d"} Jun 03 16:35:49.433874 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.433848 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" event={"ID":"a30bb381-b051-45eb-9bd8-141d33b9c951","Type":"ContainerStarted","Data":"b123dfd022b5fe280a238e8a9f0a428e19a1091508bc72d3adf16eab006a8c2e"} Jun 03 16:35:49.434729 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.434706 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" event={"ID":"f8e6aaad-859e-443a-8df6-b0c16c961906","Type":"ContainerStarted","Data":"9d29851c84112abcd98c84768f5bd569389d6eaac35d4b38f12eb623d1514186"} Jun 03 16:35:49.467910 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.467875 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx"] Jun 03 16:35:49.470234 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:35:49.470206 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6baa9e_6cb5_4477_83e3_6af98dfebaf6.slice/crio-3b717f21f736ef9ea5a598d2ef5c95428b737ac8dce00a1aa1581bc04d6c276e WatchSource:0}: Error finding container 3b717f21f736ef9ea5a598d2ef5c95428b737ac8dce00a1aa1581bc04d6c276e: Status 404 returned error can't find the container with id 3b717f21f736ef9ea5a598d2ef5c95428b737ac8dce00a1aa1581bc04d6c276e Jun 03 16:35:49.470234 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.470213 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-ng9qq"] Jun 03 16:35:49.473124 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:35:49.473017 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252be81c_7dd7_4b62_92a8_143e49405472.slice/crio-93676145ac2d57266b12f8d1c7316c874ffa138adcbfae8af4766b8dd85ab220 WatchSource:0}: Error finding container 93676145ac2d57266b12f8d1c7316c874ffa138adcbfae8af4766b8dd85ab220: Status 404 returned error can't find the container with id 93676145ac2d57266b12f8d1c7316c874ffa138adcbfae8af4766b8dd85ab220 Jun 03 16:35:49.480631 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.480605 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:49.480708 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.480692 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:49.480799 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.480780 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:50.480756319 +0000 UTC m=+111.894653096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : configmap references non-existent config key: service-ca.crt Jun 03 16:35:49.480842 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.480830 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:35:49.480881 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.480873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:50.480861793 +0000 UTC m=+111.894758551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : secret "router-metrics-certs-default" not found Jun 03 16:35:49.581713 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:49.581664 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:49.581860 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.581822 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:35:49.581860 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.581844 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b9cbbc6b-vpjjt: secret "image-registry-tls" not found Jun 03 16:35:49.581945 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:49.581902 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls podName:273fd345-d13d-4738-8aa4-6fa1fda41bdd nodeName:}" failed. No retries permitted until 2026-06-03 16:35:50.581884557 +0000 UTC m=+111.995781314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls") pod "image-registry-85b9cbbc6b-vpjjt" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd") : secret "image-registry-tls" not found Jun 03 16:35:50.389620 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.389577 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:50.390118 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.389732 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:35:50.390118 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.389813 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls podName:a53c3f55-c957-4988-9767-28f32e9bbffb nodeName:}" failed. No retries permitted until 2026-06-03 16:35:52.389789361 +0000 UTC m=+113.803686122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-sff64" (UID: "a53c3f55-c957-4988-9767-28f32e9bbffb") : secret "samples-operator-tls" not found Jun 03 16:35:50.440063 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.440012 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" event={"ID":"252be81c-7dd7-4b62-92a8-143e49405472","Type":"ContainerStarted","Data":"93676145ac2d57266b12f8d1c7316c874ffa138adcbfae8af4766b8dd85ab220"} Jun 03 16:35:50.443726 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.442761 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" event={"ID":"5b6baa9e-6cb5-4477-83e3-6af98dfebaf6","Type":"ContainerStarted","Data":"9712da8a5e2b9c5f3e00436f63748386d88deaf2022dd6ea85b844e5ec01dcde"} Jun 03 16:35:50.443726 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.442800 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" event={"ID":"5b6baa9e-6cb5-4477-83e3-6af98dfebaf6","Type":"ContainerStarted","Data":"3b717f21f736ef9ea5a598d2ef5c95428b737ac8dce00a1aa1581bc04d6c276e"} Jun 03 16:35:50.490379 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.490337 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:50.490575 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.490434 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:50.490649 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.490583 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:52.490564153 +0000 UTC m=+113.904460932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : configmap references non-existent config key: service-ca.crt Jun 03 16:35:50.490838 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.490807 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:35:50.490996 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.490873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:52.490854629 +0000 UTC m=+113.904751393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : secret "router-metrics-certs-default" not found Jun 03 16:35:50.592549 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:50.591934 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:50.592549 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.592100 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:35:50.592549 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.592118 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b9cbbc6b-vpjjt: secret "image-registry-tls" not found Jun 03 16:35:50.592549 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:50.592178 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls podName:273fd345-d13d-4738-8aa4-6fa1fda41bdd nodeName:}" failed. No retries permitted until 2026-06-03 16:35:52.592157836 +0000 UTC m=+114.006054598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls") pod "image-registry-85b9cbbc6b-vpjjt" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd") : secret "image-registry-tls" not found Jun 03 16:35:51.447052 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:51.447008 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" event={"ID":"a30bb381-b051-45eb-9bd8-141d33b9c951","Type":"ContainerStarted","Data":"5532b904ec89aed1d7f3ba616199adacb97c93d27046c583d41a36d852c8cb1c"} Jun 03 16:35:51.461985 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:51.461906 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-f79q6" podStartSLOduration=1.4532189180000001 podStartE2EDuration="3.461885474s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:35:49.25352885 +0000 UTC m=+110.667425608" lastFinishedPulling="2026-06-03 16:35:51.262195406 +0000 UTC m=+112.676092164" observedRunningTime="2026-06-03 16:35:51.461077328 +0000 UTC m=+112.874974110" watchObservedRunningTime="2026-06-03 16:35:51.461885474 +0000 UTC m=+112.875782363" Jun 03 16:35:51.462473 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:51.462441 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qdwsx" podStartSLOduration=3.462431067 podStartE2EDuration="3.462431067s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:35:50.456760866 +0000 UTC m=+111.870657647" watchObservedRunningTime="2026-06-03 16:35:51.462431067 +0000 UTC m=+112.876327848" Jun 03 16:35:52.410373 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:52.410335 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:52.410561 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.410496 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:35:52.410613 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.410567 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls podName:a53c3f55-c957-4988-9767-28f32e9bbffb nodeName:}" failed. No retries permitted until 2026-06-03 16:35:56.410551242 +0000 UTC m=+117.824448000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-sff64" (UID: "a53c3f55-c957-4988-9767-28f32e9bbffb") : secret "samples-operator-tls" not found Jun 03 16:35:52.511418 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:52.511377 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:52.511903 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:52.511466 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:52.511903 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.511551 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:35:52.511903 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.511628 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:56.511606473 +0000 UTC m=+117.925503305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : secret "router-metrics-certs-default" not found Jun 03 16:35:52.511903 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.511652 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:35:56.511638829 +0000 UTC m=+117.925535591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : configmap references non-existent config key: service-ca.crt Jun 03 16:35:52.612565 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:52.612520 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:52.612759 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.612673 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:35:52.612759 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.612693 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b9cbbc6b-vpjjt: secret "image-registry-tls" not found Jun 03 16:35:52.612759 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:52.612757 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls podName:273fd345-d13d-4738-8aa4-6fa1fda41bdd nodeName:}" failed. No retries permitted until 2026-06-03 16:35:56.612735317 +0000 UTC m=+118.026632091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls") pod "image-registry-85b9cbbc6b-vpjjt" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd") : secret "image-registry-tls" not found Jun 03 16:35:53.453767 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:53.453720 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" event={"ID":"f8e6aaad-859e-443a-8df6-b0c16c961906","Type":"ContainerStarted","Data":"ea482101d5672fef22c2ffe8554ab57c08b9506aff44054f9df5799816fddef2"} Jun 03 16:35:53.455326 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:53.455284 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" event={"ID":"252be81c-7dd7-4b62-92a8-143e49405472","Type":"ContainerStarted","Data":"ec05300f945ebab0777933603ca136d83b9d42f953fc70e799b48a8e293058a7"} Jun 03 16:35:53.456586 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:53.456553 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" event={"ID":"83a442ad-bce0-4e94-ac51-349784e6b5e2","Type":"ContainerStarted","Data":"13a201e74a275c1a7560de44361f24967ac2109212ba58cbfeb1f606d2a128a8"} Jun 03 16:35:53.468064 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:53.468015 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" podStartSLOduration=1.8153855129999998 podStartE2EDuration="5.46799902s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:35:49.123429244 +0000 UTC m=+110.537326002" lastFinishedPulling="2026-06-03 16:35:52.776042751 +0000 UTC m=+114.189939509" observedRunningTime="2026-06-03 16:35:53.467128929 +0000 UTC m=+114.881025714" watchObservedRunningTime="2026-06-03 16:35:53.46799902 +0000 UTC m=+114.881895802" Jun 03 16:35:53.480672 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:53.480631 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" podStartSLOduration=2.049341481 podStartE2EDuration="5.48061731s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:35:49.347845416 +0000 UTC m=+110.761742174" lastFinishedPulling="2026-06-03 16:35:52.779121241 +0000 UTC m=+114.193018003" observedRunningTime="2026-06-03 16:35:53.479121535 +0000 UTC m=+114.893018314" watchObservedRunningTime="2026-06-03 16:35:53.48061731 +0000 UTC m=+114.894514081" Jun 03 16:35:53.495629 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:53.495578 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" podStartSLOduration=2.188418082 podStartE2EDuration="5.495559164s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:35:49.474603418 +0000 UTC m=+110.888500177" lastFinishedPulling="2026-06-03 16:35:52.781744498 +0000 UTC m=+114.195641259" observedRunningTime="2026-06-03 16:35:53.494527159 +0000 UTC m=+114.908423939" watchObservedRunningTime="2026-06-03 16:35:53.495559164 +0000 UTC m=+114.909455947" Jun 03 16:35:56.444820 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:56.444775 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:35:56.445308 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.444926 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 16:35:56.445308 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.445029 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls podName:a53c3f55-c957-4988-9767-28f32e9bbffb nodeName:}" failed. No retries permitted until 2026-06-03 16:36:04.445010423 +0000 UTC m=+125.858907198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-sff64" (UID: "a53c3f55-c957-4988-9767-28f32e9bbffb") : secret "samples-operator-tls" not found Jun 03 16:35:56.546216 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:56.546177 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:56.546415 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:56.546249 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:35:56.546415 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.546354 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:35:56.546517 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.546419 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:36:04.546401494 +0000 UTC m=+125.960298251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : configmap references non-existent config key: service-ca.crt Jun 03 16:35:56.546517 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.546439 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:36:04.546433211 +0000 UTC m=+125.960329969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : secret "router-metrics-certs-default" not found Jun 03 16:35:56.637205 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:56.637179 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9g6p_f379d1d0-19d7-4e30-89e9-21b07792bfb4/dns-node-resolver/0.log" Jun 03 16:35:56.647542 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:56.647512 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:35:56.647687 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.647671 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:35:56.647756 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.647691 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85b9cbbc6b-vpjjt: secret "image-registry-tls" not found Jun 03 16:35:56.647808 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:35:56.647756 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls podName:273fd345-d13d-4738-8aa4-6fa1fda41bdd nodeName:}" failed. No retries permitted until 2026-06-03 16:36:04.64773475 +0000 UTC m=+126.061631523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls") pod "image-registry-85b9cbbc6b-vpjjt" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd") : secret "image-registry-tls" not found Jun 03 16:35:57.637650 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:35:57.637621 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qszst_8d0d9875-93c9-4a87-9791-e172b02c7f1e/node-ca/0.log" Jun 03 16:36:04.515203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.515166 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:36:04.517737 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.517711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a53c3f55-c957-4988-9767-28f32e9bbffb-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-sff64\" (UID: \"a53c3f55-c957-4988-9767-28f32e9bbffb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:36:04.592336 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.592288 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gvd5r\"" Jun 03 16:36:04.600038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.600015 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" Jun 03 16:36:04.616009 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.615964 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:04.616114 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.616037 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:04.616156 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:04.616113 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 16:36:04.616156 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:04.616150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:36:20.616137375 +0000 UTC m=+142.030034133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : configmap references non-existent config key: service-ca.crt Jun 03 16:36:04.616224 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:04.616171 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs podName:044bd7e8-853d-4544-a307-c4bb808c623e nodeName:}" failed. No retries permitted until 2026-06-03 16:36:20.616158433 +0000 UTC m=+142.030055195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs") pod "router-default-5668b7b467-5ct5h" (UID: "044bd7e8-853d-4544-a307-c4bb808c623e") : secret "router-metrics-certs-default" not found Jun 03 16:36:04.716636 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.716593 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:36:04.719312 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.719285 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"image-registry-85b9cbbc6b-vpjjt\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:36:04.720391 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.720367 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64"] Jun 03 16:36:04.813812 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.813779 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pccbg\"" Jun 03 16:36:04.821853 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.821824 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:36:04.967240 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:04.967211 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85b9cbbc6b-vpjjt"] Jun 03 16:36:04.970377 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:04.970347 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273fd345_d13d_4738_8aa4_6fa1fda41bdd.slice/crio-10d027c555aea708c9309e38e1fa5860e4a735c659afa992988498a43e407535 WatchSource:0}: Error finding container 10d027c555aea708c9309e38e1fa5860e4a735c659afa992988498a43e407535: Status 404 returned error can't find the container with id 10d027c555aea708c9309e38e1fa5860e4a735c659afa992988498a43e407535 Jun 03 16:36:05.485254 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:05.485216 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" event={"ID":"273fd345-d13d-4738-8aa4-6fa1fda41bdd","Type":"ContainerStarted","Data":"b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057"} Jun 03 16:36:05.485254 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:05.485257 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" event={"ID":"273fd345-d13d-4738-8aa4-6fa1fda41bdd","Type":"ContainerStarted","Data":"10d027c555aea708c9309e38e1fa5860e4a735c659afa992988498a43e407535"} Jun 03 16:36:05.485490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:05.485470 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:36:05.486228 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:05.486209 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" event={"ID":"a53c3f55-c957-4988-9767-28f32e9bbffb","Type":"ContainerStarted","Data":"99aa6b01600c445f4fac75efd5eeb5e3ee484addd58e7f2e508665b7f4bb9735"} Jun 03 16:36:05.502680 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:05.502635 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" podStartSLOduration=17.502619998 podStartE2EDuration="17.502619998s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:36:05.502276387 +0000 UTC m=+126.916173189" watchObservedRunningTime="2026-06-03 16:36:05.502619998 +0000 UTC m=+126.916516778" Jun 03 16:36:07.492526 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:07.492489 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" event={"ID":"a53c3f55-c957-4988-9767-28f32e9bbffb","Type":"ContainerStarted","Data":"b94f6e03c6dafb368d36519ba74fb9b9541cc31ba294d916619adebc94dd98b6"} Jun 03 16:36:07.492526 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:07.492527 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" event={"ID":"a53c3f55-c957-4988-9767-28f32e9bbffb","Type":"ContainerStarted","Data":"a0e37be20ea69792e6ca94f95d2b5c07fcbb4dc2af673f731de073ab3bbd0164"} Jun 03 16:36:07.509906 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:07.509859 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-sff64" podStartSLOduration=17.229732068 podStartE2EDuration="19.509844838s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="2026-06-03 16:36:04.763611421 +0000 UTC m=+126.177508178" lastFinishedPulling="2026-06-03 16:36:07.04372417 +0000 UTC m=+128.457620948" observedRunningTime="2026-06-03 16:36:07.50889739 +0000 UTC m=+128.922794170" watchObservedRunningTime="2026-06-03 16:36:07.509844838 +0000 UTC m=+128.923741639" Jun 03 16:36:08.851731 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:08.851690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:36:08.854177 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:08.854154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2c6e2c1-2fef-45f5-bdb9-386cb17371e5-metrics-certs\") pod \"network-metrics-daemon-6xqz7\" (UID: \"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5\") " pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:36:08.929849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:08.929817 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fx9bm\"" Jun 03 16:36:08.938243 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:08.938221 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xqz7" Jun 03 16:36:09.056801 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:09.056770 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xqz7"] Jun 03 16:36:09.059950 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:09.059924 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c6e2c1_2fef_45f5_bdb9_386cb17371e5.slice/crio-4d824c47b630f8c2f8a4efecf0bc22da91fa16583c91ee00bf6f68ffd2d6ea9c WatchSource:0}: Error finding container 4d824c47b630f8c2f8a4efecf0bc22da91fa16583c91ee00bf6f68ffd2d6ea9c: Status 404 returned error can't find the container with id 4d824c47b630f8c2f8a4efecf0bc22da91fa16583c91ee00bf6f68ffd2d6ea9c Jun 03 16:36:09.499857 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:09.499822 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xqz7" event={"ID":"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5","Type":"ContainerStarted","Data":"4d824c47b630f8c2f8a4efecf0bc22da91fa16583c91ee00bf6f68ffd2d6ea9c"} Jun 03 16:36:11.508440 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:11.508397 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xqz7" event={"ID":"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5","Type":"ContainerStarted","Data":"af82c6e03486a2b2800366cf5900fe2f656ba1babaddc67e360e6501f56a22d5"} Jun 03 16:36:11.508440 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:11.508446 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xqz7" event={"ID":"a2c6e2c1-2fef-45f5-bdb9-386cb17371e5","Type":"ContainerStarted","Data":"5878d0281a5aba85fb3851cb97b759026c0a3a8f0e595d827a96e298266e08d5"} Jun 03 16:36:11.523499 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:11.523458 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6xqz7" podStartSLOduration=131.147636018 podStartE2EDuration="2m12.523445446s" podCreationTimestamp="2026-06-03 16:33:59 +0000 UTC" firstStartedPulling="2026-06-03 16:36:09.062212751 +0000 UTC m=+130.476109508" lastFinishedPulling="2026-06-03 16:36:10.438022178 +0000 UTC m=+131.851918936" observedRunningTime="2026-06-03 16:36:11.522560196 +0000 UTC m=+132.936456987" watchObservedRunningTime="2026-06-03 16:36:11.523445446 +0000 UTC m=+132.937342229" Jun 03 16:36:17.307888 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.307854 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85b9cbbc6b-vpjjt"] Jun 03 16:36:17.324701 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.324675 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-649b99cb7c-srjdh"] Jun 03 16:36:17.327740 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.327723 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.339819 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.339797 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5xm9n"] Jun 03 16:36:17.342727 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.342710 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.345418 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.345396 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 16:36:17.347047 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.345579 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m97v2\"" Jun 03 16:36:17.347047 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.346422 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 16:36:17.347047 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.346955 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649b99cb7c-srjdh"] Jun 03 16:36:17.353651 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.353630 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5xm9n"] Jun 03 16:36:17.412326 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32552565-d592-4d25-86ae-7b43a1bcd396-ca-trust-extracted\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32552565-d592-4d25-86ae-7b43a1bcd396-installation-pull-secrets\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd413b4d-cd40-409c-9d29-253bd496efe1-crio-socket\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.412497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32552565-d592-4d25-86ae-7b43a1bcd396-image-registry-private-configuration\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32552565-d592-4d25-86ae-7b43a1bcd396-registry-certificates\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lklxq\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-kube-api-access-lklxq\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412657 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd413b4d-cd40-409c-9d29-253bd496efe1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.412657 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-bound-sa-token\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412657 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhq72\" (UniqueName: \"kubernetes.io/projected/fd413b4d-cd40-409c-9d29-253bd496efe1-kube-api-access-jhq72\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.412657 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd413b4d-cd40-409c-9d29-253bd496efe1-data-volume\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.412776 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-registry-tls\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.412776 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd413b4d-cd40-409c-9d29-253bd496efe1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.412776 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.412703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32552565-d592-4d25-86ae-7b43a1bcd396-trusted-ca\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513269 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513239 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd413b4d-cd40-409c-9d29-253bd496efe1-crio-socket\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.513451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513302 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32552565-d592-4d25-86ae-7b43a1bcd396-image-registry-private-configuration\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513320 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32552565-d592-4d25-86ae-7b43a1bcd396-registry-certificates\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513339 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lklxq\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-kube-api-access-lklxq\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513356 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd413b4d-cd40-409c-9d29-253bd496efe1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.513451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fd413b4d-cd40-409c-9d29-253bd496efe1-crio-socket\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.513451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513421 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-bound-sa-token\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513462 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhq72\" (UniqueName: \"kubernetes.io/projected/fd413b4d-cd40-409c-9d29-253bd496efe1-kube-api-access-jhq72\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513496 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd413b4d-cd40-409c-9d29-253bd496efe1-data-volume\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513531 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-registry-tls\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513552 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd413b4d-cd40-409c-9d29-253bd496efe1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513584 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32552565-d592-4d25-86ae-7b43a1bcd396-trusted-ca\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513622 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32552565-d592-4d25-86ae-7b43a1bcd396-ca-trust-extracted\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.513749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513668 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32552565-d592-4d25-86ae-7b43a1bcd396-installation-pull-secrets\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.514209 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.513898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd413b4d-cd40-409c-9d29-253bd496efe1-data-volume\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.514628 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.514343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fd413b4d-cd40-409c-9d29-253bd496efe1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.514628 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.514515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32552565-d592-4d25-86ae-7b43a1bcd396-registry-certificates\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.514628 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.514582 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32552565-d592-4d25-86ae-7b43a1bcd396-ca-trust-extracted\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.514955 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.514934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32552565-d592-4d25-86ae-7b43a1bcd396-trusted-ca\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.516074 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.516046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32552565-d592-4d25-86ae-7b43a1bcd396-image-registry-private-configuration\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.516178 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.516130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32552565-d592-4d25-86ae-7b43a1bcd396-installation-pull-secrets\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.516427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.516408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fd413b4d-cd40-409c-9d29-253bd496efe1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.516492 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.516433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-registry-tls\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.526314 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.526289 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-bound-sa-token\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.526561 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.526543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lklxq\" (UniqueName: \"kubernetes.io/projected/32552565-d592-4d25-86ae-7b43a1bcd396-kube-api-access-lklxq\") pod \"image-registry-649b99cb7c-srjdh\" (UID: \"32552565-d592-4d25-86ae-7b43a1bcd396\") " pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.526656 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.526637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhq72\" (UniqueName: \"kubernetes.io/projected/fd413b4d-cd40-409c-9d29-253bd496efe1-kube-api-access-jhq72\") pod \"insights-runtime-extractor-5xm9n\" (UID: \"fd413b4d-cd40-409c-9d29-253bd496efe1\") " pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.636554 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.636522 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:17.657041 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.657017 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5xm9n" Jun 03 16:36:17.773148 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.773039 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-649b99cb7c-srjdh"] Jun 03 16:36:17.775631 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:17.775600 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32552565_d592_4d25_86ae_7b43a1bcd396.slice/crio-0e82bfd96213fa4dc4e7739afd1c82123d6df2863789278eee97ae942275a36e WatchSource:0}: Error finding container 0e82bfd96213fa4dc4e7739afd1c82123d6df2863789278eee97ae942275a36e: Status 404 returned error can't find the container with id 0e82bfd96213fa4dc4e7739afd1c82123d6df2863789278eee97ae942275a36e Jun 03 16:36:17.787913 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:17.787890 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5xm9n"] Jun 03 16:36:17.790833 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:17.790809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd413b4d_cd40_409c_9d29_253bd496efe1.slice/crio-cd25fd5d6025b5b05389b37784d0dc87ae57c279b42dfed7e97cad0e9198499e WatchSource:0}: Error finding container cd25fd5d6025b5b05389b37784d0dc87ae57c279b42dfed7e97cad0e9198499e: Status 404 returned error can't find the container with id cd25fd5d6025b5b05389b37784d0dc87ae57c279b42dfed7e97cad0e9198499e Jun 03 16:36:18.530239 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:18.530154 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" event={"ID":"32552565-d592-4d25-86ae-7b43a1bcd396","Type":"ContainerStarted","Data":"6736fc446d9e15cc1002673c777834c8c063cd785a2cb68b32c6689724c4e82b"} Jun 03 16:36:18.530239 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:18.530213 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" event={"ID":"32552565-d592-4d25-86ae-7b43a1bcd396","Type":"ContainerStarted","Data":"0e82bfd96213fa4dc4e7739afd1c82123d6df2863789278eee97ae942275a36e"} Jun 03 16:36:18.530710 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:18.530269 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:18.531830 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:18.531808 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xm9n" event={"ID":"fd413b4d-cd40-409c-9d29-253bd496efe1","Type":"ContainerStarted","Data":"15e276969de870a5590b542857a5985d0007e06cfb950b8760dc6f6d8fe56949"} Jun 03 16:36:18.531940 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:18.531835 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xm9n" event={"ID":"fd413b4d-cd40-409c-9d29-253bd496efe1","Type":"ContainerStarted","Data":"cd25fd5d6025b5b05389b37784d0dc87ae57c279b42dfed7e97cad0e9198499e"} Jun 03 16:36:18.549363 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:18.549315 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podStartSLOduration=1.549300535 podStartE2EDuration="1.549300535s" podCreationTimestamp="2026-06-03 16:36:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:36:18.54848264 +0000 UTC m=+139.962379420" watchObservedRunningTime="2026-06-03 16:36:18.549300535 +0000 UTC m=+139.963197314" Jun 03 16:36:19.537589 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:19.537546 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xm9n" event={"ID":"fd413b4d-cd40-409c-9d29-253bd496efe1","Type":"ContainerStarted","Data":"24702cc0793b3d14cf18e2046887abba20eb32c4a0d1d4100cbb1663b6e5f935"} Jun 03 16:36:20.542092 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.542054 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5xm9n" event={"ID":"fd413b4d-cd40-409c-9d29-253bd496efe1","Type":"ContainerStarted","Data":"6970d35c9b9341afa30fa4109da3e65b9696d641041fc200ec8ac31f4f169e73"} Jun 03 16:36:20.559811 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.559764 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5xm9n" podStartSLOduration=1.004281378 podStartE2EDuration="3.559749689s" podCreationTimestamp="2026-06-03 16:36:17 +0000 UTC" firstStartedPulling="2026-06-03 16:36:17.837853892 +0000 UTC m=+139.251750650" lastFinishedPulling="2026-06-03 16:36:20.39332219 +0000 UTC m=+141.807218961" observedRunningTime="2026-06-03 16:36:20.557959057 +0000 UTC m=+141.971855848" watchObservedRunningTime="2026-06-03 16:36:20.559749689 +0000 UTC m=+141.973646469" Jun 03 16:36:20.643027 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.642932 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:20.643027 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.643021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:20.643680 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.643654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044bd7e8-853d-4544-a307-c4bb808c623e-service-ca-bundle\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:20.645334 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.645315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/044bd7e8-853d-4544-a307-c4bb808c623e-metrics-certs\") pod \"router-default-5668b7b467-5ct5h\" (UID: \"044bd7e8-853d-4544-a307-c4bb808c623e\") " pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:20.911804 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.911720 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mspn6\"" Jun 03 16:36:20.920256 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:20.920220 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:21.048444 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:21.048408 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5668b7b467-5ct5h"] Jun 03 16:36:21.051630 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:21.051603 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044bd7e8_853d_4544_a307_c4bb808c623e.slice/crio-3edf36ad7d71a11384fda93105aeedcd1b64e73c00710b36bc09fa305c1ad822 WatchSource:0}: Error finding container 3edf36ad7d71a11384fda93105aeedcd1b64e73c00710b36bc09fa305c1ad822: Status 404 returned error can't find the container with id 3edf36ad7d71a11384fda93105aeedcd1b64e73c00710b36bc09fa305c1ad822 Jun 03 16:36:21.546034 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:21.545997 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5668b7b467-5ct5h" event={"ID":"044bd7e8-853d-4544-a307-c4bb808c623e","Type":"ContainerStarted","Data":"178a344c13b6ce24e86395a59995683ce9d133a66a2cc0a371eabaa94cba6c39"} Jun 03 16:36:21.546034 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:21.546036 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5668b7b467-5ct5h" event={"ID":"044bd7e8-853d-4544-a307-c4bb808c623e","Type":"ContainerStarted","Data":"3edf36ad7d71a11384fda93105aeedcd1b64e73c00710b36bc09fa305c1ad822"} Jun 03 16:36:21.562515 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:21.562477 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5668b7b467-5ct5h" podStartSLOduration=33.562463128 podStartE2EDuration="33.562463128s" podCreationTimestamp="2026-06-03 16:35:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:36:21.561664782 +0000 UTC m=+142.975561573" watchObservedRunningTime="2026-06-03 16:36:21.562463128 +0000 UTC m=+142.976359908" Jun 03 16:36:21.920919 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:21.920879 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:21.923496 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:21.923475 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:22.548489 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:22.548452 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:22.549703 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:22.549680 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5668b7b467-5ct5h" Jun 03 16:36:27.313201 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:27.313157 2574 patch_prober.go:28] interesting pod/image-registry-85b9cbbc6b-vpjjt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:27.313577 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:27.313216 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:31.409158 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.409123 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c59cd5bf-ccpbb"] Jun 03 16:36:31.414066 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.414043 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.416111 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416088 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 16:36:31.416231 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416132 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 16:36:31.416921 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416894 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 16:36:31.416921 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416907 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 16:36:31.417128 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416894 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 16:36:31.417128 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416901 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6vt6b\"" Jun 03 16:36:31.417128 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416900 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 16:36:31.417128 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.416905 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 16:36:31.419909 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.419891 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 16:36:31.424615 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.424596 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c59cd5bf-ccpbb"] Jun 03 16:36:31.539036 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.538968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-config\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.539036 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.539040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-trusted-ca-bundle\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.539258 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.539103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-service-ca\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.539258 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.539159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-oauth-serving-cert\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.539258 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.539185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-serving-cert\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.539258 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.539209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-oauth-config\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.539258 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.539227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6m4n\" (UniqueName: \"kubernetes.io/projected/2fccd341-3e65-40bd-802e-825d8ba0e72e-kube-api-access-b6m4n\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.639964 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.639904 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-serving-cert\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.639964 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.639997 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-oauth-config\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640018 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6m4n\" (UniqueName: \"kubernetes.io/projected/2fccd341-3e65-40bd-802e-825d8ba0e72e-kube-api-access-b6m4n\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640130 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-config\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640172 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-trusted-ca-bundle\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640194 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-service-ca\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640409 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640222 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-oauth-serving-cert\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-config\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.640995 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-oauth-serving-cert\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.641063 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.640956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-service-ca\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.641366 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.641341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-trusted-ca-bundle\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.642502 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.642480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-serving-cert\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.642587 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.642566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-oauth-config\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.646981 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.646952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6m4n\" (UniqueName: \"kubernetes.io/projected/2fccd341-3e65-40bd-802e-825d8ba0e72e-kube-api-access-b6m4n\") pod \"console-64c59cd5bf-ccpbb\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.724038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.723947 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:31.796266 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.796238 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p4rg7"] Jun 03 16:36:31.800948 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.800923 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.802885 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.802864 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 16:36:31.803027 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.802883 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 16:36:31.803171 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.803158 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-glg92\"" Jun 03 16:36:31.803325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.803313 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 16:36:31.803416 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.803397 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 16:36:31.803572 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.803512 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 16:36:31.803690 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.803620 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 16:36:31.842191 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842162 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-tls\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842191 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-wtmp\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842380 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-metrics-client-ca\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842380 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-root\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842380 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842476 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-textfile\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842476 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-sys\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842476 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.842574 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.842482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmd6t\" (UniqueName: \"kubernetes.io/projected/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-kube-api-access-mmd6t\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.853351 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.853319 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c59cd5bf-ccpbb"] Jun 03 16:36:31.856258 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:31.856229 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fccd341_3e65_40bd_802e_825d8ba0e72e.slice/crio-dc39ba7dca693e461757a0ba1e7faf5470621a11e555831456f9b09cfe54d2cb WatchSource:0}: Error finding container dc39ba7dca693e461757a0ba1e7faf5470621a11e555831456f9b09cfe54d2cb: Status 404 returned error can't find the container with id dc39ba7dca693e461757a0ba1e7faf5470621a11e555831456f9b09cfe54d2cb Jun 03 16:36:31.943814 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.943772 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-tls\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.943814 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.943819 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-wtmp\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.943850 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-metrics-client-ca\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:31.943926 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:31.944025 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-tls podName:d6d5b8ad-ac0d-425f-8d7b-63985fae5481 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:32.444000734 +0000 UTC m=+153.857897507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-tls") pod "node-exporter-p4rg7" (UID: "d6d5b8ad-ac0d-425f-8d7b-63985fae5481") : secret "node-exporter-tls" not found Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944027 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-wtmp\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944047 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-root\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-root\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944102 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944095 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944445 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-textfile\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944445 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944249 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-sys\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944445 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944287 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944445 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-sys\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944445 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944381 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmd6t\" (UniqueName: \"kubernetes.io/projected/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-kube-api-access-mmd6t\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-metrics-client-ca\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-textfile\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.944777 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.944700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-accelerators-collector-config\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.946620 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.946599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:31.957599 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:31.957569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmd6t\" (UniqueName: \"kubernetes.io/projected/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-kube-api-access-mmd6t\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:32.448891 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:32.448855 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-tls\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:32.451617 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:32.451588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6d5b8ad-ac0d-425f-8d7b-63985fae5481-node-exporter-tls\") pod \"node-exporter-p4rg7\" (UID: \"d6d5b8ad-ac0d-425f-8d7b-63985fae5481\") " pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:32.582248 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:32.582208 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c59cd5bf-ccpbb" event={"ID":"2fccd341-3e65-40bd-802e-825d8ba0e72e","Type":"ContainerStarted","Data":"dc39ba7dca693e461757a0ba1e7faf5470621a11e555831456f9b09cfe54d2cb"} Jun 03 16:36:32.712243 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:32.712166 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p4rg7" Jun 03 16:36:32.721616 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:32.721578 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d5b8ad_ac0d_425f_8d7b_63985fae5481.slice/crio-6fa14c41593096f714bc30fb98a494babc2e49f3759e5c7b58b1e432ea4dd87b WatchSource:0}: Error finding container 6fa14c41593096f714bc30fb98a494babc2e49f3759e5c7b58b1e432ea4dd87b: Status 404 returned error can't find the container with id 6fa14c41593096f714bc30fb98a494babc2e49f3759e5c7b58b1e432ea4dd87b Jun 03 16:36:33.587193 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.587153 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4rg7" event={"ID":"d6d5b8ad-ac0d-425f-8d7b-63985fae5481","Type":"ContainerStarted","Data":"6fa14c41593096f714bc30fb98a494babc2e49f3759e5c7b58b1e432ea4dd87b"} Jun 03 16:36:33.843264 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.843187 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f46f4984-vfcwx"] Jun 03 16:36:33.846759 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.846734 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.848952 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.848902 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 16:36:33.849113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.848935 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 16:36:33.849113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.849104 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 16:36:33.849241 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.849223 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 16:36:33.849292 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.849264 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 16:36:33.849292 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.849276 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zwgdn\"" Jun 03 16:36:33.849630 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.849613 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3kd87g916pb0n\"" Jun 03 16:36:33.855821 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.855773 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f46f4984-vfcwx"] Jun 03 16:36:33.964401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964579 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-tls\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964579 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkdq\" (UniqueName: \"kubernetes.io/projected/04da2bcc-ac46-4918-a82c-e5e5926574c5-kube-api-access-cbkdq\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964579 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04da2bcc-ac46-4918-a82c-e5e5926574c5-metrics-client-ca\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:33.964720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:33.964675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-grpc-tls\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065393 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065355 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065425 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-tls\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065472 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkdq\" (UniqueName: \"kubernetes.io/projected/04da2bcc-ac46-4918-a82c-e5e5926574c5-kube-api-access-cbkdq\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065506 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04da2bcc-ac46-4918-a82c-e5e5926574c5-metrics-client-ca\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065547 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065572 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065847 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065604 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.065847 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.065630 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-grpc-tls\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.066448 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.066394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04da2bcc-ac46-4918-a82c-e5e5926574c5-metrics-client-ca\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.068711 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.068677 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.068711 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.068699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-tls\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.068711 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.068701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-grpc-tls\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.068940 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.068817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.068940 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.068882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.069286 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.069269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04da2bcc-ac46-4918-a82c-e5e5926574c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.073433 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.073414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkdq\" (UniqueName: \"kubernetes.io/projected/04da2bcc-ac46-4918-a82c-e5e5926574c5-kube-api-access-cbkdq\") pod \"thanos-querier-7f46f4984-vfcwx\" (UID: \"04da2bcc-ac46-4918-a82c-e5e5926574c5\") " pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:34.158094 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:34.157995 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:35.006063 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:35.005846 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f46f4984-vfcwx"] Jun 03 16:36:35.008561 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:35.008525 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04da2bcc_ac46_4918_a82c_e5e5926574c5.slice/crio-1322229da6fe2391d882cd230603e9b9fd4ac75ae8cc1b40d58565a34c4bef80 WatchSource:0}: Error finding container 1322229da6fe2391d882cd230603e9b9fd4ac75ae8cc1b40d58565a34c4bef80: Status 404 returned error can't find the container with id 1322229da6fe2391d882cd230603e9b9fd4ac75ae8cc1b40d58565a34c4bef80 Jun 03 16:36:35.593410 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:35.593369 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"1322229da6fe2391d882cd230603e9b9fd4ac75ae8cc1b40d58565a34c4bef80"} Jun 03 16:36:35.594602 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:35.594573 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c59cd5bf-ccpbb" event={"ID":"2fccd341-3e65-40bd-802e-825d8ba0e72e","Type":"ContainerStarted","Data":"8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53"} Jun 03 16:36:35.595984 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:35.595952 2574 generic.go:358] "Generic (PLEG): container finished" podID="d6d5b8ad-ac0d-425f-8d7b-63985fae5481" containerID="f84165398a72133678c9219fca7bf7fe848d47e609caaa3568a47503301480a3" exitCode=0 Jun 03 16:36:35.596108 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:35.596005 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4rg7" event={"ID":"d6d5b8ad-ac0d-425f-8d7b-63985fae5481","Type":"ContainerDied","Data":"f84165398a72133678c9219fca7bf7fe848d47e609caaa3568a47503301480a3"} Jun 03 16:36:35.609027 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:35.608958 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64c59cd5bf-ccpbb" podStartSLOduration=1.594715244 podStartE2EDuration="4.608942335s" podCreationTimestamp="2026-06-03 16:36:31 +0000 UTC" firstStartedPulling="2026-06-03 16:36:31.858420985 +0000 UTC m=+153.272317743" lastFinishedPulling="2026-06-03 16:36:34.872648061 +0000 UTC m=+156.286544834" observedRunningTime="2026-06-03 16:36:35.608173034 +0000 UTC m=+157.022069814" watchObservedRunningTime="2026-06-03 16:36:35.608942335 +0000 UTC m=+157.022839116" Jun 03 16:36:35.997314 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:35.997205 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-svwtw" podUID="e2a436fb-5a27-4fe4-8b87-56ade6e6370d" Jun 03 16:36:36.003926 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:36.003892 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-vltxp" podUID="fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a" Jun 03 16:36:36.073347 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.073313 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d8575dfbd-4xcr9"] Jun 03 16:36:36.075809 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.075787 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.078242 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.078019 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 16:36:36.078242 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.078024 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1jnmh5h2a59d9\"" Jun 03 16:36:36.078242 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.078117 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 16:36:36.078680 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.078642 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bl4qb\"" Jun 03 16:36:36.078792 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.078776 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 16:36:36.078881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.078821 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 16:36:36.083675 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.083483 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d8575dfbd-4xcr9"] Jun 03 16:36:36.184381 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9954750c-8d2b-4b06-b280-b57273272c7b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.184554 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184393 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-secret-metrics-server-tls\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.184554 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl7c4\" (UniqueName: \"kubernetes.io/projected/9954750c-8d2b-4b06-b280-b57273272c7b-kube-api-access-gl7c4\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.184687 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-client-ca-bundle\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.184730 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9954750c-8d2b-4b06-b280-b57273272c7b-audit-log\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.184795 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-secret-metrics-server-client-certs\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.184849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.184811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9954750c-8d2b-4b06-b280-b57273272c7b-metrics-server-audit-profiles\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286269 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286183 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-secret-metrics-server-client-certs\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286269 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286221 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9954750c-8d2b-4b06-b280-b57273272c7b-metrics-server-audit-profiles\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286269 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286252 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9954750c-8d2b-4b06-b280-b57273272c7b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286561 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286273 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-secret-metrics-server-tls\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286561 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286314 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl7c4\" (UniqueName: \"kubernetes.io/projected/9954750c-8d2b-4b06-b280-b57273272c7b-kube-api-access-gl7c4\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286561 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286391 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-client-ca-bundle\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286561 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286425 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9954750c-8d2b-4b06-b280-b57273272c7b-audit-log\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.286826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.286794 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9954750c-8d2b-4b06-b280-b57273272c7b-audit-log\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.287082 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.287058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9954750c-8d2b-4b06-b280-b57273272c7b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.287427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.287403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9954750c-8d2b-4b06-b280-b57273272c7b-metrics-server-audit-profiles\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.288769 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.288743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-secret-metrics-server-tls\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.288866 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.288805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-secret-metrics-server-client-certs\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.288866 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.288835 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9954750c-8d2b-4b06-b280-b57273272c7b-client-ca-bundle\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.293745 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.293723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl7c4\" (UniqueName: \"kubernetes.io/projected/9954750c-8d2b-4b06-b280-b57273272c7b-kube-api-access-gl7c4\") pod \"metrics-server-6d8575dfbd-4xcr9\" (UID: \"9954750c-8d2b-4b06-b280-b57273272c7b\") " pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.387375 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.387338 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:36.523295 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.523233 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d8575dfbd-4xcr9"] Jun 03 16:36:36.525164 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:36.525133 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9954750c_8d2b_4b06_b280_b57273272c7b.slice/crio-8bc84c0bb2514426943f4d727445e20b4f6754dc26c50ed4d6d3ce590b1c261c WatchSource:0}: Error finding container 8bc84c0bb2514426943f4d727445e20b4f6754dc26c50ed4d6d3ce590b1c261c: Status 404 returned error can't find the container with id 8bc84c0bb2514426943f4d727445e20b4f6754dc26c50ed4d6d3ce590b1c261c Jun 03 16:36:36.555110 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.555026 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm"] Jun 03 16:36:36.558050 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.558025 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:36.560088 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.560057 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 16:36:36.560088 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.560080 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-7khhj\"" Jun 03 16:36:36.565778 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.565700 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm"] Jun 03 16:36:36.600792 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.600760 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4rg7" event={"ID":"d6d5b8ad-ac0d-425f-8d7b-63985fae5481","Type":"ContainerStarted","Data":"a82270c6a2fa7aaebedf87ef89c9f20ae2bd3bcc807d6e77a7bb12b5d7e3ae0b"} Jun 03 16:36:36.600792 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.600792 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p4rg7" event={"ID":"d6d5b8ad-ac0d-425f-8d7b-63985fae5481","Type":"ContainerStarted","Data":"ff349659f04974ce00939326d1a4dafce9e720a5fc58a945ae7125c7c1bc7c05"} Jun 03 16:36:36.601881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.601862 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:36:36.602002 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.601905 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" event={"ID":"9954750c-8d2b-4b06-b280-b57273272c7b","Type":"ContainerStarted","Data":"8bc84c0bb2514426943f4d727445e20b4f6754dc26c50ed4d6d3ce590b1c261c"} Jun 03 16:36:36.602123 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.602108 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwtw" Jun 03 16:36:36.617435 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.617351 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p4rg7" podStartSLOduration=3.478263657 podStartE2EDuration="5.617335911s" podCreationTimestamp="2026-06-03 16:36:31 +0000 UTC" firstStartedPulling="2026-06-03 16:36:32.723811766 +0000 UTC m=+154.137708543" lastFinishedPulling="2026-06-03 16:36:34.862884036 +0000 UTC m=+156.276780797" observedRunningTime="2026-06-03 16:36:36.617175717 +0000 UTC m=+158.031072498" watchObservedRunningTime="2026-06-03 16:36:36.617335911 +0000 UTC m=+158.031232690" Jun 03 16:36:36.690715 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.690673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8x5dm\" (UID: \"cd78483d-ff98-4a19-9889-c7266dff7fe1\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:36.792692 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:36.792649 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8x5dm\" (UID: \"cd78483d-ff98-4a19-9889-c7266dff7fe1\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:36.792856 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:36.792804 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 16:36:36.792912 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:36.792901 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert podName:cd78483d-ff98-4a19-9889-c7266dff7fe1 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:37.292879062 +0000 UTC m=+158.706775840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-8x5dm" (UID: "cd78483d-ff98-4a19-9889-c7266dff7fe1") : secret "monitoring-plugin-cert" not found Jun 03 16:36:37.297155 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.297124 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8x5dm\" (UID: \"cd78483d-ff98-4a19-9889-c7266dff7fe1\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:37.297546 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:37.297305 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 16:36:37.297546 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:37.297417 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert podName:cd78483d-ff98-4a19-9889-c7266dff7fe1 nodeName:}" failed. No retries permitted until 2026-06-03 16:36:38.297392738 +0000 UTC m=+159.711289506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-8x5dm" (UID: "cd78483d-ff98-4a19-9889-c7266dff7fe1") : secret "monitoring-plugin-cert" not found Jun 03 16:36:37.311828 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.311799 2574 patch_prober.go:28] interesting pod/image-registry-85b9cbbc6b-vpjjt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:37.311967 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.311848 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:37.607645 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.607602 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"99e9e16f2a75ac0c401d0adddb3e01e3de03f0d51bb43c028231f90f1c4cf6ae"} Jun 03 16:36:37.607645 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.607650 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"a141df8b85428e298448478ad27c0ec92c6749809c6f150f74bc0d578536daac"} Jun 03 16:36:37.607893 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.607660 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"8094a8c3ce2fa0d5088abcec7820b9a719853650cef9256036dd1c0c1bbcdffb"} Jun 03 16:36:37.641426 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.641392 2574 patch_prober.go:28] interesting pod/image-registry-649b99cb7c-srjdh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:37.641600 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.641447 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:37.967730 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.967651 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:36:37.976154 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.976131 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:37.978581 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.978559 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 16:36:37.978704 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.978679 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 16:36:37.978945 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.978928 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 16:36:37.979067 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.979023 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-17cgtc8e1gsi1\"" Jun 03 16:36:37.979219 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.979204 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 16:36:37.979532 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.979514 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 16:36:37.979621 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.979584 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 16:36:37.979950 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.979936 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 16:36:37.980613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.980588 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n44m6\"" Jun 03 16:36:37.980720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.980635 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 16:36:37.980720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.980677 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 16:36:37.983698 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.983681 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 16:36:37.983942 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:37.983928 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 16:36:38.001085 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.001056 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:36:38.002093 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.002070 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 16:36:38.105628 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd6a51-423a-4833-8e73-2946ad598645-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.105789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.105789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.105789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.105789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.105789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105761 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd6a51-423a-4833-8e73-2946ad598645-config-out\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.105789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6grw\" (UniqueName: \"kubernetes.io/projected/95fd6a51-423a-4833-8e73-2946ad598645-kube-api-access-j6grw\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.105936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106001 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-config\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106113 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-web-config\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.106349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.106230 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207322 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207289 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207336 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-config\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207363 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207383 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-web-config\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207411 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207428 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207478 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207447 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207610 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207646 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207679 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd6a51-423a-4833-8e73-2946ad598645-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207713 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207740 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207771 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207807 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207838 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd6a51-423a-4833-8e73-2946ad598645-config-out\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.207881 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207863 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6grw\" (UniqueName: \"kubernetes.io/projected/95fd6a51-423a-4833-8e73-2946ad598645-kube-api-access-j6grw\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.208387 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.208387 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.207942 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.208387 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.208275 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.208387 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.208350 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.209064 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.208694 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.210796 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.210766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.211349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.211011 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.211349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.211270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.211509 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.211367 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-web-config\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.212322 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.211843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.212322 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.212119 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.212322 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.212256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-config\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.212511 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.212390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95fd6a51-423a-4833-8e73-2946ad598645-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.212952 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.212927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.213691 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.213430 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.213691 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.213443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95fd6a51-423a-4833-8e73-2946ad598645-config-out\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.213691 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.213644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95fd6a51-423a-4833-8e73-2946ad598645-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.214531 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.214511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.214612 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.214526 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95fd6a51-423a-4833-8e73-2946ad598645-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.217613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.217594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6grw\" (UniqueName: \"kubernetes.io/projected/95fd6a51-423a-4833-8e73-2946ad598645-kube-api-access-j6grw\") pod \"prometheus-k8s-0\" (UID: \"95fd6a51-423a-4833-8e73-2946ad598645\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.287370 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.287280 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:38.309516 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.309478 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8x5dm\" (UID: \"cd78483d-ff98-4a19-9889-c7266dff7fe1\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:38.312435 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.312407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd78483d-ff98-4a19-9889-c7266dff7fe1-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-8x5dm\" (UID: \"cd78483d-ff98-4a19-9889-c7266dff7fe1\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:38.370327 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.370292 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:38.979777 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.979751 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm"] Jun 03 16:36:38.981906 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:38.981881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd78483d_ff98_4a19_9889_c7266dff7fe1.slice/crio-a251b5508b66870d817b160c890a55f227c5bfcfbfaedf2b67041dce733bb71d WatchSource:0}: Error finding container a251b5508b66870d817b160c890a55f227c5bfcfbfaedf2b67041dce733bb71d: Status 404 returned error can't find the container with id a251b5508b66870d817b160c890a55f227c5bfcfbfaedf2b67041dce733bb71d Jun 03 16:36:38.991630 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:38.991602 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 16:36:38.994318 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:38.994294 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fd6a51_423a_4833_8e73_2946ad598645.slice/crio-a1d82b9b48cde021d4d2eac1edabcbc2e88fb164c1744924cc70cddad64eab08 WatchSource:0}: Error finding container a1d82b9b48cde021d4d2eac1edabcbc2e88fb164c1744924cc70cddad64eab08: Status 404 returned error can't find the container with id a1d82b9b48cde021d4d2eac1edabcbc2e88fb164c1744924cc70cddad64eab08 Jun 03 16:36:39.541893 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.541849 2574 patch_prober.go:28] interesting pod/image-registry-649b99cb7c-srjdh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:39.542385 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.541908 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:39.615618 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.615580 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"a66b34e08ecdd76d05fe44f921a05de2c96ff23dcf988e67bd7d4ccdeb12b8e7"} Jun 03 16:36:39.615618 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.615624 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"1f82e0a4a60e730629d3f01df19021e7ae885b6921b964a91c32a893016091c8"} Jun 03 16:36:39.615860 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.615639 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" event={"ID":"04da2bcc-ac46-4918-a82c-e5e5926574c5","Type":"ContainerStarted","Data":"16a04c07b2baae577d89ec24829bfd71ffb7ca3ad0344839120e1b9372a87c48"} Jun 03 16:36:39.615860 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.615751 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:39.617180 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.617155 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" event={"ID":"9954750c-8d2b-4b06-b280-b57273272c7b","Type":"ContainerStarted","Data":"f38fcc4acf23a5f3cff8fd3d0a15589b6983fec1280c56cb8a040e941138a33f"} Jun 03 16:36:39.618442 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.618415 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"a1d82b9b48cde021d4d2eac1edabcbc2e88fb164c1744924cc70cddad64eab08"} Jun 03 16:36:39.619641 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.619619 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" event={"ID":"cd78483d-ff98-4a19-9889-c7266dff7fe1","Type":"ContainerStarted","Data":"a251b5508b66870d817b160c890a55f227c5bfcfbfaedf2b67041dce733bb71d"} Jun 03 16:36:39.636819 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.636769 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" podStartSLOduration=3.022631912 podStartE2EDuration="6.636753959s" podCreationTimestamp="2026-06-03 16:36:33 +0000 UTC" firstStartedPulling="2026-06-03 16:36:35.010458414 +0000 UTC m=+156.424355172" lastFinishedPulling="2026-06-03 16:36:38.624580448 +0000 UTC m=+160.038477219" observedRunningTime="2026-06-03 16:36:39.635115548 +0000 UTC m=+161.049012322" watchObservedRunningTime="2026-06-03 16:36:39.636753959 +0000 UTC m=+161.050650740" Jun 03 16:36:39.650317 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:39.650272 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" podStartSLOduration=1.55028504 podStartE2EDuration="3.650260656s" podCreationTimestamp="2026-06-03 16:36:36 +0000 UTC" firstStartedPulling="2026-06-03 16:36:36.527206375 +0000 UTC m=+157.941103132" lastFinishedPulling="2026-06-03 16:36:38.627181971 +0000 UTC m=+160.041078748" observedRunningTime="2026-06-03 16:36:39.64867989 +0000 UTC m=+161.062576667" watchObservedRunningTime="2026-06-03 16:36:39.650260656 +0000 UTC m=+161.064157435" Jun 03 16:36:40.628239 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:40.628177 2574 generic.go:358] "Generic (PLEG): container finished" podID="95fd6a51-423a-4833-8e73-2946ad598645" containerID="8a03d1093f46a65ca57fe5a38ff197c8e62fbcb263905e7da4c0142d94b25f67" exitCode=0 Jun 03 16:36:40.630013 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:40.629955 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerDied","Data":"8a03d1093f46a65ca57fe5a38ff197c8e62fbcb263905e7da4c0142d94b25f67"} Jun 03 16:36:40.936550 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:40.936463 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:36:40.936720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:40.936575 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:36:40.939239 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:40.939209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2a436fb-5a27-4fe4-8b87-56ade6e6370d-metrics-tls\") pod \"dns-default-svwtw\" (UID: \"e2a436fb-5a27-4fe4-8b87-56ade6e6370d\") " pod="openshift-dns/dns-default-svwtw" Jun 03 16:36:40.939371 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:40.939321 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a-cert\") pod \"ingress-canary-vltxp\" (UID: \"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a\") " pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:36:41.105039 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.105013 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6d9kw\"" Jun 03 16:36:41.105177 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.105108 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kldw8\"" Jun 03 16:36:41.113636 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.113617 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-svwtw" Jun 03 16:36:41.113721 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.113672 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vltxp" Jun 03 16:36:41.252664 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.252541 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vltxp"] Jun 03 16:36:41.254765 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:41.254734 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0e4863_81e9_43e3_8ede_1d29dd0e9d5a.slice/crio-e796af85eac7c365984a295d56e560e6c88c407177fe0d1020118130cab00ca3 WatchSource:0}: Error finding container e796af85eac7c365984a295d56e560e6c88c407177fe0d1020118130cab00ca3: Status 404 returned error can't find the container with id e796af85eac7c365984a295d56e560e6c88c407177fe0d1020118130cab00ca3 Jun 03 16:36:41.269421 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.269395 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-svwtw"] Jun 03 16:36:41.271060 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:36:41.271035 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a436fb_5a27_4fe4_8b87_56ade6e6370d.slice/crio-d64287798431d384f23044e601e688509c1a0abaae39c75ea6eb479838f93b29 WatchSource:0}: Error finding container d64287798431d384f23044e601e688509c1a0abaae39c75ea6eb479838f93b29: Status 404 returned error can't find the container with id d64287798431d384f23044e601e688509c1a0abaae39c75ea6eb479838f93b29 Jun 03 16:36:41.633022 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.632965 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwtw" event={"ID":"e2a436fb-5a27-4fe4-8b87-56ade6e6370d","Type":"ContainerStarted","Data":"d64287798431d384f23044e601e688509c1a0abaae39c75ea6eb479838f93b29"} Jun 03 16:36:41.634219 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.634198 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" event={"ID":"cd78483d-ff98-4a19-9889-c7266dff7fe1","Type":"ContainerStarted","Data":"fcb87d6db89a4db4ba467e9acbe9a4600386e89bbfe5e19c8315d9566c481bf7"} Jun 03 16:36:41.634509 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.634459 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:41.635322 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.635301 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vltxp" event={"ID":"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a","Type":"ContainerStarted","Data":"e796af85eac7c365984a295d56e560e6c88c407177fe0d1020118130cab00ca3"} Jun 03 16:36:41.639434 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.639412 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" Jun 03 16:36:41.651963 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.651923 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-8x5dm" podStartSLOduration=3.597690162 podStartE2EDuration="5.651912485s" podCreationTimestamp="2026-06-03 16:36:36 +0000 UTC" firstStartedPulling="2026-06-03 16:36:38.983766877 +0000 UTC m=+160.397663635" lastFinishedPulling="2026-06-03 16:36:41.037989189 +0000 UTC m=+162.451885958" observedRunningTime="2026-06-03 16:36:41.650918425 +0000 UTC m=+163.064815204" watchObservedRunningTime="2026-06-03 16:36:41.651912485 +0000 UTC m=+163.065809264" Jun 03 16:36:41.724382 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.724334 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:41.724569 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.724396 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:41.725957 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.725922 2574 patch_prober.go:28] interesting pod/console-64c59cd5bf-ccpbb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 03 16:36:41.726104 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:41.725991 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64c59cd5bf-ccpbb" podUID="2fccd341-3e65-40bd-802e-825d8ba0e72e" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 03 16:36:42.328069 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.328024 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerName="registry" containerID="cri-o://b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057" gracePeriod=30 Jun 03 16:36:42.846732 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.846702 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956681 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-trusted-ca\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956758 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-bound-sa-token\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956810 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl5h7\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-kube-api-access-xl5h7\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956839 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-installation-pull-secrets\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956886 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/273fd345-d13d-4738-8aa4-6fa1fda41bdd-ca-trust-extracted\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956913 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-certificates\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.956960 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-image-registry-private-configuration\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.957020 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") pod \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\" (UID: \"273fd345-d13d-4738-8aa4-6fa1fda41bdd\") " Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.957179 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.957357 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-trusted-ca\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:42.958118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.957941 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:36:42.959883 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.959851 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:36:42.960516 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.960465 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:36:42.960924 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.960804 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:36:42.960924 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.960910 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:36:42.961819 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.961790 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-kube-api-access-xl5h7" (OuterVolumeSpecName: "kube-api-access-xl5h7") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "kube-api-access-xl5h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:36:42.969429 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:42.969406 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/273fd345-d13d-4738-8aa4-6fa1fda41bdd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "273fd345-d13d-4738-8aa4-6fa1fda41bdd" (UID: "273fd345-d13d-4738-8aa4-6fa1fda41bdd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:36:43.058411 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058365 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-bound-sa-token\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.058411 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058415 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl5h7\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-kube-api-access-xl5h7\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.058411 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058426 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-installation-pull-secrets\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.058411 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058436 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/273fd345-d13d-4738-8aa4-6fa1fda41bdd-ca-trust-extracted\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.058763 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058449 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-certificates\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.058763 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058463 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/273fd345-d13d-4738-8aa4-6fa1fda41bdd-image-registry-private-configuration\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.058763 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.058477 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/273fd345-d13d-4738-8aa4-6fa1fda41bdd-registry-tls\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:36:43.644493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.644446 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwtw" event={"ID":"e2a436fb-5a27-4fe4-8b87-56ade6e6370d","Type":"ContainerStarted","Data":"31e41a2d5331ef23f499be0d73393b67ae7d2e0afa10b8657c2b2019e9d339d9"} Jun 03 16:36:43.644493 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.644491 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-svwtw" event={"ID":"e2a436fb-5a27-4fe4-8b87-56ade6e6370d","Type":"ContainerStarted","Data":"abbc16522e2fce9464be1d04271497302994efd0cb0fb86e08617fd8ef7bbc99"} Jun 03 16:36:43.644684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.644566 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-svwtw" Jun 03 16:36:43.645658 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.645629 2574 generic.go:358] "Generic (PLEG): container finished" podID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerID="b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057" exitCode=0 Jun 03 16:36:43.645801 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.645688 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" Jun 03 16:36:43.645801 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.645718 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" event={"ID":"273fd345-d13d-4738-8aa4-6fa1fda41bdd","Type":"ContainerDied","Data":"b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057"} Jun 03 16:36:43.645801 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.645758 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85b9cbbc6b-vpjjt" event={"ID":"273fd345-d13d-4738-8aa4-6fa1fda41bdd","Type":"ContainerDied","Data":"10d027c555aea708c9309e38e1fa5860e4a735c659afa992988498a43e407535"} Jun 03 16:36:43.645801 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.645787 2574 scope.go:117] "RemoveContainer" containerID="b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057" Jun 03 16:36:43.663092 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.663034 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-svwtw" podStartSLOduration=130.207688993 podStartE2EDuration="2m11.663016469s" podCreationTimestamp="2026-06-03 16:34:32 +0000 UTC" firstStartedPulling="2026-06-03 16:36:41.273255121 +0000 UTC m=+162.687151886" lastFinishedPulling="2026-06-03 16:36:42.728582589 +0000 UTC m=+164.142479362" observedRunningTime="2026-06-03 16:36:43.660213605 +0000 UTC m=+165.074110388" watchObservedRunningTime="2026-06-03 16:36:43.663016469 +0000 UTC m=+165.076913250" Jun 03 16:36:43.674862 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.674824 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85b9cbbc6b-vpjjt"] Jun 03 16:36:43.677771 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.677747 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85b9cbbc6b-vpjjt"] Jun 03 16:36:43.924209 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.924185 2574 scope.go:117] "RemoveContainer" containerID="b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057" Jun 03 16:36:43.924581 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:36:43.924549 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057\": container with ID starting with b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057 not found: ID does not exist" containerID="b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057" Jun 03 16:36:43.924626 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:43.924593 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057"} err="failed to get container status \"b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057\": rpc error: code = NotFound desc = could not find container \"b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057\": container with ID starting with b71b2a3d6d77d21ad8bb6a05df3cc8ec7844e9023e9b45fefcaf30e9fc9a9057 not found: ID does not exist" Jun 03 16:36:44.651388 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:44.651353 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"ba8be259333ff210ce50f725e832473004522e60b5afeb45a79c0290c948681b"} Jun 03 16:36:44.651388 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:44.651386 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"5bf1f3a7f51af5fe0e127be6d1f37011f29b6105caef11654fe30215281b1ebd"} Jun 03 16:36:44.653775 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:44.653742 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vltxp" event={"ID":"fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a","Type":"ContainerStarted","Data":"dd9312059667245ab3d23a6a49c476bd55c37aac162b3970cc238ddf85f599d0"} Jun 03 16:36:44.669549 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:44.669499 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vltxp" podStartSLOduration=129.482221004 podStartE2EDuration="2m12.669480954s" podCreationTimestamp="2026-06-03 16:34:32 +0000 UTC" firstStartedPulling="2026-06-03 16:36:41.256794343 +0000 UTC m=+162.670691101" lastFinishedPulling="2026-06-03 16:36:44.44405428 +0000 UTC m=+165.857951051" observedRunningTime="2026-06-03 16:36:44.666990926 +0000 UTC m=+166.080887699" watchObservedRunningTime="2026-06-03 16:36:44.669480954 +0000 UTC m=+166.083377735" Jun 03 16:36:45.124748 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.124715 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" path="/var/lib/kubelet/pods/273fd345-d13d-4738-8aa4-6fa1fda41bdd/volumes" Jun 03 16:36:45.636470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.636442 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f46f4984-vfcwx" Jun 03 16:36:45.659630 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.659593 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"ecf7cb05321e5c557705fbb34610ef104bd0bf3826adc6326b417c26740f2a10"} Jun 03 16:36:45.659630 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.659636 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"c33291357afa1582627c4412919fa5d7b8150085ac816762a8947f3b28387771"} Jun 03 16:36:45.659879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.659647 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"3997ea0bc79fc6817e273c1a5428724817dc0cf2832ca8ed682637e7f27409be"} Jun 03 16:36:45.659879 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.659656 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95fd6a51-423a-4833-8e73-2946ad598645","Type":"ContainerStarted","Data":"6e37b1d455f2e30b7bc80f322e07c979d39d5eacce68b3a645ce068b8a69e3ca"} Jun 03 16:36:45.686780 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:45.686728 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.240342322 podStartE2EDuration="8.686711741s" podCreationTimestamp="2026-06-03 16:36:37 +0000 UTC" firstStartedPulling="2026-06-03 16:36:38.996351021 +0000 UTC m=+160.410247779" lastFinishedPulling="2026-06-03 16:36:44.44272044 +0000 UTC m=+165.856617198" observedRunningTime="2026-06-03 16:36:45.684548356 +0000 UTC m=+167.098445147" watchObservedRunningTime="2026-06-03 16:36:45.686711741 +0000 UTC m=+167.100608521" Jun 03 16:36:47.640758 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:47.640718 2574 patch_prober.go:28] interesting pod/image-registry-649b99cb7c-srjdh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:47.641271 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:47.640788 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:48.288128 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:48.288073 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:36:49.542098 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:49.542061 2574 patch_prober.go:28] interesting pod/image-registry-649b99cb7c-srjdh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:49.542485 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:49.542125 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:51.728577 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:51.728546 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:51.732315 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:51.732298 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:36:52.783354 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:52.783320 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c59cd5bf-ccpbb"] Jun 03 16:36:53.655342 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:53.655306 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-svwtw" Jun 03 16:36:56.388185 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:56.388129 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:56.388185 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:56.388198 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:36:57.640514 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:57.640474 2574 patch_prober.go:28] interesting pod/image-registry-649b99cb7c-srjdh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:57.640886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:57.640544 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:36:57.640886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:57.640588 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:36:57.641185 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:57.641159 2574 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"6736fc446d9e15cc1002673c777834c8c063cd785a2cb68b32c6689724c4e82b"} pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" containerMessage="Container registry failed liveness probe, will be restarted" Jun 03 16:36:57.644430 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:57.644402 2574 patch_prober.go:28] interesting pod/image-registry-649b99cb7c-srjdh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 16:36:57.644556 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:36:57.644450 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 16:37:04.718950 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:04.718914 2574 generic.go:358] "Generic (PLEG): container finished" podID="252be81c-7dd7-4b62-92a8-143e49405472" containerID="ec05300f945ebab0777933603ca136d83b9d42f953fc70e799b48a8e293058a7" exitCode=0 Jun 03 16:37:04.719362 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:04.718996 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" event={"ID":"252be81c-7dd7-4b62-92a8-143e49405472","Type":"ContainerDied","Data":"ec05300f945ebab0777933603ca136d83b9d42f953fc70e799b48a8e293058a7"} Jun 03 16:37:04.719362 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:04.719355 2574 scope.go:117] "RemoveContainer" containerID="ec05300f945ebab0777933603ca136d83b9d42f953fc70e799b48a8e293058a7" Jun 03 16:37:05.724200 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:05.724169 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-ng9qq" event={"ID":"252be81c-7dd7-4b62-92a8-143e49405472","Type":"ContainerStarted","Data":"fb564f1f6decb08dae0c539af9b85289dec5d1bd46f5cfb1c2ca703602bcf507"} Jun 03 16:37:07.644995 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:07.644945 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:37:16.392836 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:16.392801 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:37:16.397108 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:16.397084 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d8575dfbd-4xcr9" Jun 03 16:37:18.705134 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:18.705070 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64c59cd5bf-ccpbb" podUID="2fccd341-3e65-40bd-802e-825d8ba0e72e" containerName="console" containerID="cri-o://8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53" gracePeriod=15 Jun 03 16:37:18.944592 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:18.944567 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64c59cd5bf-ccpbb_2fccd341-3e65-40bd-802e-825d8ba0e72e/console/0.log" Jun 03 16:37:18.944714 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:18.944630 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:37:19.086760 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086723 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-config\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.086933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086768 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-service-ca\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.086933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086807 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-oauth-config\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.086933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086836 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-oauth-serving-cert\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.086933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086887 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-serving-cert\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.086933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086908 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6m4n\" (UniqueName: \"kubernetes.io/projected/2fccd341-3e65-40bd-802e-825d8ba0e72e-kube-api-access-b6m4n\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.087213 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.086945 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-trusted-ca-bundle\") pod \"2fccd341-3e65-40bd-802e-825d8ba0e72e\" (UID: \"2fccd341-3e65-40bd-802e-825d8ba0e72e\") " Jun 03 16:37:19.087213 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.087125 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-config" (OuterVolumeSpecName: "console-config") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:19.087325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.087244 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:19.087380 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.087321 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:19.087582 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.087554 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:37:19.089532 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.089497 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:37:19.089637 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.089560 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fccd341-3e65-40bd-802e-825d8ba0e72e-kube-api-access-b6m4n" (OuterVolumeSpecName: "kube-api-access-b6m4n") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "kube-api-access-b6m4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:37:19.089637 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.089560 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fccd341-3e65-40bd-802e-825d8ba0e72e" (UID: "2fccd341-3e65-40bd-802e-825d8ba0e72e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:37:19.188163 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188125 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-trusted-ca-bundle\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.188163 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188158 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-config\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.188163 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188170 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-service-ca\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.188455 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188179 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-oauth-config\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.188455 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188189 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fccd341-3e65-40bd-802e-825d8ba0e72e-oauth-serving-cert\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.188455 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188197 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fccd341-3e65-40bd-802e-825d8ba0e72e-console-serving-cert\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.188455 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.188206 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6m4n\" (UniqueName: \"kubernetes.io/projected/2fccd341-3e65-40bd-802e-825d8ba0e72e-kube-api-access-b6m4n\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:37:19.767806 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.767779 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64c59cd5bf-ccpbb_2fccd341-3e65-40bd-802e-825d8ba0e72e/console/0.log" Jun 03 16:37:19.768325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.767819 2574 generic.go:358] "Generic (PLEG): container finished" podID="2fccd341-3e65-40bd-802e-825d8ba0e72e" containerID="8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53" exitCode=2 Jun 03 16:37:19.768325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.767847 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c59cd5bf-ccpbb" event={"ID":"2fccd341-3e65-40bd-802e-825d8ba0e72e","Type":"ContainerDied","Data":"8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53"} Jun 03 16:37:19.768325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.767884 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c59cd5bf-ccpbb" event={"ID":"2fccd341-3e65-40bd-802e-825d8ba0e72e","Type":"ContainerDied","Data":"dc39ba7dca693e461757a0ba1e7faf5470621a11e555831456f9b09cfe54d2cb"} Jun 03 16:37:19.768325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.767900 2574 scope.go:117] "RemoveContainer" containerID="8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53" Jun 03 16:37:19.768325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.767923 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c59cd5bf-ccpbb" Jun 03 16:37:19.776022 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.776001 2574 scope.go:117] "RemoveContainer" containerID="8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53" Jun 03 16:37:19.776278 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:37:19.776258 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53\": container with ID starting with 8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53 not found: ID does not exist" containerID="8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53" Jun 03 16:37:19.776325 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.776286 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53"} err="failed to get container status \"8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53\": rpc error: code = NotFound desc = could not find container \"8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53\": container with ID starting with 8ef2ae45719a76b2993f3438b5bdf08722807fa819e861dba5b2656544b23f53 not found: ID does not exist" Jun 03 16:37:19.782057 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.782035 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64c59cd5bf-ccpbb"] Jun 03 16:37:19.788139 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:19.788114 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64c59cd5bf-ccpbb"] Jun 03 16:37:21.123540 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:21.123512 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fccd341-3e65-40bd-802e-825d8ba0e72e" path="/var/lib/kubelet/pods/2fccd341-3e65-40bd-802e-825d8ba0e72e/volumes" Jun 03 16:37:22.660394 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:22.660355 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" podUID="32552565-d592-4d25-86ae-7b43a1bcd396" containerName="registry" containerID="cri-o://6736fc446d9e15cc1002673c777834c8c063cd785a2cb68b32c6689724c4e82b" gracePeriod=30 Jun 03 16:37:23.787151 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.783459 2574 generic.go:358] "Generic (PLEG): container finished" podID="f8e6aaad-859e-443a-8df6-b0c16c961906" containerID="ea482101d5672fef22c2ffe8554ab57c08b9506aff44054f9df5799816fddef2" exitCode=0 Jun 03 16:37:23.787151 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.783622 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" event={"ID":"f8e6aaad-859e-443a-8df6-b0c16c961906","Type":"ContainerDied","Data":"ea482101d5672fef22c2ffe8554ab57c08b9506aff44054f9df5799816fddef2"} Jun 03 16:37:23.787151 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.784209 2574 scope.go:117] "RemoveContainer" containerID="ea482101d5672fef22c2ffe8554ab57c08b9506aff44054f9df5799816fddef2" Jun 03 16:37:23.791086 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.791054 2574 generic.go:358] "Generic (PLEG): container finished" podID="83a442ad-bce0-4e94-ac51-349784e6b5e2" containerID="13a201e74a275c1a7560de44361f24967ac2109212ba58cbfeb1f606d2a128a8" exitCode=0 Jun 03 16:37:23.791216 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.791092 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" event={"ID":"83a442ad-bce0-4e94-ac51-349784e6b5e2","Type":"ContainerDied","Data":"13a201e74a275c1a7560de44361f24967ac2109212ba58cbfeb1f606d2a128a8"} Jun 03 16:37:23.791412 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.791394 2574 scope.go:117] "RemoveContainer" containerID="13a201e74a275c1a7560de44361f24967ac2109212ba58cbfeb1f606d2a128a8" Jun 03 16:37:23.793022 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.792993 2574 generic.go:358] "Generic (PLEG): container finished" podID="32552565-d592-4d25-86ae-7b43a1bcd396" containerID="6736fc446d9e15cc1002673c777834c8c063cd785a2cb68b32c6689724c4e82b" exitCode=0 Jun 03 16:37:23.793100 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:23.793041 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" event={"ID":"32552565-d592-4d25-86ae-7b43a1bcd396","Type":"ContainerDied","Data":"6736fc446d9e15cc1002673c777834c8c063cd785a2cb68b32c6689724c4e82b"} Jun 03 16:37:24.800904 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:24.800862 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" event={"ID":"32552565-d592-4d25-86ae-7b43a1bcd396","Type":"ContainerStarted","Data":"6160f20792fed184eb725cc1d0c35d421466753812ff1d6fbccad97f8a75b358"} Jun 03 16:37:24.801366 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:24.800995 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:37:24.802883 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:24.802853 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wzprq" event={"ID":"f8e6aaad-859e-443a-8df6-b0c16c961906","Type":"ContainerStarted","Data":"7773f6f0b368a84b2d15f36486fa4e3afb334229952a74bce887c1f0210d036c"} Jun 03 16:37:24.804443 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:24.804420 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-68zcr" event={"ID":"83a442ad-bce0-4e94-ac51-349784e6b5e2","Type":"ContainerStarted","Data":"73e5b0bd2b25d249ca3782e0f7047895a8e055e46181255fab3637456b2459c7"} Jun 03 16:37:38.287727 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:38.287683 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:37:38.303651 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:38.303621 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:37:38.858860 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:38.858832 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 16:37:45.811147 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:37:45.811114 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-649b99cb7c-srjdh" Jun 03 16:38:38.053383 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053344 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-89s6m"] Jun 03 16:38:38.053826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053656 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerName="registry" Jun 03 16:38:38.053826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053668 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerName="registry" Jun 03 16:38:38.053826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053678 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fccd341-3e65-40bd-802e-825d8ba0e72e" containerName="console" Jun 03 16:38:38.053826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053683 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fccd341-3e65-40bd-802e-825d8ba0e72e" containerName="console" Jun 03 16:38:38.053826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053741 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="273fd345-d13d-4738-8aa4-6fa1fda41bdd" containerName="registry" Jun 03 16:38:38.053826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.053749 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fccd341-3e65-40bd-802e-825d8ba0e72e" containerName="console" Jun 03 16:38:38.055585 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.055569 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.057544 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.057527 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:38:38.063110 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.063087 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89s6m"] Jun 03 16:38:38.168286 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.168241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4a1f17b-5738-47c6-9444-0426c3d19373-kubelet-config\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.168286 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.168290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4a1f17b-5738-47c6-9444-0426c3d19373-original-pull-secret\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.168508 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.168434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4a1f17b-5738-47c6-9444-0426c3d19373-dbus\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.269171 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.269128 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4a1f17b-5738-47c6-9444-0426c3d19373-dbus\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.269370 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.269207 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4a1f17b-5738-47c6-9444-0426c3d19373-kubelet-config\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.269370 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.269231 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4a1f17b-5738-47c6-9444-0426c3d19373-original-pull-secret\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.269370 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.269329 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d4a1f17b-5738-47c6-9444-0426c3d19373-kubelet-config\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.269494 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.269362 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d4a1f17b-5738-47c6-9444-0426c3d19373-dbus\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.271558 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.271526 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d4a1f17b-5738-47c6-9444-0426c3d19373-original-pull-secret\") pod \"global-pull-secret-syncer-89s6m\" (UID: \"d4a1f17b-5738-47c6-9444-0426c3d19373\") " pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.365882 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.365855 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89s6m" Jun 03 16:38:38.492119 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:38.492093 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89s6m"] Jun 03 16:38:38.494661 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:38:38.494627 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a1f17b_5738_47c6_9444_0426c3d19373.slice/crio-b320fdefba93e6750cd7e5a5569c9309c90d3a233ece14ce60fcd938bdc46f86 WatchSource:0}: Error finding container b320fdefba93e6750cd7e5a5569c9309c90d3a233ece14ce60fcd938bdc46f86: Status 404 returned error can't find the container with id b320fdefba93e6750cd7e5a5569c9309c90d3a233ece14ce60fcd938bdc46f86 Jun 03 16:38:39.014959 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:39.014920 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89s6m" event={"ID":"d4a1f17b-5738-47c6-9444-0426c3d19373","Type":"ContainerStarted","Data":"b320fdefba93e6750cd7e5a5569c9309c90d3a233ece14ce60fcd938bdc46f86"} Jun 03 16:38:44.030106 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:44.030066 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89s6m" event={"ID":"d4a1f17b-5738-47c6-9444-0426c3d19373","Type":"ContainerStarted","Data":"41bbf2350ba9fd3eb3be5bb545b6e7101827ecb49d2498ad041be841cd456c9c"} Jun 03 16:38:44.044173 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:44.044126 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-89s6m" podStartSLOduration=1.437929313 podStartE2EDuration="6.04411044s" podCreationTimestamp="2026-06-03 16:38:38 +0000 UTC" firstStartedPulling="2026-06-03 16:38:38.496360065 +0000 UTC m=+279.910256825" lastFinishedPulling="2026-06-03 16:38:43.102541189 +0000 UTC m=+284.516437952" observedRunningTime="2026-06-03 16:38:44.043198188 +0000 UTC m=+285.457094967" watchObservedRunningTime="2026-06-03 16:38:44.04411044 +0000 UTC m=+285.458007221" Jun 03 16:38:59.010932 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:59.010902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:38:59.011524 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:59.011386 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:38:59.017720 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:38:59.017698 2574 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 16:40:32.256960 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.256924 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88"] Jun 03 16:40:32.260546 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.260528 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.262921 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.262898 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 16:40:32.263442 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.263427 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 16:40:32.263880 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.263858 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 16:40:32.264054 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.264038 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 16:40:32.264236 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.264223 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zrctl\"" Jun 03 16:40:32.285272 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.285234 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88"] Jun 03 16:40:32.351024 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.350961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-manifests\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.351024 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.351027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-tmp\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.351283 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.351072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.351283 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.351111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.351283 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.351141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glt7q\" (UniqueName: \"kubernetes.io/projected/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-kube-api-access-glt7q\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.452382 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.452342 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.452584 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.452390 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glt7q\" (UniqueName: \"kubernetes.io/projected/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-kube-api-access-glt7q\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.452584 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.452480 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-manifests\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.452707 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.452594 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-tmp\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.452707 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.452644 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.452902 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.452882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-manifests\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.454831 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.454797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-tmp\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.454940 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.454874 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.455059 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.455042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.460206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.460188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glt7q\" (UniqueName: \"kubernetes.io/projected/2bb671e1-4df3-4adb-9b02-85b39e0a3ec4-kube-api-access-glt7q\") pod \"opendatahub-operator-controller-manager-5f84758474-m9b88\" (UID: \"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4\") " pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.570787 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.570689 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:32.711886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.711848 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88"] Jun 03 16:40:32.716135 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:40:32.716103 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb671e1_4df3_4adb_9b02_85b39e0a3ec4.slice/crio-4036cc1158a8b3fc2c43da3cf968709e5808bdff21e876d49123468da4edc8d6 WatchSource:0}: Error finding container 4036cc1158a8b3fc2c43da3cf968709e5808bdff21e876d49123468da4edc8d6: Status 404 returned error can't find the container with id 4036cc1158a8b3fc2c43da3cf968709e5808bdff21e876d49123468da4edc8d6 Jun 03 16:40:32.718077 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:32.718053 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:40:33.347152 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:33.347093 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" event={"ID":"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4","Type":"ContainerStarted","Data":"4036cc1158a8b3fc2c43da3cf968709e5808bdff21e876d49123468da4edc8d6"} Jun 03 16:40:36.359551 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:36.359512 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" event={"ID":"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4","Type":"ContainerStarted","Data":"5acc90a59821ed139cfa6348845c8731da75e7a3f0454e8bfcb9aa61b05a8730"} Jun 03 16:40:37.364381 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:37.364343 2574 generic.go:358] "Generic (PLEG): container finished" podID="2bb671e1-4df3-4adb-9b02-85b39e0a3ec4" containerID="5acc90a59821ed139cfa6348845c8731da75e7a3f0454e8bfcb9aa61b05a8730" exitCode=0 Jun 03 16:40:37.364760 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:37.364414 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" event={"ID":"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4","Type":"ContainerDied","Data":"5acc90a59821ed139cfa6348845c8731da75e7a3f0454e8bfcb9aa61b05a8730"} Jun 03 16:40:38.369334 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:38.369296 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" event={"ID":"2bb671e1-4df3-4adb-9b02-85b39e0a3ec4","Type":"ContainerStarted","Data":"69732dcf9a8bb37464e51e66174b455f65a92ed5571ff575844b9b04b10e2aa8"} Jun 03 16:40:38.369750 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:38.369425 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:40:38.406684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:38.406582 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" podStartSLOduration=1.44155725 podStartE2EDuration="6.406566434s" podCreationTimestamp="2026-06-03 16:40:32 +0000 UTC" firstStartedPulling="2026-06-03 16:40:32.71824455 +0000 UTC m=+394.132141327" lastFinishedPulling="2026-06-03 16:40:37.683253746 +0000 UTC m=+399.097150511" observedRunningTime="2026-06-03 16:40:38.404681304 +0000 UTC m=+399.818578096" watchObservedRunningTime="2026-06-03 16:40:38.406566434 +0000 UTC m=+399.820463213" Jun 03 16:40:49.375864 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:40:49.375824 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f84758474-m9b88" Jun 03 16:41:01.396040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.396003 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bc585896-cddfk"] Jun 03 16:41:01.405500 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.405475 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.408239 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408208 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bc585896-cddfk"] Jun 03 16:41:01.408421 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408394 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 16:41:01.408504 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408401 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 16:41:01.408504 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408470 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 16:41:01.408607 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408550 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:41:01.408607 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408584 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6h8bk\"" Jun 03 16:41:01.408747 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.408693 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 16:41:01.500132 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.500088 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc0cb38-da63-4262-9f30-415fe0529f35-cert\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.500316 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.500165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dc0cb38-da63-4262-9f30-415fe0529f35-manager-config\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.500316 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.500188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rkww\" (UniqueName: \"kubernetes.io/projected/4dc0cb38-da63-4262-9f30-415fe0529f35-kube-api-access-8rkww\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.500316 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.500213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dc0cb38-da63-4262-9f30-415fe0529f35-metrics-cert\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.601259 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.601217 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dc0cb38-da63-4262-9f30-415fe0529f35-manager-config\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.601259 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.601260 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rkww\" (UniqueName: \"kubernetes.io/projected/4dc0cb38-da63-4262-9f30-415fe0529f35-kube-api-access-8rkww\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.601514 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.601296 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dc0cb38-da63-4262-9f30-415fe0529f35-metrics-cert\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.601514 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.601350 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc0cb38-da63-4262-9f30-415fe0529f35-cert\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.601883 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.601862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dc0cb38-da63-4262-9f30-415fe0529f35-manager-config\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.603849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.603825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc0cb38-da63-4262-9f30-415fe0529f35-cert\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.603944 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.603852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dc0cb38-da63-4262-9f30-415fe0529f35-metrics-cert\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.625545 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.625502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rkww\" (UniqueName: \"kubernetes.io/projected/4dc0cb38-da63-4262-9f30-415fe0529f35-kube-api-access-8rkww\") pod \"lws-controller-manager-69bc585896-cddfk\" (UID: \"4dc0cb38-da63-4262-9f30-415fe0529f35\") " pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.716811 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.716716 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:01.849894 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:01.849870 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bc585896-cddfk"] Jun 03 16:41:01.851940 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:41:01.851913 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc0cb38_da63_4262_9f30_415fe0529f35.slice/crio-f3e58bb944c94fd10eaea08ff9e361b687ade637793a53dcb8c1731b0ddbed4f WatchSource:0}: Error finding container f3e58bb944c94fd10eaea08ff9e361b687ade637793a53dcb8c1731b0ddbed4f: Status 404 returned error can't find the container with id f3e58bb944c94fd10eaea08ff9e361b687ade637793a53dcb8c1731b0ddbed4f Jun 03 16:41:02.459096 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:02.459059 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" event={"ID":"4dc0cb38-da63-4262-9f30-415fe0529f35","Type":"ContainerStarted","Data":"f3e58bb944c94fd10eaea08ff9e361b687ade637793a53dcb8c1731b0ddbed4f"} Jun 03 16:41:05.478606 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:05.478568 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" event={"ID":"4dc0cb38-da63-4262-9f30-415fe0529f35","Type":"ContainerStarted","Data":"b787cadda50c3deb5b0d927cf4fbad2d0520eff753747f03f01080307988a96c"} Jun 03 16:41:05.479037 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:05.478747 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:05.529517 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:05.529449 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" podStartSLOduration=1.956941593 podStartE2EDuration="4.529430705s" podCreationTimestamp="2026-06-03 16:41:01 +0000 UTC" firstStartedPulling="2026-06-03 16:41:01.853768621 +0000 UTC m=+423.267665378" lastFinishedPulling="2026-06-03 16:41:04.426257731 +0000 UTC m=+425.840154490" observedRunningTime="2026-06-03 16:41:05.529106768 +0000 UTC m=+426.943003548" watchObservedRunningTime="2026-06-03 16:41:05.529430705 +0000 UTC m=+426.943327486" Jun 03 16:41:16.484269 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:16.484190 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69bc585896-cddfk" Jun 03 16:41:31.389802 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.389763 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm"] Jun 03 16:41:31.393766 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.393739 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.395884 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.395859 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ptpqr\"" Jun 03 16:41:31.396028 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.395891 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 16:41:31.403855 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.403832 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm"] Jun 03 16:41:31.587656 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.587656 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.587886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.587886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.587886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.587886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.588064 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587916 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.588064 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.587936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwlbx\" (UniqueName: \"kubernetes.io/projected/252fda0f-d5b0-461d-a06f-6696fabfaa6a-kube-api-access-kwlbx\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.588064 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.588004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.688842 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688749 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.688842 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688801 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.688842 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688823 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688857 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688877 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688898 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwlbx\" (UniqueName: \"kubernetes.io/projected/252fda0f-d5b0-461d-a06f-6696fabfaa6a-kube-api-access-kwlbx\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.688941 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689013 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689049 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689435 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689497 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689551 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689640 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.689718 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.689701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.691931 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.691909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.692087 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.692070 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.699253 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.699231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/252fda0f-d5b0-461d-a06f-6696fabfaa6a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.699489 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.699467 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwlbx\" (UniqueName: \"kubernetes.io/projected/252fda0f-d5b0-461d-a06f-6696fabfaa6a-kube-api-access-kwlbx\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8d4qjm\" (UID: \"252fda0f-d5b0-461d-a06f-6696fabfaa6a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.706180 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.706160 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:31.834686 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:31.834654 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm"] Jun 03 16:41:31.840151 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:41:31.840114 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252fda0f_d5b0_461d_a06f_6696fabfaa6a.slice/crio-6021c36761ccaec72da1ca1ff2fc3f101003d66873256ee7518d9ca231229798 WatchSource:0}: Error finding container 6021c36761ccaec72da1ca1ff2fc3f101003d66873256ee7518d9ca231229798: Status 404 returned error can't find the container with id 6021c36761ccaec72da1ca1ff2fc3f101003d66873256ee7518d9ca231229798 Jun 03 16:41:32.567301 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:32.567258 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" event={"ID":"252fda0f-d5b0-461d-a06f-6696fabfaa6a","Type":"ContainerStarted","Data":"6021c36761ccaec72da1ca1ff2fc3f101003d66873256ee7518d9ca231229798"} Jun 03 16:41:34.242582 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.242537 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:41:34.242960 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.242628 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:41:34.242960 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.242676 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:41:34.577654 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.577624 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" event={"ID":"252fda0f-d5b0-461d-a06f-6696fabfaa6a","Type":"ContainerStarted","Data":"c958b9071df6bd4734b019f2dc68748fa3f3bcbf9d7b011d0c6571ff7ce859a8"} Jun 03 16:41:34.597121 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.597071 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" podStartSLOduration=1.197056129 podStartE2EDuration="3.597057026s" podCreationTimestamp="2026-06-03 16:41:31 +0000 UTC" firstStartedPulling="2026-06-03 16:41:31.842273765 +0000 UTC m=+453.256170525" lastFinishedPulling="2026-06-03 16:41:34.242274664 +0000 UTC m=+455.656171422" observedRunningTime="2026-06-03 16:41:34.595549631 +0000 UTC m=+456.009446422" watchObservedRunningTime="2026-06-03 16:41:34.597057026 +0000 UTC m=+456.010953806" Jun 03 16:41:34.706913 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.706867 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:34.962988 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.962881 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-99f686c75-tzq7z"] Jun 03 16:41:34.966636 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.966612 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:34.968565 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.968537 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 16:41:34.968565 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.968537 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d56zr\"" Jun 03 16:41:34.975835 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:34.975784 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-99f686c75-tzq7z"] Jun 03 16:41:35.019424 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.019379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/68e9a10a-ef41-400f-89b4-855ad01f5262-redirect-config\") pod \"dashboard-redirect-99f686c75-tzq7z\" (UID: \"68e9a10a-ef41-400f-89b4-855ad01f5262\") " pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.019424 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.019429 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4xr\" (UniqueName: \"kubernetes.io/projected/68e9a10a-ef41-400f-89b4-855ad01f5262-kube-api-access-vp4xr\") pod \"dashboard-redirect-99f686c75-tzq7z\" (UID: \"68e9a10a-ef41-400f-89b4-855ad01f5262\") " pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.120105 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.120066 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/68e9a10a-ef41-400f-89b4-855ad01f5262-redirect-config\") pod \"dashboard-redirect-99f686c75-tzq7z\" (UID: \"68e9a10a-ef41-400f-89b4-855ad01f5262\") " pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.120255 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.120117 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4xr\" (UniqueName: \"kubernetes.io/projected/68e9a10a-ef41-400f-89b4-855ad01f5262-kube-api-access-vp4xr\") pod \"dashboard-redirect-99f686c75-tzq7z\" (UID: \"68e9a10a-ef41-400f-89b4-855ad01f5262\") " pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.120839 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.120820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/68e9a10a-ef41-400f-89b4-855ad01f5262-redirect-config\") pod \"dashboard-redirect-99f686c75-tzq7z\" (UID: \"68e9a10a-ef41-400f-89b4-855ad01f5262\") " pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.127344 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.127314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4xr\" (UniqueName: \"kubernetes.io/projected/68e9a10a-ef41-400f-89b4-855ad01f5262-kube-api-access-vp4xr\") pod \"dashboard-redirect-99f686c75-tzq7z\" (UID: \"68e9a10a-ef41-400f-89b4-855ad01f5262\") " pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.279440 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.279362 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" Jun 03 16:41:35.612718 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.612691 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-99f686c75-tzq7z"] Jun 03 16:41:35.615319 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:41:35.615289 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e9a10a_ef41_400f_89b4_855ad01f5262.slice/crio-72944c79559215928c567c89f2f12c2bec355d0b4b892bfc62276728ce9944e8 WatchSource:0}: Error finding container 72944c79559215928c567c89f2f12c2bec355d0b4b892bfc62276728ce9944e8: Status 404 returned error can't find the container with id 72944c79559215928c567c89f2f12c2bec355d0b4b892bfc62276728ce9944e8 Jun 03 16:41:35.708181 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.708143 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jun 03 16:41:35.708351 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:35.708205 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" podUID="252fda0f-d5b0-461d-a06f-6696fabfaa6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jun 03 16:41:36.585664 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:36.585621 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" event={"ID":"68e9a10a-ef41-400f-89b4-855ad01f5262","Type":"ContainerStarted","Data":"72944c79559215928c567c89f2f12c2bec355d0b4b892bfc62276728ce9944e8"} Jun 03 16:41:36.712650 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:36.712334 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:37.590617 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:37.590583 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:37.591812 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:37.591787 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8d4qjm" Jun 03 16:41:40.603898 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:40.603865 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" event={"ID":"68e9a10a-ef41-400f-89b4-855ad01f5262","Type":"ContainerStarted","Data":"64bc7427d155ad304ead30ec292cd33d704f1344139a4fa627dd82bd17423232"} Jun 03 16:41:40.617834 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:40.617782 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-99f686c75-tzq7z" podStartSLOduration=1.9546497760000001 podStartE2EDuration="6.617766901s" podCreationTimestamp="2026-06-03 16:41:34 +0000 UTC" firstStartedPulling="2026-06-03 16:41:35.616661163 +0000 UTC m=+457.030557921" lastFinishedPulling="2026-06-03 16:41:40.279778287 +0000 UTC m=+461.693675046" observedRunningTime="2026-06-03 16:41:40.616486164 +0000 UTC m=+462.030382944" watchObservedRunningTime="2026-06-03 16:41:40.617766901 +0000 UTC m=+462.031663684" Jun 03 16:41:53.025328 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.025292 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-789vw"] Jun 03 16:41:53.028152 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.028126 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:53.032342 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.032317 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 16:41:53.034308 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.034286 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-z6xlf\"" Jun 03 16:41:53.041410 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.041384 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-789vw"] Jun 03 16:41:53.048774 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.048749 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 16:41:53.074477 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.074447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fmfd\" (UniqueName: \"kubernetes.io/projected/f5e37fdd-d742-4c5e-ab9f-61daeb172c03-kube-api-access-8fmfd\") pod \"kuadrant-operator-catalog-789vw\" (UID: \"f5e37fdd-d742-4c5e-ab9f-61daeb172c03\") " pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:53.175873 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.175841 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fmfd\" (UniqueName: \"kubernetes.io/projected/f5e37fdd-d742-4c5e-ab9f-61daeb172c03-kube-api-access-8fmfd\") pod \"kuadrant-operator-catalog-789vw\" (UID: \"f5e37fdd-d742-4c5e-ab9f-61daeb172c03\") " pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:53.189479 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.189445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fmfd\" (UniqueName: \"kubernetes.io/projected/f5e37fdd-d742-4c5e-ab9f-61daeb172c03-kube-api-access-8fmfd\") pod \"kuadrant-operator-catalog-789vw\" (UID: \"f5e37fdd-d742-4c5e-ab9f-61daeb172c03\") " pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:53.336933 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.336902 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:53.392494 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.392462 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-789vw"] Jun 03 16:41:53.473833 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.473808 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-789vw"] Jun 03 16:41:53.476546 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:41:53.476516 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e37fdd_d742_4c5e_ab9f_61daeb172c03.slice/crio-01a706396b69503498b0e005a88c059a40bdb850723578d261a5977006be8445 WatchSource:0}: Error finding container 01a706396b69503498b0e005a88c059a40bdb850723578d261a5977006be8445: Status 404 returned error can't find the container with id 01a706396b69503498b0e005a88c059a40bdb850723578d261a5977006be8445 Jun 03 16:41:53.596197 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.596116 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brhvv"] Jun 03 16:41:53.598936 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.598918 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:41:53.606365 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.606338 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brhvv"] Jun 03 16:41:53.646504 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.646464 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-789vw" event={"ID":"f5e37fdd-d742-4c5e-ab9f-61daeb172c03","Type":"ContainerStarted","Data":"01a706396b69503498b0e005a88c059a40bdb850723578d261a5977006be8445"} Jun 03 16:41:53.680266 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.680222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdxzx\" (UniqueName: \"kubernetes.io/projected/f5ef69f6-abb1-4622-a852-27f2682fbe63-kube-api-access-qdxzx\") pod \"kuadrant-operator-catalog-brhvv\" (UID: \"f5ef69f6-abb1-4622-a852-27f2682fbe63\") " pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:41:53.781721 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.781675 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdxzx\" (UniqueName: \"kubernetes.io/projected/f5ef69f6-abb1-4622-a852-27f2682fbe63-kube-api-access-qdxzx\") pod \"kuadrant-operator-catalog-brhvv\" (UID: \"f5ef69f6-abb1-4622-a852-27f2682fbe63\") " pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:41:53.791034 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.791000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdxzx\" (UniqueName: \"kubernetes.io/projected/f5ef69f6-abb1-4622-a852-27f2682fbe63-kube-api-access-qdxzx\") pod \"kuadrant-operator-catalog-brhvv\" (UID: \"f5ef69f6-abb1-4622-a852-27f2682fbe63\") " pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:41:53.910297 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:53.910196 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:41:54.044887 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:54.044856 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-brhvv"] Jun 03 16:41:54.077692 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:41:54.077658 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ef69f6_abb1_4622_a852_27f2682fbe63.slice/crio-2cc5cd3e518b2c40d1b0fefce8228e73377597e2ec5e32bcc2152728ccd5afa1 WatchSource:0}: Error finding container 2cc5cd3e518b2c40d1b0fefce8228e73377597e2ec5e32bcc2152728ccd5afa1: Status 404 returned error can't find the container with id 2cc5cd3e518b2c40d1b0fefce8228e73377597e2ec5e32bcc2152728ccd5afa1 Jun 03 16:41:54.651932 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:54.651890 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" event={"ID":"f5ef69f6-abb1-4622-a852-27f2682fbe63","Type":"ContainerStarted","Data":"2cc5cd3e518b2c40d1b0fefce8228e73377597e2ec5e32bcc2152728ccd5afa1"} Jun 03 16:41:56.662541 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:56.662500 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" event={"ID":"f5ef69f6-abb1-4622-a852-27f2682fbe63","Type":"ContainerStarted","Data":"7146b3c0443266cf3c47a4834226f3eeaf673a8a3476277abf590754cf258a79"} Jun 03 16:41:56.677546 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:56.677491 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" podStartSLOduration=2.077096498 podStartE2EDuration="3.677476539s" podCreationTimestamp="2026-06-03 16:41:53 +0000 UTC" firstStartedPulling="2026-06-03 16:41:54.079338948 +0000 UTC m=+475.493235707" lastFinishedPulling="2026-06-03 16:41:55.679718977 +0000 UTC m=+477.093615748" observedRunningTime="2026-06-03 16:41:56.675522044 +0000 UTC m=+478.089418823" watchObservedRunningTime="2026-06-03 16:41:56.677476539 +0000 UTC m=+478.091373318" Jun 03 16:41:57.667406 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:57.667374 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-789vw" event={"ID":"f5e37fdd-d742-4c5e-ab9f-61daeb172c03","Type":"ContainerStarted","Data":"87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb"} Jun 03 16:41:57.667799 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:57.667624 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-789vw" podUID="f5e37fdd-d742-4c5e-ab9f-61daeb172c03" containerName="registry-server" containerID="cri-o://87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb" gracePeriod=2 Jun 03 16:41:57.682118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:57.682057 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-789vw" podStartSLOduration=0.886004667 podStartE2EDuration="4.682039717s" podCreationTimestamp="2026-06-03 16:41:53 +0000 UTC" firstStartedPulling="2026-06-03 16:41:53.478117681 +0000 UTC m=+474.892014443" lastFinishedPulling="2026-06-03 16:41:57.274152731 +0000 UTC m=+478.688049493" observedRunningTime="2026-06-03 16:41:57.68067451 +0000 UTC m=+479.094571290" watchObservedRunningTime="2026-06-03 16:41:57.682039717 +0000 UTC m=+479.095936497" Jun 03 16:41:57.912581 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:57.912553 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:58.019828 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.019714 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fmfd\" (UniqueName: \"kubernetes.io/projected/f5e37fdd-d742-4c5e-ab9f-61daeb172c03-kube-api-access-8fmfd\") pod \"f5e37fdd-d742-4c5e-ab9f-61daeb172c03\" (UID: \"f5e37fdd-d742-4c5e-ab9f-61daeb172c03\") " Jun 03 16:41:58.022018 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.021986 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5e37fdd-d742-4c5e-ab9f-61daeb172c03-kube-api-access-8fmfd" (OuterVolumeSpecName: "kube-api-access-8fmfd") pod "f5e37fdd-d742-4c5e-ab9f-61daeb172c03" (UID: "f5e37fdd-d742-4c5e-ab9f-61daeb172c03"). InnerVolumeSpecName "kube-api-access-8fmfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:41:58.120671 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.120633 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fmfd\" (UniqueName: \"kubernetes.io/projected/f5e37fdd-d742-4c5e-ab9f-61daeb172c03-kube-api-access-8fmfd\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:41:58.671509 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.671471 2574 generic.go:358] "Generic (PLEG): container finished" podID="f5e37fdd-d742-4c5e-ab9f-61daeb172c03" containerID="87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb" exitCode=0 Jun 03 16:41:58.672004 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.671532 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-789vw" Jun 03 16:41:58.672004 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.671561 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-789vw" event={"ID":"f5e37fdd-d742-4c5e-ab9f-61daeb172c03","Type":"ContainerDied","Data":"87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb"} Jun 03 16:41:58.672004 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.671602 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-789vw" event={"ID":"f5e37fdd-d742-4c5e-ab9f-61daeb172c03","Type":"ContainerDied","Data":"01a706396b69503498b0e005a88c059a40bdb850723578d261a5977006be8445"} Jun 03 16:41:58.672004 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.671617 2574 scope.go:117] "RemoveContainer" containerID="87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb" Jun 03 16:41:58.680744 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.680727 2574 scope.go:117] "RemoveContainer" containerID="87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb" Jun 03 16:41:58.681002 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:41:58.680966 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb\": container with ID starting with 87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb not found: ID does not exist" containerID="87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb" Jun 03 16:41:58.681071 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.681023 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb"} err="failed to get container status \"87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb\": rpc error: code = NotFound desc = could not find container \"87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb\": container with ID starting with 87ae8a1a7004855240e54120763c9352ec3178dfe4be218435079a0965dfc0bb not found: ID does not exist" Jun 03 16:41:58.690614 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.690585 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-789vw"] Jun 03 16:41:58.692863 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:58.692842 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-789vw"] Jun 03 16:41:59.125271 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:41:59.125238 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e37fdd-d742-4c5e-ab9f-61daeb172c03" path="/var/lib/kubelet/pods/f5e37fdd-d742-4c5e-ab9f-61daeb172c03/volumes" Jun 03 16:42:03.910696 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:03.910658 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:42:03.910696 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:03.910702 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:42:03.933689 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:03.933658 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:42:04.714369 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:04.714341 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-brhvv" Jun 03 16:42:20.329570 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.329467 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tlg7j"] Jun 03 16:42:20.330042 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.329991 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e37fdd-d742-4c5e-ab9f-61daeb172c03" containerName="registry-server" Jun 03 16:42:20.330042 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.330010 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e37fdd-d742-4c5e-ab9f-61daeb172c03" containerName="registry-server" Jun 03 16:42:20.330166 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.330127 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f5e37fdd-d742-4c5e-ab9f-61daeb172c03" containerName="registry-server" Jun 03 16:42:20.346789 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.346752 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tlg7j"] Jun 03 16:42:20.346956 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.346884 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:20.349155 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.349134 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9dr48\"" Jun 03 16:42:20.527352 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.527293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdh7d\" (UniqueName: \"kubernetes.io/projected/9c40b292-c654-4db9-887f-a8d7c1695dd1-kube-api-access-fdh7d\") pod \"authorino-operator-657f44b778-tlg7j\" (UID: \"9c40b292-c654-4db9-887f-a8d7c1695dd1\") " pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:20.628411 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.628330 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdh7d\" (UniqueName: \"kubernetes.io/projected/9c40b292-c654-4db9-887f-a8d7c1695dd1-kube-api-access-fdh7d\") pod \"authorino-operator-657f44b778-tlg7j\" (UID: \"9c40b292-c654-4db9-887f-a8d7c1695dd1\") " pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:20.637369 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.637340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdh7d\" (UniqueName: \"kubernetes.io/projected/9c40b292-c654-4db9-887f-a8d7c1695dd1-kube-api-access-fdh7d\") pod \"authorino-operator-657f44b778-tlg7j\" (UID: \"9c40b292-c654-4db9-887f-a8d7c1695dd1\") " pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:20.657869 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.657837 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:20.790278 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:20.790250 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tlg7j"] Jun 03 16:42:20.792348 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:42:20.792316 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c40b292_c654_4db9_887f_a8d7c1695dd1.slice/crio-15bd79498004dd2cfc8597e4be5a48acfd498ee93fc2ea1cb3acf194310b3ec8 WatchSource:0}: Error finding container 15bd79498004dd2cfc8597e4be5a48acfd498ee93fc2ea1cb3acf194310b3ec8: Status 404 returned error can't find the container with id 15bd79498004dd2cfc8597e4be5a48acfd498ee93fc2ea1cb3acf194310b3ec8 Jun 03 16:42:21.752427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:21.752388 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" event={"ID":"9c40b292-c654-4db9-887f-a8d7c1695dd1","Type":"ContainerStarted","Data":"15bd79498004dd2cfc8597e4be5a48acfd498ee93fc2ea1cb3acf194310b3ec8"} Jun 03 16:42:23.761638 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:23.761602 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" event={"ID":"9c40b292-c654-4db9-887f-a8d7c1695dd1","Type":"ContainerStarted","Data":"494add3f03a699a5e0d54b65a552282a7d4c1f721e0b7d72a5b40938ecbdd144"} Jun 03 16:42:23.762153 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:23.761723 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:23.779340 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:23.779292 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" podStartSLOduration=1.6412628649999998 podStartE2EDuration="3.779278917s" podCreationTimestamp="2026-06-03 16:42:20 +0000 UTC" firstStartedPulling="2026-06-03 16:42:20.79479419 +0000 UTC m=+502.208690951" lastFinishedPulling="2026-06-03 16:42:22.932810225 +0000 UTC m=+504.346707003" observedRunningTime="2026-06-03 16:42:23.77807443 +0000 UTC m=+505.191971210" watchObservedRunningTime="2026-06-03 16:42:23.779278917 +0000 UTC m=+505.193175696" Jun 03 16:42:26.882905 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:26.882869 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv"] Jun 03 16:42:26.885152 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:26.885131 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:26.887598 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:26.887574 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 16:42:26.887739 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:26.887626 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qsf25\"" Jun 03 16:42:26.896180 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:26.896160 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv"] Jun 03 16:42:26.982267 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:26.982229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgg6\" (UniqueName: \"kubernetes.io/projected/d0a61e4d-139b-4466-8fb9-25f31f9ff86d-kube-api-access-vbgg6\") pod \"dns-operator-controller-manager-648d5c98bc-zh2mv\" (UID: \"d0a61e4d-139b-4466-8fb9-25f31f9ff86d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:27.083194 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:27.083156 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgg6\" (UniqueName: \"kubernetes.io/projected/d0a61e4d-139b-4466-8fb9-25f31f9ff86d-kube-api-access-vbgg6\") pod \"dns-operator-controller-manager-648d5c98bc-zh2mv\" (UID: \"d0a61e4d-139b-4466-8fb9-25f31f9ff86d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:27.091818 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:27.091782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgg6\" (UniqueName: \"kubernetes.io/projected/d0a61e4d-139b-4466-8fb9-25f31f9ff86d-kube-api-access-vbgg6\") pod \"dns-operator-controller-manager-648d5c98bc-zh2mv\" (UID: \"d0a61e4d-139b-4466-8fb9-25f31f9ff86d\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:27.194914 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:27.194825 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:27.326783 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:27.326751 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv"] Jun 03 16:42:27.330461 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:42:27.330431 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a61e4d_139b_4466_8fb9_25f31f9ff86d.slice/crio-efdff6f222fe88650321e02f8163d9e303c0edb4b9665997b9405f589ee760ef WatchSource:0}: Error finding container efdff6f222fe88650321e02f8163d9e303c0edb4b9665997b9405f589ee760ef: Status 404 returned error can't find the container with id efdff6f222fe88650321e02f8163d9e303c0edb4b9665997b9405f589ee760ef Jun 03 16:42:27.775636 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:27.775592 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" event={"ID":"d0a61e4d-139b-4466-8fb9-25f31f9ff86d","Type":"ContainerStarted","Data":"efdff6f222fe88650321e02f8163d9e303c0edb4b9665997b9405f589ee760ef"} Jun 03 16:42:30.787216 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:30.787176 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" event={"ID":"d0a61e4d-139b-4466-8fb9-25f31f9ff86d","Type":"ContainerStarted","Data":"eb6e9002275b226755515e36dc200be4099f87b52f8bb334d85d2b139c7949ce"} Jun 03 16:42:30.787632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:30.787316 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:30.804040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:30.803954 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" podStartSLOduration=2.319093717 podStartE2EDuration="4.80393951s" podCreationTimestamp="2026-06-03 16:42:26 +0000 UTC" firstStartedPulling="2026-06-03 16:42:27.332870806 +0000 UTC m=+508.746767567" lastFinishedPulling="2026-06-03 16:42:29.817716599 +0000 UTC m=+511.231613360" observedRunningTime="2026-06-03 16:42:30.803110435 +0000 UTC m=+512.217007215" watchObservedRunningTime="2026-06-03 16:42:30.80393951 +0000 UTC m=+512.217836290" Jun 03 16:42:32.087148 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.087108 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh"] Jun 03 16:42:32.090701 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.090682 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.092941 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.092924 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qqh2p\"" Jun 03 16:42:32.104414 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.104390 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh"] Jun 03 16:42:32.132174 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.132141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbz8x\" (UniqueName: \"kubernetes.io/projected/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-kube-api-access-hbz8x\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.132344 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.132207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.233005 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.232927 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.233181 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.233085 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbz8x\" (UniqueName: \"kubernetes.io/projected/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-kube-api-access-hbz8x\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.233348 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.233327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.241031 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.241001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbz8x\" (UniqueName: \"kubernetes.io/projected/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-kube-api-access-hbz8x\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.400725 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.400628 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:32.531313 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.531288 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh"] Jun 03 16:42:32.533851 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:42:32.533825 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd792efe9_39b8_414e_b8e6_35e01fb4a3c2.slice/crio-824a3ab29d949e174dc5d4dce78d6d0c3d7d137296beae9fb57c5a2ad62c1531 WatchSource:0}: Error finding container 824a3ab29d949e174dc5d4dce78d6d0c3d7d137296beae9fb57c5a2ad62c1531: Status 404 returned error can't find the container with id 824a3ab29d949e174dc5d4dce78d6d0c3d7d137296beae9fb57c5a2ad62c1531 Jun 03 16:42:32.795294 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:32.795201 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" event={"ID":"d792efe9-39b8-414e-b8e6-35e01fb4a3c2","Type":"ContainerStarted","Data":"824a3ab29d949e174dc5d4dce78d6d0c3d7d137296beae9fb57c5a2ad62c1531"} Jun 03 16:42:34.767793 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:34.767755 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-tlg7j" Jun 03 16:42:38.819473 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:38.819387 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" event={"ID":"d792efe9-39b8-414e-b8e6-35e01fb4a3c2","Type":"ContainerStarted","Data":"bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf"} Jun 03 16:42:38.819815 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:38.819528 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:38.837930 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:38.837870 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" podStartSLOduration=0.98515178 podStartE2EDuration="6.837843732s" podCreationTimestamp="2026-06-03 16:42:32 +0000 UTC" firstStartedPulling="2026-06-03 16:42:32.536192085 +0000 UTC m=+513.950088843" lastFinishedPulling="2026-06-03 16:42:38.388884036 +0000 UTC m=+519.802780795" observedRunningTime="2026-06-03 16:42:38.836607499 +0000 UTC m=+520.250504279" watchObservedRunningTime="2026-06-03 16:42:38.837843732 +0000 UTC m=+520.251740513" Jun 03 16:42:41.792421 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:41.792391 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-zh2mv" Jun 03 16:42:49.825632 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:49.825599 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:51.477777 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.477733 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh"] Jun 03 16:42:51.478224 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.478073 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" containerName="manager" containerID="cri-o://bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf" gracePeriod=2 Jun 03 16:42:51.482074 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.482044 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh"] Jun 03 16:42:51.496775 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.496743 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd"] Jun 03 16:42:51.497532 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.497275 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" containerName="manager" Jun 03 16:42:51.497532 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.497300 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" containerName="manager" Jun 03 16:42:51.497532 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.497424 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" containerName="manager" Jun 03 16:42:51.500518 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.500498 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.511375 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.511351 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd"] Jun 03 16:42:51.523277 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.523244 2574 status_manager.go:895] "Failed to get status for pod" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" is forbidden: User \"system:node:ip-10-0-142-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-172.ec2.internal' and this object" Jun 03 16:42:51.614779 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.614741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmnn2\" (UniqueName: \"kubernetes.io/projected/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-kube-api-access-vmnn2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgjrd\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.614931 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.614819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgjrd\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.716240 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.716206 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmnn2\" (UniqueName: \"kubernetes.io/projected/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-kube-api-access-vmnn2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgjrd\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.716389 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.716259 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgjrd\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.716686 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.716662 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgjrd\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.720444 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.720427 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:51.722490 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.722465 2574 status_manager.go:895] "Failed to get status for pod" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" is forbidden: User \"system:node:ip-10-0-142-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-172.ec2.internal' and this object" Jun 03 16:42:51.726330 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.726311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmnn2\" (UniqueName: \"kubernetes.io/projected/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-kube-api-access-vmnn2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-zgjrd\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.816847 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.816758 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbz8x\" (UniqueName: \"kubernetes.io/projected/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-kube-api-access-hbz8x\") pod \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " Jun 03 16:42:51.817037 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.816896 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-extensions-socket-volume\") pod \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\" (UID: \"d792efe9-39b8-414e-b8e6-35e01fb4a3c2\") " Jun 03 16:42:51.817427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.817397 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d792efe9-39b8-414e-b8e6-35e01fb4a3c2" (UID: "d792efe9-39b8-414e-b8e6-35e01fb4a3c2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:42:51.818847 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.818824 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-kube-api-access-hbz8x" (OuterVolumeSpecName: "kube-api-access-hbz8x") pod "d792efe9-39b8-414e-b8e6-35e01fb4a3c2" (UID: "d792efe9-39b8-414e-b8e6-35e01fb4a3c2"). InnerVolumeSpecName "kube-api-access-hbz8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:42:51.863520 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.863489 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:51.866110 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.866084 2574 generic.go:358] "Generic (PLEG): container finished" podID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" containerID="bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf" exitCode=0 Jun 03 16:42:51.866206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.866156 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" Jun 03 16:42:51.866297 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.866165 2574 scope.go:117] "RemoveContainer" containerID="bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf" Jun 03 16:42:51.868306 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.868269 2574 status_manager.go:895] "Failed to get status for pod" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" is forbidden: User \"system:node:ip-10-0-142-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-172.ec2.internal' and this object" Jun 03 16:42:51.874730 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.874706 2574 scope.go:117] "RemoveContainer" containerID="bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf" Jun 03 16:42:51.875032 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:42:51.874966 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf\": container with ID starting with bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf not found: ID does not exist" containerID="bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf" Jun 03 16:42:51.875099 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.875021 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf"} err="failed to get container status \"bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf\": rpc error: code = NotFound desc = could not find container \"bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf\": container with ID starting with bf45a2b8720093e1965e400012b46c11a6bc3091ac78b9d9f3cedcb1a8d4d7cf not found: ID does not exist" Jun 03 16:42:51.877378 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.877348 2574 status_manager.go:895] "Failed to get status for pod" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" is forbidden: User \"system:node:ip-10-0-142-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-172.ec2.internal' and this object" Jun 03 16:42:51.918002 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.917944 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-extensions-socket-volume\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:42:51.918002 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:51.918003 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbz8x\" (UniqueName: \"kubernetes.io/projected/d792efe9-39b8-414e-b8e6-35e01fb4a3c2-kube-api-access-hbz8x\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:42:52.011530 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:52.011491 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd"] Jun 03 16:42:52.014884 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:42:52.014859 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d167cf4_2e9c_4b07_8152_6e45f3a4de5a.slice/crio-9554b37eefa7f679b23846f878edeb73078535d7c003ab7fce8f6a4203fc7784 WatchSource:0}: Error finding container 9554b37eefa7f679b23846f878edeb73078535d7c003ab7fce8f6a4203fc7784: Status 404 returned error can't find the container with id 9554b37eefa7f679b23846f878edeb73078535d7c003ab7fce8f6a4203fc7784 Jun 03 16:42:52.872405 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:52.872364 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" event={"ID":"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a","Type":"ContainerStarted","Data":"1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55"} Jun 03 16:42:52.872405 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:52.872406 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" event={"ID":"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a","Type":"ContainerStarted","Data":"9554b37eefa7f679b23846f878edeb73078535d7c003ab7fce8f6a4203fc7784"} Jun 03 16:42:52.872894 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:52.872506 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:42:52.892902 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:52.892848 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" podStartSLOduration=1.892833917 podStartE2EDuration="1.892833917s" podCreationTimestamp="2026-06-03 16:42:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:42:52.891103736 +0000 UTC m=+534.305000518" watchObservedRunningTime="2026-06-03 16:42:52.892833917 +0000 UTC m=+534.306730696" Jun 03 16:42:52.893772 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:52.893743 2574 status_manager.go:895] "Failed to get status for pod" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-44rsh" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-44rsh\" is forbidden: User \"system:node:ip-10-0-142-172.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-172.ec2.internal' and this object" Jun 03 16:42:53.124620 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:42:53.124531 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d792efe9-39b8-414e-b8e6-35e01fb4a3c2" path="/var/lib/kubelet/pods/d792efe9-39b8-414e-b8e6-35e01fb4a3c2/volumes" Jun 03 16:43:03.878032 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:03.877969 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:43:10.417724 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.417687 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bddcb9b6f-7hbm7"] Jun 03 16:43:10.420231 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.420210 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.422457 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.422436 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 16:43:10.423065 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423038 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 16:43:10.423220 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423090 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 16:43:10.423399 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423379 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 16:43:10.423484 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423396 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6vt6b\"" Jun 03 16:43:10.423484 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423396 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 16:43:10.423484 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423385 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 16:43:10.423673 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.423643 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 16:43:10.429737 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.429709 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 16:43:10.430535 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.430513 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bddcb9b6f-7hbm7"] Jun 03 16:43:10.478496 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-serving-cert\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.478496 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478499 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-service-ca\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.478759 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-oauth-config\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.478759 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7l2t\" (UniqueName: \"kubernetes.io/projected/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-kube-api-access-j7l2t\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.478759 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-oauth-serving-cert\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.478759 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-trusted-ca-bundle\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.478759 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.478628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-config\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579426 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579382 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-serving-cert\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579426 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-service-ca\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579454 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-oauth-config\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579488 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7l2t\" (UniqueName: \"kubernetes.io/projected/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-kube-api-access-j7l2t\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579519 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-oauth-serving-cert\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579543 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-trusted-ca-bundle\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.579684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.579580 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-config\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.580291 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.580265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-oauth-serving-cert\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.580410 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.580323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-service-ca\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.580450 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.580416 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-config\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.580615 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.580598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-trusted-ca-bundle\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.581955 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.581935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-serving-cert\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.582084 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.582001 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-console-oauth-config\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.587354 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.587327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7l2t\" (UniqueName: \"kubernetes.io/projected/22858c2b-fd6e-4db9-8ff2-aedbc3da20d3-kube-api-access-j7l2t\") pod \"console-6bddcb9b6f-7hbm7\" (UID: \"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3\") " pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.732219 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.732130 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:10.866937 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.866911 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bddcb9b6f-7hbm7"] Jun 03 16:43:10.869408 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:43:10.869378 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22858c2b_fd6e_4db9_8ff2_aedbc3da20d3.slice/crio-622c228f0d92a54ce420399cade601ca9962fa049fe20412aa35feb19ca4a569 WatchSource:0}: Error finding container 622c228f0d92a54ce420399cade601ca9962fa049fe20412aa35feb19ca4a569: Status 404 returned error can't find the container with id 622c228f0d92a54ce420399cade601ca9962fa049fe20412aa35feb19ca4a569 Jun 03 16:43:10.935038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.935002 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bddcb9b6f-7hbm7" event={"ID":"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3","Type":"ContainerStarted","Data":"7d37896b5a439a6ea7c01fae3b8ffb91ea921a949561c2be3e6b777608ec8422"} Jun 03 16:43:10.935160 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.935044 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bddcb9b6f-7hbm7" event={"ID":"22858c2b-fd6e-4db9-8ff2-aedbc3da20d3","Type":"ContainerStarted","Data":"622c228f0d92a54ce420399cade601ca9962fa049fe20412aa35feb19ca4a569"} Jun 03 16:43:10.953356 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:10.953165 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bddcb9b6f-7hbm7" podStartSLOduration=0.953143377 podStartE2EDuration="953.143377ms" podCreationTimestamp="2026-06-03 16:43:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:43:10.951662406 +0000 UTC m=+552.365559196" watchObservedRunningTime="2026-06-03 16:43:10.953143377 +0000 UTC m=+552.367040158" Jun 03 16:43:20.732719 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:20.732673 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:20.732719 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:20.732718 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:20.737648 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:20.737619 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:20.973947 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:20.973915 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bddcb9b6f-7hbm7" Jun 03 16:43:23.477861 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.477823 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd"] Jun 03 16:43:23.478654 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.478601 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" podUID="4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" containerName="manager" containerID="cri-o://1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55" gracePeriod=10 Jun 03 16:43:23.726550 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.726525 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:43:23.797427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.797323 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-extensions-socket-volume\") pod \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " Jun 03 16:43:23.797427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.797385 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmnn2\" (UniqueName: \"kubernetes.io/projected/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-kube-api-access-vmnn2\") pod \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\" (UID: \"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a\") " Jun 03 16:43:23.797777 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.797755 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" (UID: "4d167cf4-2e9c-4b07-8152-6e45f3a4de5a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:43:23.799849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.799821 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-kube-api-access-vmnn2" (OuterVolumeSpecName: "kube-api-access-vmnn2") pod "4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" (UID: "4d167cf4-2e9c-4b07-8152-6e45f3a4de5a"). InnerVolumeSpecName "kube-api-access-vmnn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:43:23.898858 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.898821 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-extensions-socket-volume\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:43:23.898858 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.898852 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmnn2\" (UniqueName: \"kubernetes.io/projected/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a-kube-api-access-vmnn2\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:43:23.981166 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.981125 2574 generic.go:358] "Generic (PLEG): container finished" podID="4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" containerID="1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55" exitCode=0 Jun 03 16:43:23.981341 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.981178 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" event={"ID":"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a","Type":"ContainerDied","Data":"1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55"} Jun 03 16:43:23.981341 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.981196 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" Jun 03 16:43:23.981341 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.981213 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd" event={"ID":"4d167cf4-2e9c-4b07-8152-6e45f3a4de5a","Type":"ContainerDied","Data":"9554b37eefa7f679b23846f878edeb73078535d7c003ab7fce8f6a4203fc7784"} Jun 03 16:43:23.981341 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.981234 2574 scope.go:117] "RemoveContainer" containerID="1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55" Jun 03 16:43:23.990334 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.990304 2574 scope.go:117] "RemoveContainer" containerID="1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55" Jun 03 16:43:23.990599 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:43:23.990577 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55\": container with ID starting with 1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55 not found: ID does not exist" containerID="1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55" Jun 03 16:43:23.990661 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:23.990609 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55"} err="failed to get container status \"1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55\": rpc error: code = NotFound desc = could not find container \"1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55\": container with ID starting with 1b1c46e06aba9732893a006c33489d54f13e0fd57302e1b6eb54f236c1357b55 not found: ID does not exist" Jun 03 16:43:24.002461 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:24.002429 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd"] Jun 03 16:43:24.009520 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:24.009494 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-zgjrd"] Jun 03 16:43:25.124293 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:25.124259 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" path="/var/lib/kubelet/pods/4d167cf4-2e9c-4b07-8152-6e45f3a4de5a/volumes" Jun 03 16:43:39.816927 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.816891 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r"] Jun 03 16:43:39.817504 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.817390 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" containerName="manager" Jun 03 16:43:39.817504 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.817411 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" containerName="manager" Jun 03 16:43:39.817624 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.817526 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d167cf4-2e9c-4b07-8152-6e45f3a4de5a" containerName="manager" Jun 03 16:43:39.819729 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.819704 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.822487 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.822463 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k2hbn\"" Jun 03 16:43:39.836922 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.836893 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r"] Jun 03 16:43:39.955179 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955179 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f577509-f6f3-400a-abbf-c375844e0853-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955386 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955212 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955386 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f577509-f6f3-400a-abbf-c375844e0853-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955386 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955318 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955386 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955517 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f577509-f6f3-400a-abbf-c375844e0853-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955517 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkvfn\" (UniqueName: \"kubernetes.io/projected/8f577509-f6f3-400a-abbf-c375844e0853-kube-api-access-jkvfn\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:39.955517 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:39.955495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.056734 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056696 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.056866 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056745 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f577509-f6f3-400a-abbf-c375844e0853-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.056866 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056799 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkvfn\" (UniqueName: \"kubernetes.io/projected/8f577509-f6f3-400a-abbf-c375844e0853-kube-api-access-jkvfn\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.056866 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056832 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057005 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056886 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057005 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056926 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f577509-f6f3-400a-abbf-c375844e0853-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057005 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.056957 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057158 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057005 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f577509-f6f3-400a-abbf-c375844e0853-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057158 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057041 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057264 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057358 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057488 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057433 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057488 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.057805 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.057779 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f577509-f6f3-400a-abbf-c375844e0853-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.059303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.059278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f577509-f6f3-400a-abbf-c375844e0853-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.059531 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.059510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f577509-f6f3-400a-abbf-c375844e0853-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.065191 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.065166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f577509-f6f3-400a-abbf-c375844e0853-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.065271 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.065229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkvfn\" (UniqueName: \"kubernetes.io/projected/8f577509-f6f3-400a-abbf-c375844e0853-kube-api-access-jkvfn\") pod \"maas-default-gateway-openshift-default-7df95f575-7wv9r\" (UID: \"8f577509-f6f3-400a-abbf-c375844e0853\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.131886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.131851 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:40.266410 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.266386 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r"] Jun 03 16:43:40.268656 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:43:40.268629 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f577509_f6f3_400a_abbf_c375844e0853.slice/crio-8df9796c070e185bc12d0bc595742bef9be0c3742652d5faab3d4a53c574ab3f WatchSource:0}: Error finding container 8df9796c070e185bc12d0bc595742bef9be0c3742652d5faab3d4a53c574ab3f: Status 404 returned error can't find the container with id 8df9796c070e185bc12d0bc595742bef9be0c3742652d5faab3d4a53c574ab3f Jun 03 16:43:40.270920 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.270883 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:43:40.271017 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.270968 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:43:40.271063 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:40.271031 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 16:43:41.049151 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:41.049113 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" event={"ID":"8f577509-f6f3-400a-abbf-c375844e0853","Type":"ContainerStarted","Data":"2816d7008661179d4d7b3e6de1ef8cd5c96722cbd19687003b1b831800868211"} Jun 03 16:43:41.049151 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:41.049152 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" event={"ID":"8f577509-f6f3-400a-abbf-c375844e0853","Type":"ContainerStarted","Data":"8df9796c070e185bc12d0bc595742bef9be0c3742652d5faab3d4a53c574ab3f"} Jun 03 16:43:41.066943 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:41.066885 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" podStartSLOduration=2.066865334 podStartE2EDuration="2.066865334s" podCreationTimestamp="2026-06-03 16:43:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:43:41.065230126 +0000 UTC m=+582.479126906" watchObservedRunningTime="2026-06-03 16:43:41.066865334 +0000 UTC m=+582.480762112" Jun 03 16:43:41.132849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:41.132812 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:41.137998 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:41.137946 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:42.052605 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:42.052572 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:42.053619 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:42.053596 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-7wv9r" Jun 03 16:43:44.710445 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.710412 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:43:44.713119 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.713093 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:44.715121 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.715097 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8lh8p\"" Jun 03 16:43:44.715266 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.715157 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 16:43:44.722444 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.722417 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:43:44.816642 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.816608 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:43:44.904450 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.904421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9868e1b4-1db6-4850-a9eb-741507bd8961-config-file\") pod \"limitador-limitador-7d549b5b-454bq\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:44.904618 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:44.904472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkwsx\" (UniqueName: \"kubernetes.io/projected/9868e1b4-1db6-4850-a9eb-741507bd8961-kube-api-access-wkwsx\") pod \"limitador-limitador-7d549b5b-454bq\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:45.005145 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.005056 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9868e1b4-1db6-4850-a9eb-741507bd8961-config-file\") pod \"limitador-limitador-7d549b5b-454bq\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:45.005145 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.005117 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkwsx\" (UniqueName: \"kubernetes.io/projected/9868e1b4-1db6-4850-a9eb-741507bd8961-kube-api-access-wkwsx\") pod \"limitador-limitador-7d549b5b-454bq\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:45.005757 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.005734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9868e1b4-1db6-4850-a9eb-741507bd8961-config-file\") pod \"limitador-limitador-7d549b5b-454bq\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:45.012584 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.012555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkwsx\" (UniqueName: \"kubernetes.io/projected/9868e1b4-1db6-4850-a9eb-741507bd8961-kube-api-access-wkwsx\") pod \"limitador-limitador-7d549b5b-454bq\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:45.024529 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.024504 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:45.160244 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.160218 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:43:45.163127 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:43:45.163099 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9868e1b4_1db6_4850_a9eb_741507bd8961.slice/crio-2af9c56eeaa76e4eb83961a69fcccdf7f44f45b7e74bb047f283e2da43fb2546 WatchSource:0}: Error finding container 2af9c56eeaa76e4eb83961a69fcccdf7f44f45b7e74bb047f283e2da43fb2546: Status 404 returned error can't find the container with id 2af9c56eeaa76e4eb83961a69fcccdf7f44f45b7e74bb047f283e2da43fb2546 Jun 03 16:43:45.508507 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.508462 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7rjbz"] Jun 03 16:43:45.511771 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.511752 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:45.513765 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.513744 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kk8gn\"" Jun 03 16:43:45.517916 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.517890 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7rjbz"] Jun 03 16:43:45.609599 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.609569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhmp\" (UniqueName: \"kubernetes.io/projected/cb0234c3-dc30-428b-8eaa-1191b0940993-kube-api-access-mmhmp\") pod \"authorino-f99f4b5cd-7rjbz\" (UID: \"cb0234c3-dc30-428b-8eaa-1191b0940993\") " pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:45.710427 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.710380 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhmp\" (UniqueName: \"kubernetes.io/projected/cb0234c3-dc30-428b-8eaa-1191b0940993-kube-api-access-mmhmp\") pod \"authorino-f99f4b5cd-7rjbz\" (UID: \"cb0234c3-dc30-428b-8eaa-1191b0940993\") " pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:45.717571 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.717543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhmp\" (UniqueName: \"kubernetes.io/projected/cb0234c3-dc30-428b-8eaa-1191b0940993-kube-api-access-mmhmp\") pod \"authorino-f99f4b5cd-7rjbz\" (UID: \"cb0234c3-dc30-428b-8eaa-1191b0940993\") " pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:45.838507 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.838478 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:45.981215 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:45.980939 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7rjbz"] Jun 03 16:43:45.984406 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:43:45.984365 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb0234c3_dc30_428b_8eaa_1191b0940993.slice/crio-8709f19091592d18946b61fa67e4b626d86f713fd41ccf77e79b1218692b5386 WatchSource:0}: Error finding container 8709f19091592d18946b61fa67e4b626d86f713fd41ccf77e79b1218692b5386: Status 404 returned error can't find the container with id 8709f19091592d18946b61fa67e4b626d86f713fd41ccf77e79b1218692b5386 Jun 03 16:43:46.070748 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:46.070704 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" event={"ID":"cb0234c3-dc30-428b-8eaa-1191b0940993","Type":"ContainerStarted","Data":"8709f19091592d18946b61fa67e4b626d86f713fd41ccf77e79b1218692b5386"} Jun 03 16:43:46.072887 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:46.072829 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" event={"ID":"9868e1b4-1db6-4850-a9eb-741507bd8961","Type":"ContainerStarted","Data":"2af9c56eeaa76e4eb83961a69fcccdf7f44f45b7e74bb047f283e2da43fb2546"} Jun 03 16:43:50.622596 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:50.622559 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7rjbz"] Jun 03 16:43:51.095538 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:51.095503 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" event={"ID":"cb0234c3-dc30-428b-8eaa-1191b0940993","Type":"ContainerStarted","Data":"028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168"} Jun 03 16:43:51.096873 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:51.096845 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" event={"ID":"9868e1b4-1db6-4850-a9eb-741507bd8961","Type":"ContainerStarted","Data":"c2e9f337d791a0bc217615d1af8dfe006508b4ba38ef3820bbb07a1f67ac648c"} Jun 03 16:43:51.097017 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:51.096943 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:43:51.109506 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:51.109445 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" podStartSLOduration=2.02449003 podStartE2EDuration="6.109430271s" podCreationTimestamp="2026-06-03 16:43:45 +0000 UTC" firstStartedPulling="2026-06-03 16:43:45.986262943 +0000 UTC m=+587.400159706" lastFinishedPulling="2026-06-03 16:43:50.071203189 +0000 UTC m=+591.485099947" observedRunningTime="2026-06-03 16:43:51.107682691 +0000 UTC m=+592.521579471" watchObservedRunningTime="2026-06-03 16:43:51.109430271 +0000 UTC m=+592.523327063" Jun 03 16:43:51.126928 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:51.126880 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" podStartSLOduration=2.222503231 podStartE2EDuration="7.126865672s" podCreationTimestamp="2026-06-03 16:43:44 +0000 UTC" firstStartedPulling="2026-06-03 16:43:45.164893905 +0000 UTC m=+586.578790666" lastFinishedPulling="2026-06-03 16:43:50.069256349 +0000 UTC m=+591.483153107" observedRunningTime="2026-06-03 16:43:51.125253205 +0000 UTC m=+592.539149986" watchObservedRunningTime="2026-06-03 16:43:51.126865672 +0000 UTC m=+592.540762451" Jun 03 16:43:52.100237 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:52.100197 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" podUID="cb0234c3-dc30-428b-8eaa-1191b0940993" containerName="authorino" containerID="cri-o://028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168" gracePeriod=30 Jun 03 16:43:52.353289 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:52.353224 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:52.370320 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:52.370291 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmhmp\" (UniqueName: \"kubernetes.io/projected/cb0234c3-dc30-428b-8eaa-1191b0940993-kube-api-access-mmhmp\") pod \"cb0234c3-dc30-428b-8eaa-1191b0940993\" (UID: \"cb0234c3-dc30-428b-8eaa-1191b0940993\") " Jun 03 16:43:52.372691 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:52.372656 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0234c3-dc30-428b-8eaa-1191b0940993-kube-api-access-mmhmp" (OuterVolumeSpecName: "kube-api-access-mmhmp") pod "cb0234c3-dc30-428b-8eaa-1191b0940993" (UID: "cb0234c3-dc30-428b-8eaa-1191b0940993"). InnerVolumeSpecName "kube-api-access-mmhmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:43:52.471045 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:52.470964 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmhmp\" (UniqueName: \"kubernetes.io/projected/cb0234c3-dc30-428b-8eaa-1191b0940993-kube-api-access-mmhmp\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:43:53.105061 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.105021 2574 generic.go:358] "Generic (PLEG): container finished" podID="cb0234c3-dc30-428b-8eaa-1191b0940993" containerID="028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168" exitCode=0 Jun 03 16:43:53.105451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.105077 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" Jun 03 16:43:53.105451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.105075 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" event={"ID":"cb0234c3-dc30-428b-8eaa-1191b0940993","Type":"ContainerDied","Data":"028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168"} Jun 03 16:43:53.105451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.105176 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7rjbz" event={"ID":"cb0234c3-dc30-428b-8eaa-1191b0940993","Type":"ContainerDied","Data":"8709f19091592d18946b61fa67e4b626d86f713fd41ccf77e79b1218692b5386"} Jun 03 16:43:53.105451 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.105198 2574 scope.go:117] "RemoveContainer" containerID="028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168" Jun 03 16:43:53.114437 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.114417 2574 scope.go:117] "RemoveContainer" containerID="028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168" Jun 03 16:43:53.114687 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:43:53.114669 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168\": container with ID starting with 028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168 not found: ID does not exist" containerID="028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168" Jun 03 16:43:53.114736 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.114695 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168"} err="failed to get container status \"028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168\": rpc error: code = NotFound desc = could not find container \"028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168\": container with ID starting with 028a471a809ec66bc6904a63e309529f43cb7a928d692d61cca3acf3cfdf1168 not found: ID does not exist" Jun 03 16:43:53.124600 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.124578 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7rjbz"] Jun 03 16:43:53.127096 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:53.127076 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7rjbz"] Jun 03 16:43:55.124040 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:55.124009 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0234c3-dc30-428b-8eaa-1191b0940993" path="/var/lib/kubelet/pods/cb0234c3-dc30-428b-8eaa-1191b0940993/volumes" Jun 03 16:43:59.038873 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:59.038844 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:43:59.038873 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:43:59.038876 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:44:01.621247 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:01.621207 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:44:01.621746 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:01.621522 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" podUID="9868e1b4-1db6-4850-a9eb-741507bd8961" containerName="limitador" containerID="cri-o://c2e9f337d791a0bc217615d1af8dfe006508b4ba38ef3820bbb07a1f67ac648c" gracePeriod=30 Jun 03 16:44:01.622257 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:01.622126 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:44:02.138070 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.138039 2574 generic.go:358] "Generic (PLEG): container finished" podID="9868e1b4-1db6-4850-a9eb-741507bd8961" containerID="c2e9f337d791a0bc217615d1af8dfe006508b4ba38ef3820bbb07a1f67ac648c" exitCode=0 Jun 03 16:44:02.138233 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.138112 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" event={"ID":"9868e1b4-1db6-4850-a9eb-741507bd8961","Type":"ContainerDied","Data":"c2e9f337d791a0bc217615d1af8dfe006508b4ba38ef3820bbb07a1f67ac648c"} Jun 03 16:44:02.181288 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.181214 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:44:02.266319 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.266281 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9868e1b4-1db6-4850-a9eb-741507bd8961-config-file\") pod \"9868e1b4-1db6-4850-a9eb-741507bd8961\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " Jun 03 16:44:02.266319 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.266333 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkwsx\" (UniqueName: \"kubernetes.io/projected/9868e1b4-1db6-4850-a9eb-741507bd8961-kube-api-access-wkwsx\") pod \"9868e1b4-1db6-4850-a9eb-741507bd8961\" (UID: \"9868e1b4-1db6-4850-a9eb-741507bd8961\") " Jun 03 16:44:02.266740 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.266709 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9868e1b4-1db6-4850-a9eb-741507bd8961-config-file" (OuterVolumeSpecName: "config-file") pod "9868e1b4-1db6-4850-a9eb-741507bd8961" (UID: "9868e1b4-1db6-4850-a9eb-741507bd8961"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:44:02.268508 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.268485 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9868e1b4-1db6-4850-a9eb-741507bd8961-kube-api-access-wkwsx" (OuterVolumeSpecName: "kube-api-access-wkwsx") pod "9868e1b4-1db6-4850-a9eb-741507bd8961" (UID: "9868e1b4-1db6-4850-a9eb-741507bd8961"). InnerVolumeSpecName "kube-api-access-wkwsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:44:02.367511 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.367476 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9868e1b4-1db6-4850-a9eb-741507bd8961-config-file\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:44:02.367511 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:02.367507 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkwsx\" (UniqueName: \"kubernetes.io/projected/9868e1b4-1db6-4850-a9eb-741507bd8961-kube-api-access-wkwsx\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:44:03.143303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:03.143269 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" event={"ID":"9868e1b4-1db6-4850-a9eb-741507bd8961","Type":"ContainerDied","Data":"2af9c56eeaa76e4eb83961a69fcccdf7f44f45b7e74bb047f283e2da43fb2546"} Jun 03 16:44:03.143702 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:03.143315 2574 scope.go:117] "RemoveContainer" containerID="c2e9f337d791a0bc217615d1af8dfe006508b4ba38ef3820bbb07a1f67ac648c" Jun 03 16:44:03.143702 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:03.143350 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-454bq" Jun 03 16:44:03.163299 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:03.163272 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:44:03.166912 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:03.166888 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-454bq"] Jun 03 16:44:05.123540 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.123509 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9868e1b4-1db6-4850-a9eb-741507bd8961" path="/var/lib/kubelet/pods/9868e1b4-1db6-4850-a9eb-741507bd8961/volumes" Jun 03 16:44:05.813400 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813371 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-w6drk"] Jun 03 16:44:05.813749 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813737 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0234c3-dc30-428b-8eaa-1191b0940993" containerName="authorino" Jun 03 16:44:05.813792 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813750 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0234c3-dc30-428b-8eaa-1191b0940993" containerName="authorino" Jun 03 16:44:05.813792 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813766 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9868e1b4-1db6-4850-a9eb-741507bd8961" containerName="limitador" Jun 03 16:44:05.813792 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813772 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9868e1b4-1db6-4850-a9eb-741507bd8961" containerName="limitador" Jun 03 16:44:05.813886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813823 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="9868e1b4-1db6-4850-a9eb-741507bd8961" containerName="limitador" Jun 03 16:44:05.813886 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.813833 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb0234c3-dc30-428b-8eaa-1191b0940993" containerName="authorino" Jun 03 16:44:05.818118 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.818093 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:05.820309 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.820283 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 16:44:05.824165 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.824142 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-w6drk"] Jun 03 16:44:05.898594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.898520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6nk\" (UniqueName: \"kubernetes.io/projected/c5d601a9-ca13-459c-b2e1-1ebbb252aabc-kube-api-access-vk6nk\") pod \"postgres-68c4fbbd6f-w6drk\" (UID: \"c5d601a9-ca13-459c-b2e1-1ebbb252aabc\") " pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:05.898594 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.898551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5d601a9-ca13-459c-b2e1-1ebbb252aabc-data\") pod \"postgres-68c4fbbd6f-w6drk\" (UID: \"c5d601a9-ca13-459c-b2e1-1ebbb252aabc\") " pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:05.999205 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.999166 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6nk\" (UniqueName: \"kubernetes.io/projected/c5d601a9-ca13-459c-b2e1-1ebbb252aabc-kube-api-access-vk6nk\") pod \"postgres-68c4fbbd6f-w6drk\" (UID: \"c5d601a9-ca13-459c-b2e1-1ebbb252aabc\") " pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:05.999205 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.999211 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5d601a9-ca13-459c-b2e1-1ebbb252aabc-data\") pod \"postgres-68c4fbbd6f-w6drk\" (UID: \"c5d601a9-ca13-459c-b2e1-1ebbb252aabc\") " pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:05.999640 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:05.999619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5d601a9-ca13-459c-b2e1-1ebbb252aabc-data\") pod \"postgres-68c4fbbd6f-w6drk\" (UID: \"c5d601a9-ca13-459c-b2e1-1ebbb252aabc\") " pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:06.006657 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:06.006630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6nk\" (UniqueName: \"kubernetes.io/projected/c5d601a9-ca13-459c-b2e1-1ebbb252aabc-kube-api-access-vk6nk\") pod \"postgres-68c4fbbd6f-w6drk\" (UID: \"c5d601a9-ca13-459c-b2e1-1ebbb252aabc\") " pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:06.130243 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:06.130206 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:06.258146 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:06.258116 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-w6drk"] Jun 03 16:44:06.260767 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:44:06.260741 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d601a9_ca13_459c_b2e1_1ebbb252aabc.slice/crio-b5b10599a7c28c64ffb439be9bf4cd68da7170e32dcb1b205512c9f0af7bb626 WatchSource:0}: Error finding container b5b10599a7c28c64ffb439be9bf4cd68da7170e32dcb1b205512c9f0af7bb626: Status 404 returned error can't find the container with id b5b10599a7c28c64ffb439be9bf4cd68da7170e32dcb1b205512c9f0af7bb626 Jun 03 16:44:07.158863 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:07.158828 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-w6drk" event={"ID":"c5d601a9-ca13-459c-b2e1-1ebbb252aabc","Type":"ContainerStarted","Data":"b5b10599a7c28c64ffb439be9bf4cd68da7170e32dcb1b205512c9f0af7bb626"} Jun 03 16:44:09.166010 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:09.165947 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-w6drk" event={"ID":"c5d601a9-ca13-459c-b2e1-1ebbb252aabc","Type":"ContainerStarted","Data":"7a759fe8d8ccec231bcc5220d881fe0a1b569f3a40a3485bc9446067db733363"} Jun 03 16:44:09.166488 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:09.166124 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:09.179532 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:09.179480 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-w6drk" podStartSLOduration=1.894420665 podStartE2EDuration="4.179464837s" podCreationTimestamp="2026-06-03 16:44:05 +0000 UTC" firstStartedPulling="2026-06-03 16:44:06.262509476 +0000 UTC m=+607.676406235" lastFinishedPulling="2026-06-03 16:44:08.547553639 +0000 UTC m=+609.961450407" observedRunningTime="2026-06-03 16:44:09.17911076 +0000 UTC m=+610.593007539" watchObservedRunningTime="2026-06-03 16:44:09.179464837 +0000 UTC m=+610.593361619" Jun 03 16:44:15.199025 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:15.198991 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-w6drk" Jun 03 16:44:23.923389 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:23.923355 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-27hrl"] Jun 03 16:44:23.929457 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:23.929422 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" Jun 03 16:44:23.931857 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:23.931827 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-mmmw2\"" Jun 03 16:44:23.932027 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:23.931923 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 16:44:23.932379 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:23.932362 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 16:44:23.936126 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:23.936102 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-27hrl"] Jun 03 16:44:24.070265 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:24.070221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7kkr\" (UniqueName: \"kubernetes.io/projected/d55d27e7-1a73-45d2-a40d-5aa1286be96a-kube-api-access-r7kkr\") pod \"keycloak-operator-7864d68cbd-27hrl\" (UID: \"d55d27e7-1a73-45d2-a40d-5aa1286be96a\") " pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" Jun 03 16:44:24.170999 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:24.170935 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7kkr\" (UniqueName: \"kubernetes.io/projected/d55d27e7-1a73-45d2-a40d-5aa1286be96a-kube-api-access-r7kkr\") pod \"keycloak-operator-7864d68cbd-27hrl\" (UID: \"d55d27e7-1a73-45d2-a40d-5aa1286be96a\") " pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" Jun 03 16:44:24.178655 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:24.178603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7kkr\" (UniqueName: \"kubernetes.io/projected/d55d27e7-1a73-45d2-a40d-5aa1286be96a-kube-api-access-r7kkr\") pod \"keycloak-operator-7864d68cbd-27hrl\" (UID: \"d55d27e7-1a73-45d2-a40d-5aa1286be96a\") " pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" Jun 03 16:44:24.241077 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:24.241036 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" Jun 03 16:44:24.377929 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:24.377903 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-27hrl"] Jun 03 16:44:24.380165 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:44:24.380129 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55d27e7_1a73_45d2_a40d_5aa1286be96a.slice/crio-a5e2150975fc73339d25fa8c9927da515e188d0280a07986e056a072c85f8c27 WatchSource:0}: Error finding container a5e2150975fc73339d25fa8c9927da515e188d0280a07986e056a072c85f8c27: Status 404 returned error can't find the container with id a5e2150975fc73339d25fa8c9927da515e188d0280a07986e056a072c85f8c27 Jun 03 16:44:25.223234 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:25.223191 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" event={"ID":"d55d27e7-1a73-45d2-a40d-5aa1286be96a","Type":"ContainerStarted","Data":"a5e2150975fc73339d25fa8c9927da515e188d0280a07986e056a072c85f8c27"} Jun 03 16:44:31.249136 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:31.249040 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" event={"ID":"d55d27e7-1a73-45d2-a40d-5aa1286be96a","Type":"ContainerStarted","Data":"0da55ce1be8c68aaa5e1851deb35b410dff661be1f9a88b80ef7bec4c11a5ba5"} Jun 03 16:44:31.263470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:44:31.263417 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-27hrl" podStartSLOduration=1.777386922 podStartE2EDuration="8.263402906s" podCreationTimestamp="2026-06-03 16:44:23 +0000 UTC" firstStartedPulling="2026-06-03 16:44:24.381594816 +0000 UTC m=+625.795491574" lastFinishedPulling="2026-06-03 16:44:30.867610788 +0000 UTC m=+632.281507558" observedRunningTime="2026-06-03 16:44:31.262284329 +0000 UTC m=+632.676181109" watchObservedRunningTime="2026-06-03 16:44:31.263402906 +0000 UTC m=+632.677299685" Jun 03 16:45:10.803298 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.803257 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84566d779b-rh6tt"] Jun 03 16:45:10.806060 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.806036 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:10.808554 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.808528 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kk8gn\"" Jun 03 16:45:10.808677 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.808529 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 16:45:10.812042 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.812022 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84566d779b-rh6tt"] Jun 03 16:45:10.915303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.915267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-tls-cert\") pod \"authorino-84566d779b-rh6tt\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:10.915303 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:10.915306 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhrbw\" (UniqueName: \"kubernetes.io/projected/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-kube-api-access-qhrbw\") pod \"authorino-84566d779b-rh6tt\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:11.016111 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.016077 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-tls-cert\") pod \"authorino-84566d779b-rh6tt\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:11.016111 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.016113 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhrbw\" (UniqueName: \"kubernetes.io/projected/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-kube-api-access-qhrbw\") pod \"authorino-84566d779b-rh6tt\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:11.018660 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.018635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-tls-cert\") pod \"authorino-84566d779b-rh6tt\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:11.022694 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.022673 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhrbw\" (UniqueName: \"kubernetes.io/projected/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-kube-api-access-qhrbw\") pod \"authorino-84566d779b-rh6tt\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:11.136633 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.136578 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:45:11.266826 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.266798 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84566d779b-rh6tt"] Jun 03 16:45:11.269708 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:45:11.269677 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2eba75a6_b1ba_4fcc_b6b4_e9678c8ebaff.slice/crio-a20fe8cb1aa0724b98ef5dc43d36fc8b0b89dc1ac0b357f6803288ec7943d04b WatchSource:0}: Error finding container a20fe8cb1aa0724b98ef5dc43d36fc8b0b89dc1ac0b357f6803288ec7943d04b: Status 404 returned error can't find the container with id a20fe8cb1aa0724b98ef5dc43d36fc8b0b89dc1ac0b357f6803288ec7943d04b Jun 03 16:45:11.401095 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:11.400996 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84566d779b-rh6tt" event={"ID":"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff","Type":"ContainerStarted","Data":"a20fe8cb1aa0724b98ef5dc43d36fc8b0b89dc1ac0b357f6803288ec7943d04b"} Jun 03 16:45:12.406015 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:12.405959 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84566d779b-rh6tt" event={"ID":"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff","Type":"ContainerStarted","Data":"381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77"} Jun 03 16:45:12.420931 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:45:12.420876 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-84566d779b-rh6tt" podStartSLOduration=2.07937017 podStartE2EDuration="2.420861817s" podCreationTimestamp="2026-06-03 16:45:10 +0000 UTC" firstStartedPulling="2026-06-03 16:45:11.271006273 +0000 UTC m=+672.684903031" lastFinishedPulling="2026-06-03 16:45:11.61249792 +0000 UTC m=+673.026394678" observedRunningTime="2026-06-03 16:45:12.418823198 +0000 UTC m=+673.832719977" watchObservedRunningTime="2026-06-03 16:45:12.420861817 +0000 UTC m=+673.834758597" Jun 03 16:46:38.334753 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.334718 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84566d779b-rh6tt"] Jun 03 16:46:38.335204 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.334941 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-84566d779b-rh6tt" podUID="2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" containerName="authorino" containerID="cri-o://381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77" gracePeriod=30 Jun 03 16:46:38.592299 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.592236 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:46:38.718950 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.718908 2574 generic.go:358] "Generic (PLEG): container finished" podID="2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" containerID="381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77" exitCode=0 Jun 03 16:46:38.719139 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.718961 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84566d779b-rh6tt" Jun 03 16:46:38.719139 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.719009 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84566d779b-rh6tt" event={"ID":"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff","Type":"ContainerDied","Data":"381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77"} Jun 03 16:46:38.719139 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.719050 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84566d779b-rh6tt" event={"ID":"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff","Type":"ContainerDied","Data":"a20fe8cb1aa0724b98ef5dc43d36fc8b0b89dc1ac0b357f6803288ec7943d04b"} Jun 03 16:46:38.719139 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.719065 2574 scope.go:117] "RemoveContainer" containerID="381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77" Jun 03 16:46:38.728845 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.728827 2574 scope.go:117] "RemoveContainer" containerID="381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77" Jun 03 16:46:38.729159 ip-10-0-142-172 kubenswrapper[2574]: E0603 16:46:38.729140 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77\": container with ID starting with 381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77 not found: ID does not exist" containerID="381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77" Jun 03 16:46:38.729226 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.729170 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77"} err="failed to get container status \"381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77\": rpc error: code = NotFound desc = could not find container \"381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77\": container with ID starting with 381e9f151634338e7f38221b2b2bc0f3cc706ade5b48c32d7e777eb999340e77 not found: ID does not exist" Jun 03 16:46:38.736541 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.736517 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhrbw\" (UniqueName: \"kubernetes.io/projected/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-kube-api-access-qhrbw\") pod \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " Jun 03 16:46:38.736665 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.736608 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-tls-cert\") pod \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\" (UID: \"2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff\") " Jun 03 16:46:38.738768 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.738741 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-kube-api-access-qhrbw" (OuterVolumeSpecName: "kube-api-access-qhrbw") pod "2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" (UID: "2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff"). InnerVolumeSpecName "kube-api-access-qhrbw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:46:38.747483 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.747459 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" (UID: "2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:46:38.837963 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.837928 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-tls-cert\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:46:38.838139 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:38.837987 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhrbw\" (UniqueName: \"kubernetes.io/projected/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff-kube-api-access-qhrbw\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\"" Jun 03 16:46:39.036914 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:39.036886 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84566d779b-rh6tt"] Jun 03 16:46:39.039526 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:39.039500 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84566d779b-rh6tt"] Jun 03 16:46:39.124849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:39.124813 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" path="/var/lib/kubelet/pods/2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff/volumes" Jun 03 16:46:49.796661 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.796624 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5"] Jun 03 16:46:49.797173 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.797050 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" containerName="authorino" Jun 03 16:46:49.797173 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.797063 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" containerName="authorino" Jun 03 16:46:49.797173 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.797131 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="2eba75a6-b1ba-4fcc-b6b4-e9678c8ebaff" containerName="authorino" Jun 03 16:46:49.805531 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.805494 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:49.808623 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.808597 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 16:46:49.808804 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.808632 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-djdp4\"" Jun 03 16:46:49.808940 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.808813 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 16:46:49.808940 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.808631 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 16:46:49.809083 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.809010 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5"] Jun 03 16:46:49.945709 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.945650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:49.945928 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.945771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:49.945928 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.945857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n4pj\" (UniqueName: \"kubernetes.io/projected/c432824f-6ac3-4c7e-95ef-ec4224083541-kube-api-access-4n4pj\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:49.945928 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.945886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:49.946132 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.945932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c432824f-6ac3-4c7e-95ef-ec4224083541-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:49.946132 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:49.945988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.046728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.046617 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n4pj\" (UniqueName: \"kubernetes.io/projected/c432824f-6ac3-4c7e-95ef-ec4224083541-kube-api-access-4n4pj\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.046728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.046670 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.046728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.046700 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c432824f-6ac3-4c7e-95ef-ec4224083541-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.046728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.046723 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.046728 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.046744 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.047142 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.046801 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.047203 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.047178 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.047268 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.047195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.047268 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.047245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.049130 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.049112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c432824f-6ac3-4c7e-95ef-ec4224083541-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.049268 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.049250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c432824f-6ac3-4c7e-95ef-ec4224083541-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.053229 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.053203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n4pj\" (UniqueName: \"kubernetes.io/projected/c432824f-6ac3-4c7e-95ef-ec4224083541-kube-api-access-4n4pj\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5\" (UID: \"c432824f-6ac3-4c7e-95ef-ec4224083541\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.118000 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.117937 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:46:50.249392 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.249366 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5"] Jun 03 16:46:50.252244 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:46:50.252202 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc432824f_6ac3_4c7e_95ef_ec4224083541.slice/crio-88c844252942165d76a5672fbc3acdcb9d5912aab87dee697900434cbdd242ad WatchSource:0}: Error finding container 88c844252942165d76a5672fbc3acdcb9d5912aab87dee697900434cbdd242ad: Status 404 returned error can't find the container with id 88c844252942165d76a5672fbc3acdcb9d5912aab87dee697900434cbdd242ad Jun 03 16:46:50.253893 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.253878 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:46:50.765962 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:50.765923 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" event={"ID":"c432824f-6ac3-4c7e-95ef-ec4224083541","Type":"ContainerStarted","Data":"88c844252942165d76a5672fbc3acdcb9d5912aab87dee697900434cbdd242ad"} Jun 03 16:46:54.782684 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:46:54.782650 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" event={"ID":"c432824f-6ac3-4c7e-95ef-ec4224083541","Type":"ContainerStarted","Data":"66f33662d586fb48ffd0505752995eec9764db8045a6bc577a895815ad547984"} Jun 03 16:47:06.395483 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.395393 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2"] Jun 03 16:47:06.400515 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.400493 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.402494 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.402471 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 16:47:06.410882 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.410863 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2"] Jun 03 16:47:06.497714 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.497678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.497884 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.497724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.497884 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.497818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.497968 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.497903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde905d4-a56d-44b8-9745-98efcb9f48d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.497968 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.497920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r85mp\" (UniqueName: \"kubernetes.io/projected/bde905d4-a56d-44b8-9745-98efcb9f48d8-kube-api-access-r85mp\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.497968 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.497940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599350 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599310 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde905d4-a56d-44b8-9745-98efcb9f48d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599350 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599350 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r85mp\" (UniqueName: \"kubernetes.io/projected/bde905d4-a56d-44b8-9745-98efcb9f48d8-kube-api-access-r85mp\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599616 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599373 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599616 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599525 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599616 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599607 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599774 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599673 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599827 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.599945 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.599920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.600018 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.600002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.601767 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.601746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde905d4-a56d-44b8-9745-98efcb9f48d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.601928 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.601909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde905d4-a56d-44b8-9745-98efcb9f48d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.607120 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.607097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r85mp\" (UniqueName: \"kubernetes.io/projected/bde905d4-a56d-44b8-9745-98efcb9f48d8-kube-api-access-r85mp\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2\" (UID: \"bde905d4-a56d-44b8-9745-98efcb9f48d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.713501 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.713413 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:06.851265 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:06.851196 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2"] Jun 03 16:47:06.854093 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:47:06.854056 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde905d4_a56d_44b8_9745_98efcb9f48d8.slice/crio-3b5e777ecc166c67bb9123a9b4507c9712b5678d9adbc62505274f9500ccc8a7 WatchSource:0}: Error finding container 3b5e777ecc166c67bb9123a9b4507c9712b5678d9adbc62505274f9500ccc8a7: Status 404 returned error can't find the container with id 3b5e777ecc166c67bb9123a9b4507c9712b5678d9adbc62505274f9500ccc8a7 Jun 03 16:47:07.832951 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:07.832912 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" event={"ID":"bde905d4-a56d-44b8-9745-98efcb9f48d8","Type":"ContainerStarted","Data":"758b4aef6e83665e50c596b896f1ae6b167b91d884bdf225857c12f75e8ffb5c"} Jun 03 16:47:07.833350 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:07.832956 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" event={"ID":"bde905d4-a56d-44b8-9745-98efcb9f48d8","Type":"ContainerStarted","Data":"3b5e777ecc166c67bb9123a9b4507c9712b5678d9adbc62505274f9500ccc8a7"} Jun 03 16:47:11.848083 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:11.848049 2574 generic.go:358] "Generic (PLEG): container finished" podID="bde905d4-a56d-44b8-9745-98efcb9f48d8" containerID="758b4aef6e83665e50c596b896f1ae6b167b91d884bdf225857c12f75e8ffb5c" exitCode=0 Jun 03 16:47:11.848473 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:11.848108 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" event={"ID":"bde905d4-a56d-44b8-9745-98efcb9f48d8","Type":"ContainerDied","Data":"758b4aef6e83665e50c596b896f1ae6b167b91d884bdf225857c12f75e8ffb5c"} Jun 03 16:47:13.857053 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:13.857008 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" event={"ID":"bde905d4-a56d-44b8-9745-98efcb9f48d8","Type":"ContainerStarted","Data":"0d55354330571acb397132c39a096f6fcccdd78c62e9773954d43e7c1169d17d"} Jun 03 16:47:13.872645 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:13.872576 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" podStartSLOduration=6.52986679 podStartE2EDuration="7.872561388s" podCreationTimestamp="2026-06-03 16:47:06 +0000 UTC" firstStartedPulling="2026-06-03 16:47:11.848729739 +0000 UTC m=+793.262626497" lastFinishedPulling="2026-06-03 16:47:13.191424333 +0000 UTC m=+794.605321095" observedRunningTime="2026-06-03 16:47:13.872094767 +0000 UTC m=+795.285991820" watchObservedRunningTime="2026-06-03 16:47:13.872561388 +0000 UTC m=+795.286458170" Jun 03 16:47:16.714055 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:16.714012 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:16.714511 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:16.714082 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:16.726581 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:16.726552 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:16.878328 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:16.878291 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2" Jun 03 16:47:17.702798 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.702764 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c"] Jun 03 16:47:17.709828 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.709800 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.712038 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.712013 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 16:47:17.715780 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.715751 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c"] Jun 03 16:47:17.807246 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.807208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwlqg\" (UniqueName: \"kubernetes.io/projected/99499049-22d9-485c-bb26-53418791916b-kube-api-access-pwlqg\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.807246 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.807264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99499049-22d9-485c-bb26-53418791916b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.807470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.807342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.807470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.807397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.807470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.807444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.807470 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.807467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.908774 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.908737 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwlqg\" (UniqueName: \"kubernetes.io/projected/99499049-22d9-485c-bb26-53418791916b-kube-api-access-pwlqg\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.908957 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.908803 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99499049-22d9-485c-bb26-53418791916b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.908957 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.908853 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.908957 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.908935 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.909206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.909049 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.909206 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.909082 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.909434 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.909406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.909536 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.909465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.909536 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.909527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.911882 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.911851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/99499049-22d9-485c-bb26-53418791916b-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.912215 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.912196 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99499049-22d9-485c-bb26-53418791916b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:17.916233 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:17.916209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwlqg\" (UniqueName: \"kubernetes.io/projected/99499049-22d9-485c-bb26-53418791916b-kube-api-access-pwlqg\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c\" (UID: \"99499049-22d9-485c-bb26-53418791916b\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:18.021101 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:18.021001 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:18.151859 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:18.151821 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c"] Jun 03 16:47:18.153851 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:47:18.153819 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99499049_22d9_485c_bb26_53418791916b.slice/crio-c0d83b4ecb9a421018ff34c6208f2f617605632b41f52f9f83e7aa41dc15ab2e WatchSource:0}: Error finding container c0d83b4ecb9a421018ff34c6208f2f617605632b41f52f9f83e7aa41dc15ab2e: Status 404 returned error can't find the container with id c0d83b4ecb9a421018ff34c6208f2f617605632b41f52f9f83e7aa41dc15ab2e Jun 03 16:47:18.875541 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:18.875502 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" event={"ID":"99499049-22d9-485c-bb26-53418791916b","Type":"ContainerStarted","Data":"8a09934ff9caa00fd8883e4bf648ca5d21a4706825858936abe6d75125d99d4a"} Jun 03 16:47:18.875541 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:18.875544 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" event={"ID":"99499049-22d9-485c-bb26-53418791916b","Type":"ContainerStarted","Data":"c0d83b4ecb9a421018ff34c6208f2f617605632b41f52f9f83e7aa41dc15ab2e"} Jun 03 16:47:24.897735 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:24.897646 2574 generic.go:358] "Generic (PLEG): container finished" podID="99499049-22d9-485c-bb26-53418791916b" containerID="8a09934ff9caa00fd8883e4bf648ca5d21a4706825858936abe6d75125d99d4a" exitCode=0 Jun 03 16:47:24.897735 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:24.897721 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" event={"ID":"99499049-22d9-485c-bb26-53418791916b","Type":"ContainerDied","Data":"8a09934ff9caa00fd8883e4bf648ca5d21a4706825858936abe6d75125d99d4a"} Jun 03 16:47:25.902909 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:25.902874 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" event={"ID":"99499049-22d9-485c-bb26-53418791916b","Type":"ContainerStarted","Data":"cc3b3c3ebee8ca8722a11f8418bfd1c13d7e7ce632daf8348f1718bc8c88dc93"} Jun 03 16:47:25.920849 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:25.920796 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" podStartSLOduration=8.642790135 podStartE2EDuration="8.920782868s" podCreationTimestamp="2026-06-03 16:47:17 +0000 UTC" firstStartedPulling="2026-06-03 16:47:24.89835067 +0000 UTC m=+806.312247428" lastFinishedPulling="2026-06-03 16:47:25.176343393 +0000 UTC m=+806.590240161" observedRunningTime="2026-06-03 16:47:25.917638374 +0000 UTC m=+807.331535166" watchObservedRunningTime="2026-06-03 16:47:25.920782868 +0000 UTC m=+807.334679648" Jun 03 16:47:28.021863 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:28.021823 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:28.021863 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:28.021864 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:28.034530 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:28.034504 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:28.925730 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:28.925693 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c" Jun 03 16:47:55.015363 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:55.015329 2574 generic.go:358] "Generic (PLEG): container finished" podID="c432824f-6ac3-4c7e-95ef-ec4224083541" containerID="66f33662d586fb48ffd0505752995eec9764db8045a6bc577a895815ad547984" exitCode=0 Jun 03 16:47:55.015846 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:55.015408 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" event={"ID":"c432824f-6ac3-4c7e-95ef-ec4224083541","Type":"ContainerDied","Data":"66f33662d586fb48ffd0505752995eec9764db8045a6bc577a895815ad547984"} Jun 03 16:47:56.022842 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:56.022802 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" event={"ID":"c432824f-6ac3-4c7e-95ef-ec4224083541","Type":"ContainerStarted","Data":"d4412817349ba91a26378ea889f4ba899a38fa2aa640a5d2d89f5b45b09af86a"} Jun 03 16:47:56.040931 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:47:56.040875 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" podStartSLOduration=1.9517768210000002 podStartE2EDuration="1m7.040857879s" podCreationTimestamp="2026-06-03 16:46:49 +0000 UTC" firstStartedPulling="2026-06-03 16:46:50.254084147 +0000 UTC m=+771.667980904" lastFinishedPulling="2026-06-03 16:47:55.3431652 +0000 UTC m=+836.757061962" observedRunningTime="2026-06-03 16:47:56.038849977 +0000 UTC m=+837.452746758" watchObservedRunningTime="2026-06-03 16:47:56.040857879 +0000 UTC m=+837.454754659" Jun 03 16:48:00.118133 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:48:00.118096 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:48:00.118647 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:48:00.118150 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:48:00.130646 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:48:00.130613 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:48:01.052503 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:48:01.052473 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5" Jun 03 16:48:59.065693 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:48:59.065664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:48:59.067502 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:48:59.067479 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:53:59.097760 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:53:59.097726 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:53:59.101126 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:53:59.101105 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:54:08.154321 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:08.154291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-99f686c75-tzq7z_68e9a10a-ef41-400f-89b4-855ad01f5262/nginx/0.log" Jun 03 16:54:09.203734 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:09.203708 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-m9b88_2bb671e1-4df3-4adb-9b02-85b39e0a3ec4/copy-manifests/0.log" Jun 03 16:54:09.210719 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:09.210695 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-m9b88_2bb671e1-4df3-4adb-9b02-85b39e0a3ec4/manager/0.log" Jun 03 16:54:09.448208 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:09.448180 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-w6drk_c5d601a9-ca13-459c-b2e1-1ebbb252aabc/postgres/0.log" Jun 03 16:54:10.810391 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:10.810347 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-tlg7j_9c40b292-c654-4db9-887f-a8d7c1695dd1/manager/0.log" Jun 03 16:54:10.925471 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:10.925446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-zh2mv_d0a61e4d-139b-4466-8fb9-25f31f9ff86d/manager/0.log" Jun 03 16:54:11.151634 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:11.151597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-brhvv_f5ef69f6-abb1-4622-a852-27f2682fbe63/registry-server/0.log" Jun 03 16:54:11.837722 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:11.837689 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8d4qjm_252fda0f-d5b0-461d-a06f-6696fabfaa6a/istio-proxy/0.log" Jun 03 16:54:12.285220 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:12.285143 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-7wv9r_8f577509-f6f3-400a-abbf-c375844e0853/istio-proxy/0.log" Jun 03 16:54:12.529462 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:12.529432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5668b7b467-5ct5h_044bd7e8-853d-4544-a307-c4bb808c623e/router/0.log" Jun 03 16:54:12.981189 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:12.981159 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5_c432824f-6ac3-4c7e-95ef-ec4224083541/storage-initializer/0.log" Jun 03 16:54:12.987784 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:12.987764 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-9n5d5_c432824f-6ac3-4c7e-95ef-ec4224083541/main/0.log" Jun 03 16:54:13.100989 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:13.100939 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2_bde905d4-a56d-44b8-9745-98efcb9f48d8/main/0.log" Jun 03 16:54:13.107583 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:13.107561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-h25g2_bde905d4-a56d-44b8-9745-98efcb9f48d8/storage-initializer/0.log" Jun 03 16:54:13.336823 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:13.336798 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c_99499049-22d9-485c-bb26-53418791916b/storage-initializer/0.log" Jun 03 16:54:13.343463 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:13.343442 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-zbb2c_99499049-22d9-485c-bb26-53418791916b/main/0.log" Jun 03 16:54:20.319645 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:20.319614 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-89s6m_d4a1f17b-5738-47c6-9444-0426c3d19373/global-pull-secret-syncer/0.log" Jun 03 16:54:20.490554 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:20.490525 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xxm7n_4d977b2b-7e3a-43c6-af9c-274aec484078/konnectivity-agent/0.log" Jun 03 16:54:20.555693 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:20.555664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-172.ec2.internal_883d87ae28b7b478c04eee3bfb0d0b62/haproxy/0.log" Jun 03 16:54:24.755964 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:24.755932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-tlg7j_9c40b292-c654-4db9-887f-a8d7c1695dd1/manager/0.log" Jun 03 16:54:24.794401 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:24.794365 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-zh2mv_d0a61e4d-139b-4466-8fb9-25f31f9ff86d/manager/0.log" Jun 03 16:54:24.852150 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:24.852116 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-brhvv_f5ef69f6-abb1-4622-a852-27f2682fbe63/registry-server/0.log" Jun 03 16:54:26.493189 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.493161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d8575dfbd-4xcr9_9954750c-8d2b-4b06-b280-b57273272c7b/metrics-server/0.log" Jun 03 16:54:26.518226 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.518201 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-8x5dm_cd78483d-ff98-4a19-9889-c7266dff7fe1/monitoring-plugin/0.log" Jun 03 16:54:26.756025 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.755994 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4rg7_d6d5b8ad-ac0d-425f-8d7b-63985fae5481/node-exporter/0.log" Jun 03 16:54:26.782097 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.782057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4rg7_d6d5b8ad-ac0d-425f-8d7b-63985fae5481/kube-rbac-proxy/0.log" Jun 03 16:54:26.809058 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.809036 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p4rg7_d6d5b8ad-ac0d-425f-8d7b-63985fae5481/init-textfile/0.log" Jun 03 16:54:26.932296 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.932219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/prometheus/0.log" Jun 03 16:54:26.952276 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.952246 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/config-reloader/0.log" Jun 03 16:54:26.973612 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.973580 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/thanos-sidecar/0.log" Jun 03 16:54:26.993852 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:26.993826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/kube-rbac-proxy-web/0.log" Jun 03 16:54:27.015998 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.015949 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/kube-rbac-proxy/0.log" Jun 03 16:54:27.037191 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.037137 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/kube-rbac-proxy-thanos/0.log" Jun 03 16:54:27.059425 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.059403 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95fd6a51-423a-4833-8e73-2946ad598645/init-config-reloader/0.log" Jun 03 16:54:27.241031 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.240910 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f46f4984-vfcwx_04da2bcc-ac46-4918-a82c-e5e5926574c5/thanos-query/0.log" Jun 03 16:54:27.269217 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.269181 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f46f4984-vfcwx_04da2bcc-ac46-4918-a82c-e5e5926574c5/kube-rbac-proxy-web/0.log" Jun 03 16:54:27.290882 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.290856 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f46f4984-vfcwx_04da2bcc-ac46-4918-a82c-e5e5926574c5/kube-rbac-proxy/0.log" Jun 03 16:54:27.313373 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.313341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f46f4984-vfcwx_04da2bcc-ac46-4918-a82c-e5e5926574c5/prom-label-proxy/0.log" Jun 03 16:54:27.334528 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.334505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f46f4984-vfcwx_04da2bcc-ac46-4918-a82c-e5e5926574c5/kube-rbac-proxy-rules/0.log" Jun 03 16:54:27.357522 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:27.357497 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f46f4984-vfcwx_04da2bcc-ac46-4918-a82c-e5e5926574c5/kube-rbac-proxy-metrics/0.log" Jun 03 16:54:29.544733 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.544705 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bddcb9b6f-7hbm7_22858c2b-fd6e-4db9-8ff2-aedbc3da20d3/console/0.log" Jun 03 16:54:29.969607 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.969569 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth"] Jun 03 16:54:29.973374 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.973350 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:29.975282 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.975260 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47xq\"/\"openshift-service-ca.crt\"" Jun 03 16:54:29.975824 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.975803 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s47xq\"/\"default-dockercfg-dsvp8\"" Jun 03 16:54:29.975942 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.975807 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s47xq\"/\"kube-root-ca.crt\"" Jun 03 16:54:29.980041 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:29.980018 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth"] Jun 03 16:54:30.110763 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.110733 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-f79q6_a30bb381-b051-45eb-9bd8-141d33b9c951/volume-data-source-validator/0.log" Jun 03 16:54:30.127280 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.127249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-sys\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.127477 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.127368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-lib-modules\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.127552 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.127493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmczq\" (UniqueName: \"kubernetes.io/projected/18e6ee9e-795c-491e-8e20-e86073f93693-kube-api-access-bmczq\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.127552 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.127532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-proc\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.127634 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.127560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-podres\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228413 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-lib-modules\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228505 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228493 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmczq\" (UniqueName: \"kubernetes.io/projected/18e6ee9e-795c-491e-8e20-e86073f93693-kube-api-access-bmczq\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228732 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228515 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-proc\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228732 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228536 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-podres\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228732 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-proc\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228732 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228677 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-sys\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.228732 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228698 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-lib-modules\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.229035 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-sys\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.229035 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.228802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/18e6ee9e-795c-491e-8e20-e86073f93693-podres\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.236275 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.236250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmczq\" (UniqueName: \"kubernetes.io/projected/18e6ee9e-795c-491e-8e20-e86073f93693-kube-api-access-bmczq\") pod \"perf-node-gather-daemonset-7vqth\" (UID: \"18e6ee9e-795c-491e-8e20-e86073f93693\") " pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.284172 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.284136 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:30.417069 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.417029 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth"] Jun 03 16:54:30.418556 ip-10-0-142-172 kubenswrapper[2574]: W0603 16:54:30.418532 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod18e6ee9e_795c_491e_8e20_e86073f93693.slice/crio-c815efd72898d5ab4360fa89cc6596118c72cd03e2bff11938c6cc85b5974d7d WatchSource:0}: Error finding container c815efd72898d5ab4360fa89cc6596118c72cd03e2bff11938c6cc85b5974d7d: Status 404 returned error can't find the container with id c815efd72898d5ab4360fa89cc6596118c72cd03e2bff11938c6cc85b5974d7d Jun 03 16:54:30.423029 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.423008 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:54:30.480432 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.480342 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" event={"ID":"18e6ee9e-795c-491e-8e20-e86073f93693","Type":"ContainerStarted","Data":"c815efd72898d5ab4360fa89cc6596118c72cd03e2bff11938c6cc85b5974d7d"} Jun 03 16:54:30.978755 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:30.978732 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svwtw_e2a436fb-5a27-4fe4-8b87-56ade6e6370d/dns/0.log" Jun 03 16:54:31.004209 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.004185 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-svwtw_e2a436fb-5a27-4fe4-8b87-56ade6e6370d/kube-rbac-proxy/0.log" Jun 03 16:54:31.181811 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.181778 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9g6p_f379d1d0-19d7-4e30-89e9-21b07792bfb4/dns-node-resolver/0.log" Jun 03 16:54:31.484823 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.484789 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" event={"ID":"18e6ee9e-795c-491e-8e20-e86073f93693","Type":"ContainerStarted","Data":"6ce1286aeb831cbb03de409e5155926f3fd0b6de3f9e27f8561ddb4b86a50098"} Jun 03 16:54:31.485022 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.484876 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:31.502525 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.502470 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" podStartSLOduration=2.502456687 podStartE2EDuration="2.502456687s" podCreationTimestamp="2026-06-03 16:54:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:54:31.499883693 +0000 UTC m=+1232.913780476" watchObservedRunningTime="2026-06-03 16:54:31.502456687 +0000 UTC m=+1232.916353468" Jun 03 16:54:31.634309 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.634259 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-649b99cb7c-srjdh_32552565-d592-4d25-86ae-7b43a1bcd396/registry/0.log" Jun 03 16:54:31.639057 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.639034 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-649b99cb7c-srjdh_32552565-d592-4d25-86ae-7b43a1bcd396/registry/1.log" Jun 03 16:54:31.706832 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:31.706808 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qszst_8d0d9875-93c9-4a87-9791-e172b02c7f1e/node-ca/0.log" Jun 03 16:54:32.542613 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:32.542578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8d4qjm_252fda0f-d5b0-461d-a06f-6696fabfaa6a/istio-proxy/0.log" Jun 03 16:54:32.682354 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:32.682322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-7wv9r_8f577509-f6f3-400a-abbf-c375844e0853/istio-proxy/0.log" Jun 03 16:54:32.730917 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:32.730889 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5668b7b467-5ct5h_044bd7e8-853d-4544-a307-c4bb808c623e/router/0.log" Jun 03 16:54:33.276993 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:33.276935 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vltxp_fa0e4863-81e9-43e3-8ede-1d29dd0e9d5a/serve-healthcheck-canary/0.log" Jun 03 16:54:33.708676 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:33.708650 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-ng9qq_252be81c-7dd7-4b62-92a8-143e49405472/insights-operator/1.log" Jun 03 16:54:33.713163 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:33.713139 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-ng9qq_252be81c-7dd7-4b62-92a8-143e49405472/insights-operator/0.log" Jun 03 16:54:33.732751 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:33.732730 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xm9n_fd413b4d-cd40-409c-9d29-253bd496efe1/kube-rbac-proxy/0.log" Jun 03 16:54:33.754752 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:33.754727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xm9n_fd413b4d-cd40-409c-9d29-253bd496efe1/exporter/0.log" Jun 03 16:54:33.776460 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:33.776433 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5xm9n_fd413b4d-cd40-409c-9d29-253bd496efe1/extractor/0.log" Jun 03 16:54:35.798985 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:35.798940 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-99f686c75-tzq7z_68e9a10a-ef41-400f-89b4-855ad01f5262/nginx/0.log" Jun 03 16:54:36.068274 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:36.068157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-m9b88_2bb671e1-4df3-4adb-9b02-85b39e0a3ec4/manager/0.log" Jun 03 16:54:36.088705 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:36.088680 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f84758474-m9b88_2bb671e1-4df3-4adb-9b02-85b39e0a3ec4/copy-manifests/0.log" Jun 03 16:54:36.207795 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:36.207765 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-w6drk_c5d601a9-ca13-459c-b2e1-1ebbb252aabc/postgres/0.log" Jun 03 16:54:37.474961 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:37.474929 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69bc585896-cddfk_4dc0cb38-da63-4262-9f30-415fe0529f35/manager/0.log" Jun 03 16:54:37.501008 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:37.500957 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s47xq/perf-node-gather-daemonset-7vqth" Jun 03 16:54:42.591248 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:42.591212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-wzprq_f8e6aaad-859e-443a-8df6-b0c16c961906/kube-storage-version-migrator-operator/1.log" Jun 03 16:54:42.592218 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:42.592190 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-wzprq_f8e6aaad-859e-443a-8df6-b0c16c961906/kube-storage-version-migrator-operator/0.log" Jun 03 16:54:43.635993 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.635943 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/kube-multus-additional-cni-plugins/0.log" Jun 03 16:54:43.657477 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.657450 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/egress-router-binary-copy/0.log" Jun 03 16:54:43.679443 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.679415 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/cni-plugins/0.log" Jun 03 16:54:43.699395 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.699371 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/bond-cni-plugin/0.log" Jun 03 16:54:43.721425 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.721401 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/routeoverride-cni/0.log" Jun 03 16:54:43.743491 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.743464 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/whereabouts-cni-bincopy/0.log" Jun 03 16:54:43.763413 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:43.763387 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pkjn6_89d339aa-77a6-413f-b89b-343e74a2749d/whereabouts-cni/0.log" Jun 03 16:54:44.181442 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:44.181414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z48gx_9c0957c6-eb4a-4e40-b914-6f1ae7a4a99d/kube-multus/0.log" Jun 03 16:54:44.243767 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:44.243743 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6xqz7_a2c6e2c1-2fef-45f5-bdb9-386cb17371e5/network-metrics-daemon/0.log" Jun 03 16:54:44.262349 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:44.262326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6xqz7_a2c6e2c1-2fef-45f5-bdb9-386cb17371e5/kube-rbac-proxy/0.log" Jun 03 16:54:45.374240 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.374208 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-controller/0.log" Jun 03 16:54:45.391707 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.391676 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/0.log" Jun 03 16:54:45.397021 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.397000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovn-acl-logging/1.log" Jun 03 16:54:45.413356 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.413334 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/kube-rbac-proxy-node/0.log" Jun 03 16:54:45.434050 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.434024 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 16:54:45.452954 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.452918 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/northd/0.log" Jun 03 16:54:45.473609 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.473584 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/nbdb/0.log" Jun 03 16:54:45.493760 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.493736 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/sbdb/0.log" Jun 03 16:54:45.592519 ip-10-0-142-172 kubenswrapper[2574]: I0603 16:54:45.592492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9mbgc_94a3326e-2edb-4bc4-a8e4-2513d562535a/ovnkube-controller/0.log"