Jun 08 12:51:33.348562 ip-10-0-133-240 systemd[1]: Starting Kubernetes Kubelet... Jun 08 12:51:33.699110 ip-10-0-133-240 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:51:33.699110 ip-10-0-133-240 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 12:51:33.699110 ip-10-0-133-240 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:51:33.699110 ip-10-0-133-240 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 12:51:33.699110 ip-10-0-133-240 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:51:33.699841 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.699125 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 12:51:33.707427 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707403 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:33.707427 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707422 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:33.707427 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707427 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:33.707427 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707431 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:33.707427 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707434 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:33.707427 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707437 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707440 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707443 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707446 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707449 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707451 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707454 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707457 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707460 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707462 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707465 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707468 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707470 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707473 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707475 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707478 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707481 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707484 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707487 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707489 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:33.707658 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707492 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707494 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707497 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707500 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707502 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707505 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707509 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707512 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707514 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707518 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707520 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707523 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707525 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707528 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707530 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707533 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707535 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707538 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707540 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707543 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:33.708128 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707545 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707547 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707551 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707555 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707559 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707563 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707565 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707568 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707571 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707573 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707576 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707578 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707581 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707583 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707586 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707588 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707591 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707595 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707597 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:33.708685 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707600 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707603 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707605 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707608 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707611 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707613 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707616 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707620 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707623 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707626 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707629 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707632 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707635 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707638 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707640 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707643 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707645 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707648 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707651 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:33.709147 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707654 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707657 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707661 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707664 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707667 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707670 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707673 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707676 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707679 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707682 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707684 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707687 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707690 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707693 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707695 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.707698 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708453 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708473 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708479 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:33.709727 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708483 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708486 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708489 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708494 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708498 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708500 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708503 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708506 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708510 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708513 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708516 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708519 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708522 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708525 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708528 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708531 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708534 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708537 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708539 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:33.710184 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708542 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708544 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708547 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708550 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708553 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708556 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708558 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708561 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708564 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708566 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708569 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708571 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708574 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708576 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708579 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708581 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708583 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708586 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708588 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708591 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:33.710663 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708593 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708596 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708598 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708601 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708603 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708606 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708608 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708611 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708614 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708617 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708620 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708622 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708625 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708628 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708630 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708633 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708635 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708639 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708642 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708644 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:33.711186 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708647 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708649 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708652 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708654 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708657 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708659 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708662 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708665 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708668 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708671 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708673 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708676 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708679 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708681 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708684 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708687 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708689 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708692 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708694 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708697 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:33.711704 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708701 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708704 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708707 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708709 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708712 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708714 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708716 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708719 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708721 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708724 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708727 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708729 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708732 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708734 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708737 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708739 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.708742 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709123 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709129 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709133 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:33.712190 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709135 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709138 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709141 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709144 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709147 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709150 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709153 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709156 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709158 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709161 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709164 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709167 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709169 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709172 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709175 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709177 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709180 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709182 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709185 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709187 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:33.712707 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709191 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709195 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709198 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709201 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709204 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709207 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709209 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709211 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709215 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709217 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709220 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709223 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709225 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709228 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709230 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709233 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709252 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709256 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709260 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709265 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:33.713193 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709267 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709270 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709273 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709275 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709278 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709281 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709284 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709287 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709289 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709292 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709294 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709297 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709300 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709303 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709305 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709308 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709310 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709315 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709317 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709320 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:33.713705 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709322 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709325 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709327 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709330 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709332 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709335 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709337 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709340 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709343 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709345 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709348 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709350 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709353 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709355 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709358 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709360 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709363 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709365 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709367 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709371 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:33.714250 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709373 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709376 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709378 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709382 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709386 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709389 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709392 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709394 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709397 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709400 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709403 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709405 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709408 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709411 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709414 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.709417 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709484 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709491 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709498 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709505 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 12:51:33.714750 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709510 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709513 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709517 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709521 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709524 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709527 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709530 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709534 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709537 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709540 2578 flags.go:64] FLAG: --cgroup-root="" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709543 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709546 2578 flags.go:64] FLAG: --client-ca-file="" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709549 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709552 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709556 2578 flags.go:64] FLAG: --cluster-domain="" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709559 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709562 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709565 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709568 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709572 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709575 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709578 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709581 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709585 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 08 12:51:33.715247 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709587 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709590 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709593 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709596 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709600 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709604 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709607 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709612 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709615 2578 flags.go:64] FLAG: --enable-server="true" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709618 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709623 2578 flags.go:64] FLAG: --event-burst="100" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709626 2578 flags.go:64] FLAG: --event-qps="50" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709628 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709631 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709634 2578 flags.go:64] FLAG: --eviction-hard="" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709638 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709641 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709644 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709647 2578 flags.go:64] FLAG: --eviction-soft="" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709650 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709653 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709656 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709659 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709662 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709665 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 12:51:33.715823 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709667 2578 flags.go:64] FLAG: --feature-gates="" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709674 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709677 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709680 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709683 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709686 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709689 2578 flags.go:64] FLAG: --help="false" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709692 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709696 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709698 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709701 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709705 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709708 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709711 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709715 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709718 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709721 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709724 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709727 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709730 2578 flags.go:64] FLAG: --kube-reserved="" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709733 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709735 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709739 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709742 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 12:51:33.716573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709745 2578 flags.go:64] FLAG: --lock-file="" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709748 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709750 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709753 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709759 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709762 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709765 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709780 2578 flags.go:64] FLAG: --logging-format="text" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709784 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709787 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709790 2578 flags.go:64] FLAG: --manifest-url="" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709794 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709799 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709802 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709807 2578 flags.go:64] FLAG: --max-pods="110" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709809 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709812 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709815 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709818 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709821 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709824 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709827 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709835 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709839 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709842 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 12:51:33.717616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709845 2578 flags.go:64] FLAG: --pod-cidr="" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709848 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709853 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709856 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709859 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709862 2578 flags.go:64] FLAG: --port="10250" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709865 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709868 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-036ecb74ebdb3a2ee" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709872 2578 flags.go:64] FLAG: --qos-reserved="" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709875 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709878 2578 flags.go:64] FLAG: --register-node="true" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709881 2578 flags.go:64] FLAG: --register-with-taints="" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709884 2578 flags.go:64] FLAG: --registry-burst="10" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709888 2578 flags.go:64] FLAG: --registry-qps="5" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709891 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709894 2578 flags.go:64] FLAG: --reserved-memory="" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709897 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709900 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709903 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709906 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709909 2578 flags.go:64] FLAG: --runonce="false" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709912 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709915 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709917 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709920 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 12:51:33.718754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709923 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709926 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709929 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709932 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709935 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709940 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709943 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709946 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709949 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709952 2578 flags.go:64] FLAG: --system-cgroups="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709955 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709960 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709963 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709966 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709970 2578 flags.go:64] FLAG: --tls-min-version="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709973 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709976 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709979 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709981 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709984 2578 flags.go:64] FLAG: --v="2" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709988 2578 flags.go:64] FLAG: --version="false" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709993 2578 flags.go:64] FLAG: --vmodule="" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.709996 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.710000 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710128 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:33.719868 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710132 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710135 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710138 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710141 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710144 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710147 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710150 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710153 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710156 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710159 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710161 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710164 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710170 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710173 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710175 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710178 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710180 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710183 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710186 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710189 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:33.720746 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710191 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710194 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710197 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710199 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710202 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710204 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710207 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710209 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710213 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710217 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710220 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710223 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710225 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710228 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710230 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710233 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710248 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710251 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710254 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710256 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:33.721608 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710259 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710261 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710264 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710267 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710275 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710278 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710280 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710283 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710286 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710288 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710291 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710293 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710296 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710299 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710301 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710304 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710306 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710309 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710311 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710314 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:33.722389 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710316 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710319 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710322 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710325 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710328 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710330 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710333 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710335 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710338 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710341 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710343 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710346 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710348 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710351 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710353 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710356 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710361 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710364 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710368 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:33.722995 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710371 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710375 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710378 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710381 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710383 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710386 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710388 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710391 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710394 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710396 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710399 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710401 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710404 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710406 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710409 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710411 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710415 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710418 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:33.723515 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.710420 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.711141 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.718636 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.718655 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.718674 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.718687 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718768 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718775 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718782 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718788 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718793 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718798 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718803 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718809 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:33.723963 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718813 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718818 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718823 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718827 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718832 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718837 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718841 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718847 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718851 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718855 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718859 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718864 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718868 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718872 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718876 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718881 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718886 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718890 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718894 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718899 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:33.724377 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718903 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718909 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718913 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718918 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718923 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718927 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718931 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718936 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718940 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718944 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718949 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718953 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718957 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718961 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718965 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718970 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718973 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718978 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718983 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:33.724912 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718988 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718992 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.718996 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719000 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719004 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719008 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719012 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719017 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719021 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719025 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719029 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719033 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719037 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719041 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719046 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719051 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719056 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719060 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719064 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719068 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:33.725424 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719072 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719076 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719081 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719085 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719089 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719093 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719097 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719101 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719105 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719110 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719114 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719119 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719123 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719127 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719131 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719135 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719139 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719144 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719148 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719152 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:33.725926 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719156 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719160 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719165 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719169 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719173 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719177 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719184 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719189 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719195 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719201 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719206 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719211 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.719219 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719444 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:51:33.726778 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719454 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719459 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719464 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719468 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719473 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719478 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719482 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719486 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719491 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719495 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719499 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719504 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719508 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719513 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719517 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719521 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719525 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719530 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719534 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719538 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:51:33.727370 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719542 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719547 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719551 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719555 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719559 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719564 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719568 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719573 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719577 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719581 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719586 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719591 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719595 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719599 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719603 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719607 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719612 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719616 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719620 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:51:33.728192 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719624 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719628 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719633 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719637 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719641 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719646 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719649 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719653 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719658 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719662 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719667 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719673 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719679 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719683 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719688 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719692 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719696 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719700 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719704 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719709 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:51:33.728863 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719713 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719718 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719723 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719727 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719731 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719735 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719739 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719743 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719748 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719752 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719756 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719762 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719768 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719773 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719778 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719782 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719787 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719791 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719796 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719800 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:51:33.729386 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719805 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719811 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719817 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719821 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719826 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719830 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719835 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719840 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719845 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719849 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719853 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719858 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719863 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719867 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719872 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719875 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719880 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719884 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:51:33.729869 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:33.719888 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.719895 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.720035 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.722688 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.724164 2578 server.go:1019] "Starting client certificate rotation" Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.724272 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.724310 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.726686 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:51:33.730347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.728434 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:51:33.737482 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.737463 2578 log.go:25] "Validated CRI v1 runtime API" Jun 08 12:51:33.740315 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.740297 2578 log.go:25] "Validated CRI v1 image API" Jun 08 12:51:33.742910 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.742892 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 12:51:33.745041 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.745023 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8cfd6138-4edc-410f-a56d-abd2fd25d370:/dev/nvme0n1p3 c64a2b82-4d41-4fa0-9423-dc7966376b10:/dev/nvme0n1p4] Jun 08 12:51:33.745101 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.745041 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 12:51:33.748638 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.748619 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:51:33.750042 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.749935 2578 manager.go:216] Machine: {Timestamp:2026-06-08 12:51:33.748671503 +0000 UTC m=+0.294070612 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098656 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2788299cda803b8907f2889a4842d0 SystemUUID:ec278829-9cda-803b-8907-f2889a4842d0 BootID:d008bb13-cb31-4de1-a0c8-eb3fdbde2182 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:68:f2:e3:2d:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:68:f2:e3:2d:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:87:2c:68:2b:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 12:51:33.750042 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.750038 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 12:51:33.750155 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.750142 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 12:51:33.752910 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.752887 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 12:51:33.753040 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.752913 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 12:51:33.753486 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.753476 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 12:51:33.753516 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.753489 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 12:51:33.753516 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.753502 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:51:33.754165 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.754156 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:51:33.754907 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.754897 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 12:51:33.757532 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757521 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:51:33.757640 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757630 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 12:51:33.757677 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757659 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 08 12:51:33.757677 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757669 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 12:51:33.757766 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757679 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 12:51:33.757766 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757688 2578 kubelet.go:398] "Adding apiserver pod source" Jun 08 12:51:33.757766 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.757696 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 12:51:33.758040 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.758028 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:51:33.758078 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.758053 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:51:33.759899 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.759884 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 12:51:33.761273 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.761258 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 12:51:33.761357 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.761298 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 12:51:33.762253 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762219 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 12:51:33.762253 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762257 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762268 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762277 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762290 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762298 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762309 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762317 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762327 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762340 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762362 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 12:51:33.762394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.762371 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 12:51:33.763129 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.763118 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 12:51:33.763166 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.763130 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 12:51:33.766356 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.766343 2578 server.go:1268] "Started kubelet" Jun 08 12:51:33.766456 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.766419 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 12:51:33.766561 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.766445 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 12:51:33.766662 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.766587 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 12:51:33.767335 ip-10-0-133-240 systemd[1]: Started Kubernetes Kubelet. Jun 08 12:51:33.767924 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.767901 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 12:51:33.767983 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.767916 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 12:51:33.768450 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.767922 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 12:51:33.768548 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.768535 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 08 12:51:33.768619 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.768533 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 12:51:33.772955 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.772934 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c56n8" Jun 08 12:51:33.774091 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.774075 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 12:51:33.775677 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.775657 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 12:51:33.775759 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.775660 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 12:51:33.775759 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.775743 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:33.775961 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.774955 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-240.ec2.internal.18b71c1e383b2240 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-240.ec2.internal,UID:ip-10-0-133-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-240.ec2.internal,},FirstTimestamp:2026-06-08 12:51:33.766316608 +0000 UTC m=+0.311715718,LastTimestamp:2026-06-08 12:51:33.766316608 +0000 UTC m=+0.311715718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-240.ec2.internal,}" Jun 08 12:51:33.776302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776285 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 12:51:33.776404 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776287 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 12:51:33.776488 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776456 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 12:51:33.776488 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776472 2578 factory.go:55] Registering systemd factory Jun 08 12:51:33.776588 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776575 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 08 12:51:33.776588 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776588 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 08 12:51:33.776679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776582 2578 factory.go:223] Registration of the systemd container factory successfully Jun 08 12:51:33.776806 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776794 2578 factory.go:153] Registering CRI-O factory Jun 08 12:51:33.776844 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776809 2578 factory.go:223] Registration of the crio container factory successfully Jun 08 12:51:33.776917 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776860 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 12:51:33.776917 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776877 2578 factory.go:103] Registering Raw factory Jun 08 12:51:33.776917 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.776890 2578 manager.go:1196] Started watching for new ooms in manager Jun 08 12:51:33.777348 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.777333 2578 manager.go:349] Starting recovery of all containers Jun 08 12:51:33.777766 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.777742 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 12:51:33.779829 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.779739 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 12:51:33.781387 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.781365 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c56n8" Jun 08 12:51:33.787695 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.787678 2578 manager.go:354] Recovery completed Jun 08 12:51:33.793343 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.793329 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.795604 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.795531 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.795604 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.795567 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.795604 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.795585 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.796168 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796155 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 12:51:33.796168 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796167 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 12:51:33.796293 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796182 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:51:33.796293 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796211 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.796904 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796891 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.796978 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.796978 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.796934 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.797297 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.797285 2578 policy_none.go:49] "None policy: Start" Jun 08 12:51:33.797349 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.797301 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 12:51:33.797349 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.797310 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 12:51:33.798074 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.798064 2578 policy_none.go:47] "Start" Jun 08 12:51:33.835875 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.835850 2578 manager.go:337] "Starting Device Plugin manager" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.835960 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.835980 2578 server.go:87] "Starting device plugin registration server" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.836338 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.836352 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.836431 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.836533 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.836543 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.837185 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 12:51:33.846117 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.837254 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:33.846867 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.846832 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 12:51:33.848042 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.848023 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 12:51:33.848133 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.848070 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 12:51:33.848133 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.848093 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 12:51:33.848226 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.848181 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 12:51:33.850337 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.850322 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:33.937414 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.937374 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.938374 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.938356 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.938435 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.938396 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.938435 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.938410 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.938435 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.938432 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.947309 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.947294 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.947352 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.947317 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-240.ec2.internal\": node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:33.949309 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.949267 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal"] Jun 08 12:51:33.949352 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.949325 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.950663 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.950649 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.950728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.950676 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.950728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.950686 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.951944 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.951931 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.952089 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.952128 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952105 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.952609 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952581 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.952609 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952610 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.952774 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952624 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.952774 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952624 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.952774 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952645 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.952774 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.952654 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.953754 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.953739 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.953826 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.953762 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:51:33.954455 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.954438 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:51:33.954540 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.954465 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:51:33.954540 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.954479 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:51:33.978132 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.978102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b85e035f6f85e14d320e79db36a1dca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal\" (UID: \"9b85e035f6f85e14d320e79db36a1dca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.978250 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.978138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99efa69a4b5a002c8f285a7ebacbc192-config\") pod \"kube-apiserver-proxy-ip-10-0-133-240.ec2.internal\" (UID: \"99efa69a4b5a002c8f285a7ebacbc192\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.978250 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:33.978162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b85e035f6f85e14d320e79db36a1dca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal\" (UID: \"9b85e035f6f85e14d320e79db36a1dca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:33.993821 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.993799 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:33.994068 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:33.994052 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-240.ec2.internal\" not found" node="ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.000480 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.000454 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-240.ec2.internal\" not found" node="ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.078496 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.078461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99efa69a4b5a002c8f285a7ebacbc192-config\") pod \"kube-apiserver-proxy-ip-10-0-133-240.ec2.internal\" (UID: \"99efa69a4b5a002c8f285a7ebacbc192\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.078496 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.078499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b85e035f6f85e14d320e79db36a1dca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal\" (UID: \"9b85e035f6f85e14d320e79db36a1dca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.078721 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.078520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b85e035f6f85e14d320e79db36a1dca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal\" (UID: \"9b85e035f6f85e14d320e79db36a1dca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.078721 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.078569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b85e035f6f85e14d320e79db36a1dca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal\" (UID: \"9b85e035f6f85e14d320e79db36a1dca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.078721 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.078569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/99efa69a4b5a002c8f285a7ebacbc192-config\") pod \"kube-apiserver-proxy-ip-10-0-133-240.ec2.internal\" (UID: \"99efa69a4b5a002c8f285a7ebacbc192\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.078721 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.078600 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b85e035f6f85e14d320e79db36a1dca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal\" (UID: \"9b85e035f6f85e14d320e79db36a1dca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.094275 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.094230 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.194667 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.194630 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.295553 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.295481 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.298629 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.298614 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.305087 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.305065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.396255 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.396208 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.496694 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.496658 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.597278 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.597194 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.697743 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.697710 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.724021 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.723873 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 12:51:34.724646 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.724148 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:51:34.784379 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.784344 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:46:33 +0000 UTC" deadline="2028-03-09 11:56:47.687408154 +0000 UTC" Jun 08 12:51:34.784379 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.784370 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15359h5m12.903042069s" Jun 08 12:51:34.798484 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.798458 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.843866 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.843842 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:34.898685 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:34.898657 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-240.ec2.internal\" not found" Jun 08 12:51:34.899046 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:34.899018 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b85e035f6f85e14d320e79db36a1dca.slice/crio-d276437cafef42e3a9ec4d273be0ee3b742982f369be038aa2bfc98f848ad909 WatchSource:0}: Error finding container d276437cafef42e3a9ec4d273be0ee3b742982f369be038aa2bfc98f848ad909: Status 404 returned error can't find the container with id d276437cafef42e3a9ec4d273be0ee3b742982f369be038aa2bfc98f848ad909 Jun 08 12:51:34.899430 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:34.899416 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99efa69a4b5a002c8f285a7ebacbc192.slice/crio-0260f18ffe81d461f53abc53943403e0d783c916bb376032cac5e42b7f7bc0a4 WatchSource:0}: Error finding container 0260f18ffe81d461f53abc53943403e0d783c916bb376032cac5e42b7f7bc0a4: Status 404 returned error can't find the container with id 0260f18ffe81d461f53abc53943403e0d783c916bb376032cac5e42b7f7bc0a4 Jun 08 12:51:34.904251 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.904228 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:51:34.974728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.974700 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:34.976249 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.976220 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.987850 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.987830 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:51:34.988982 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.988968 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" Jun 08 12:51:34.997864 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:34.997844 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:51:35.316943 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.316868 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:35.758920 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.758838 2578 apiserver.go:52] "Watching apiserver" Jun 08 12:51:35.766602 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.766568 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 12:51:35.769927 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.769898 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-vnskj","openshift-multus/network-metrics-daemon-pbzb2","openshift-network-diagnostics/network-check-target-xjcvp","openshift-network-operator/iptables-alerter-w7x7g","kube-system/global-pull-secret-syncer-kv2l6","kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal","openshift-multus/multus-additional-cni-plugins-l2h5w","openshift-ovn-kubernetes/ovnkube-node-2p2nz","kube-system/konnectivity-agent-jwwcp","openshift-cluster-node-tuning-operator/tuned-rgll5","openshift-dns/node-resolver-47sk9","openshift-image-registry/node-ca-bz8sf"] Jun 08 12:51:35.772588 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.772564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.774690 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.774668 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:35.774778 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.774747 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:35.775141 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.775080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.775231 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.775172 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.775320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.775307 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 12:51:35.775387 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.775365 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 12:51:35.775439 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.775393 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95s4v\"" Jun 08 12:51:35.777086 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.776668 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 12:51:35.777086 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.777001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:35.777086 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.777058 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:35.778910 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.778888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.781753 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.781023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 12:51:35.781753 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.781291 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.781753 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.781533 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.781753 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.781558 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvn69\"" Jun 08 12:51:35.781965 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.781835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.781965 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.781887 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:35.783374 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.783353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.785121 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.785098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 12:51:35.785367 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.785347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tcwk5\"" Jun 08 12:51:35.785469 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.785405 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.785569 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.785553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.785930 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.785854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.785930 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.785873 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:51:35.788508 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.788490 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.789343 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-host-slash\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.789428 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-cnibin\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789428 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-cni-bin\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789541 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-kubelet\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789541 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-hostroot\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789664 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjkn\" (UniqueName: \"kubernetes.io/projected/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-kube-api-access-pbjkn\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.789664 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-cni-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789664 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-os-release\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789664 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-k8s-cni-cncf-io\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-daemon-config\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-system-cni-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-socket-dir-parent\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-netns\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-cni-multus\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-multus-certs\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-etc-kubernetes\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:35.789993 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.789966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-iptables-alerter-script\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.790394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-cni-binary-copy\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.790394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-conf-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.790394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjdt\" (UniqueName: \"kubernetes.io/projected/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-kube-api-access-ppjdt\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.790394 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rltc2\" (UniqueName: \"kubernetes.io/projected/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-kube-api-access-rltc2\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:35.791122 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790841 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 12:51:35.791122 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.791122 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.790980 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 12:51:35.791122 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.791005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 12:51:35.791122 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.791072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-984v8\"" Jun 08 12:51:35.791874 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.791845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 12:51:35.792216 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.792191 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.792542 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.792526 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gp9vg\"" Jun 08 12:51:35.793417 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.793398 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 12:51:35.793819 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.793656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cnkg5\"" Jun 08 12:51:35.793819 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.793707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.794526 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.794509 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 12:51:35.795143 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.795117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.795511 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.795492 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 12:51:35.796060 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.796042 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 12:51:35.797635 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.797619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.799704 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.799684 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-88m2t\"" Jun 08 12:51:35.800266 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.800156 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.800266 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.800183 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.800697 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.800675 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.800848 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.800829 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.801080 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.801066 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lfmlk\"" Jun 08 12:51:35.801913 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.801892 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.804065 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.804038 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 12:51:35.804189 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.804062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 12:51:35.804189 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.804071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7gn2q\"" Jun 08 12:51:35.804450 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.804435 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 12:51:35.853100 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.853049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" event={"ID":"99efa69a4b5a002c8f285a7ebacbc192","Type":"ContainerStarted","Data":"0260f18ffe81d461f53abc53943403e0d783c916bb376032cac5e42b7f7bc0a4"} Jun 08 12:51:35.854209 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.854175 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" event={"ID":"9b85e035f6f85e14d320e79db36a1dca","Type":"ContainerStarted","Data":"d276437cafef42e3a9ec4d273be0ee3b742982f369be038aa2bfc98f848ad909"} Jun 08 12:51:35.878005 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.877978 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 12:51:35.890418 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-iptables-alerter-script\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.890531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjdt\" (UniqueName: \"kubernetes.io/projected/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-kube-api-access-ppjdt\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.890531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-cni-bin\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890680 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-kubelet\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890680 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-hostroot\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890680 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-kubelet\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890680 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890607 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-cni-bin\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890680 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-hostroot\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890680 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-system-cni-dir\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vntsx\" (UniqueName: \"kubernetes.io/projected/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-kube-api-access-vntsx\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysctl-conf\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovn-node-metrics-cert\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmvql\" (UniqueName: \"kubernetes.io/projected/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-kube-api-access-fmvql\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-run-netns\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-etc-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-socket-dir-parent\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.890961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-etc-kubernetes\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.890975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rltc2\" (UniqueName: \"kubernetes.io/projected/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-kube-api-access-rltc2\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-etc-kubernetes\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-socket-dir-parent\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-iptables-alerter-script\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.891117 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-slash\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.891282 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:51:36.391198265 +0000 UTC m=+2.936597379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cni-binary-copy\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-conf-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891358 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-ovn\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovnkube-config\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-conf-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl77h\" (UniqueName: \"kubernetes.io/projected/e70cceef-bb33-4d3e-9837-f1de06b43cac-kube-api-access-hl77h\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcc94624-b453-49e5-b9e8-092c996db370-konnectivity-ca\") pod \"konnectivity-agent-jwwcp\" (UID: \"dcc94624-b453-49e5-b9e8-092c996db370\") " pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysctl-d\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef4518f-fc2a-4a5f-b3c5-736317789b10-tmp\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhrp\" (UniqueName: \"kubernetes.io/projected/dc0d5d50-26c7-4151-90e2-828d147c2077-kube-api-access-9nhrp\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-host-slash\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-cnibin\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-systemd\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-lib-modules\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891641 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjkn\" (UniqueName: \"kubernetes.io/projected/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-kube-api-access-pbjkn\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-cnibin\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-system-cni-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-host-slash\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.891845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-netns\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-cni-bin\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-system-cni-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-env-overrides\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovnkube-script-lib\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-netns\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcc94624-b453-49e5-b9e8-092c996db370-agent-certs\") pod \"konnectivity-agent-jwwcp\" (UID: \"dcc94624-b453-49e5-b9e8-092c996db370\") " pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-cni-binary-copy\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-systemd-units\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.891982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-os-release\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-modprobe-d\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-kubernetes\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-var-lib-kubelet\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-host\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-cni-netd\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.892571 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-kubelet-config\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cnibin\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysconfig\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-os-release\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-k8s-cni-cncf-io\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-log-socket\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892346 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-run\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-tuned\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-k8s-cni-cncf-io\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-serviceca\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-os-release\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-multus-certs\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892423 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-cni-binary-copy\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-node-log\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-run-multus-certs\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-run-ovn-kubernetes\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-host\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0d5d50-26c7-4151-90e2-828d147c2077-tmp-dir\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-systemd\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-var-lib-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk4qs\" (UniqueName: \"kubernetes.io/projected/8ef4518f-fc2a-4a5f-b3c5-736317789b10-kube-api-access-wk4qs\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-cni-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-daemon-config\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-cni-dir\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-device-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-sys\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc0d5d50-26c7-4151-90e2-828d147c2077-hosts-file\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzqvn\" (UniqueName: \"kubernetes.io/projected/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-kube-api-access-zzqvn\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.892979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-cni-multus\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.893837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.893005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-kubelet\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.894302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.893025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.894302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.893070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-dbus\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.894302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.893067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-host-var-lib-cni-multus\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.894302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.893111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.894302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.893337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-multus-daemon-config\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.908944 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.908920 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:35.908944 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.908942 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:35.909065 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.908955 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:35.909065 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.909001 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:36.408989133 +0000 UTC m=+2.954388236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:35.911219 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.911190 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 12:51:35.914599 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.914581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rltc2\" (UniqueName: \"kubernetes.io/projected/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-kube-api-access-rltc2\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:35.914698 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.914602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjdt\" (UniqueName: \"kubernetes.io/projected/1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1-kube-api-access-ppjdt\") pod \"multus-vnskj\" (UID: \"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1\") " pod="openshift-multus/multus-vnskj" Jun 08 12:51:35.914698 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.914615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjkn\" (UniqueName: \"kubernetes.io/projected/e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2-kube-api-access-pbjkn\") pod \"iptables-alerter-w7x7g\" (UID: \"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2\") " pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:35.919591 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.919568 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ntjd7" Jun 08 12:51:35.931984 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.931961 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ntjd7" Jun 08 12:51:35.993440 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-node-log\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.993440 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-run-ovn-kubernetes\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-host\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-node-log\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-run-ovn-kubernetes\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0d5d50-26c7-4151-90e2-828d147c2077-tmp-dir\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-host\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-systemd\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.993659 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-systemd\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0d5d50-26c7-4151-90e2-828d147c2077-tmp-dir\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-var-lib-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4qs\" (UniqueName: \"kubernetes.io/projected/8ef4518f-fc2a-4a5f-b3c5-736317789b10-kube-api-access-wk4qs\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-device-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-var-lib-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-sys\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-device-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.993974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc0d5d50-26c7-4151-90e2-828d147c2077-hosts-file\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.994016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-sys\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzqvn\" (UniqueName: \"kubernetes.io/projected/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-kube-api-access-zzqvn\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994062 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc0d5d50-26c7-4151-90e2-828d147c2077-hosts-file\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-kubelet\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-kubelet\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994027 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-dbus\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994202 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-dbus\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-system-cni-dir\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-system-cni-dir\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vntsx\" (UniqueName: \"kubernetes.io/projected/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-kube-api-access-vntsx\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.994580 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysctl-conf\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovn-node-metrics-cert\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmvql\" (UniqueName: \"kubernetes.io/projected/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-kube-api-access-fmvql\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994459 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-run-netns\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-etc-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994514 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysctl-conf\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-etc-openvswitch\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-run-netns\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-slash\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cni-binary-copy\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-ovn\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovnkube-config\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-slash\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.995364 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl77h\" (UniqueName: \"kubernetes.io/projected/e70cceef-bb33-4d3e-9837-f1de06b43cac-kube-api-access-hl77h\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994754 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-ovn\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcc94624-b453-49e5-b9e8-092c996db370-konnectivity-ca\") pod \"konnectivity-agent-jwwcp\" (UID: \"dcc94624-b453-49e5-b9e8-092c996db370\") " pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysctl-d\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef4518f-fc2a-4a5f-b3c5-736317789b10-tmp\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhrp\" (UniqueName: \"kubernetes.io/projected/dc0d5d50-26c7-4151-90e2-828d147c2077-kube-api-access-9nhrp\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-systemd\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-lib-modules\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994938 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysctl-d\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.994967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-cni-bin\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-cni-bin\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-env-overrides\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-run-systemd\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovnkube-script-lib\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.996252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcc94624-b453-49e5-b9e8-092c996db370-agent-certs\") pod \"konnectivity-agent-jwwcp\" (UID: \"dcc94624-b453-49e5-b9e8-092c996db370\") " pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-systemd-units\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-os-release\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cni-binary-copy\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-modprobe-d\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-kubernetes\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-var-lib-kubelet\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-modprobe-d\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-host\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovnkube-config\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-cni-netd\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcc94624-b453-49e5-b9e8-092c996db370-konnectivity-ca\") pod \"konnectivity-agent-jwwcp\" (UID: \"dcc94624-b453-49e5-b9e8-092c996db370\") " pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-kubelet-config\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-lib-modules\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cnibin\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysconfig\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-log-socket\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-run\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-tuned\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovnkube-script-lib\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-serviceca\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-systemd-units\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995630 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e70cceef-bb33-4d3e-9837-f1de06b43cac-env-overrides\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-kubelet-config\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995724 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-host\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.995762 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-host-cni-netd\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995859 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-kubernetes\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:35.995856 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:36.495839167 +0000 UTC m=+3.041238278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-cnibin\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-sysconfig\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.997722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e70cceef-bb33-4d3e-9837-f1de06b43cac-log-socket\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995764 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-var-lib-kubelet\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.995994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-serviceca\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.996017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8ef4518f-fc2a-4a5f-b3c5-736317789b10-run\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.996054 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-os-release\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.997303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e70cceef-bb33-4d3e-9837-f1de06b43cac-ovn-node-metrics-cert\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.997663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef4518f-fc2a-4a5f-b3c5-736317789b10-tmp\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:35.998381 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.998076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcc94624-b453-49e5-b9e8-092c996db370-agent-certs\") pod \"konnectivity-agent-jwwcp\" (UID: \"dcc94624-b453-49e5-b9e8-092c996db370\") " pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:35.998670 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:35.998502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8ef4518f-fc2a-4a5f-b3c5-736317789b10-etc-tuned\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:36.002470 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.002414 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vntsx\" (UniqueName: \"kubernetes.io/projected/a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3-kube-api-access-vntsx\") pod \"multus-additional-cni-plugins-l2h5w\" (UID: \"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3\") " pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:36.003317 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.003293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzqvn\" (UniqueName: \"kubernetes.io/projected/f5c1e8a5-8e6d-4f00-a967-af62c04fb95b-kube-api-access-zzqvn\") pod \"node-ca-bz8sf\" (UID: \"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b\") " pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:36.003438 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.003419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4qs\" (UniqueName: \"kubernetes.io/projected/8ef4518f-fc2a-4a5f-b3c5-736317789b10-kube-api-access-wk4qs\") pod \"tuned-rgll5\" (UID: \"8ef4518f-fc2a-4a5f-b3c5-736317789b10\") " pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:36.006397 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.006376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmvql\" (UniqueName: \"kubernetes.io/projected/fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5-kube-api-access-fmvql\") pod \"aws-ebs-csi-driver-node-jm7w5\" (UID: \"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:36.006802 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.006779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl77h\" (UniqueName: \"kubernetes.io/projected/e70cceef-bb33-4d3e-9837-f1de06b43cac-kube-api-access-hl77h\") pod \"ovnkube-node-2p2nz\" (UID: \"e70cceef-bb33-4d3e-9837-f1de06b43cac\") " pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:36.007044 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.007023 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhrp\" (UniqueName: \"kubernetes.io/projected/dc0d5d50-26c7-4151-90e2-828d147c2077-kube-api-access-9nhrp\") pod \"node-resolver-47sk9\" (UID: \"dc0d5d50-26c7-4151-90e2-828d147c2077\") " pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:36.085032 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.084952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vnskj" Jun 08 12:51:36.094391 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.094369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w7x7g" Jun 08 12:51:36.105036 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.105017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" Jun 08 12:51:36.108532 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.108511 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" Jun 08 12:51:36.116099 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.116082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:51:36.121631 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.121610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:36.128091 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.128073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rgll5" Jun 08 12:51:36.131111 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.131096 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:51:36.134872 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.134856 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-47sk9" Jun 08 12:51:36.139465 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.139447 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bz8sf" Jun 08 12:51:36.398615 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.398532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:36.398768 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.398721 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:36.398841 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.398805 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:51:37.398784086 +0000 UTC m=+3.944183223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:36.498921 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.498884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:36.499087 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.498943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:36.499087 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.499074 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:36.499177 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.499154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:37.499131609 +0000 UTC m=+4.044530710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:36.499177 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.499076 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:36.499270 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.499184 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:36.499270 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.499199 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:36.499270 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:36.499264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:37.499233755 +0000 UTC m=+4.044632858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:36.828822 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.828728 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3773b8e_ce87_4ef7_8a30_d3e9e21eccd2.slice/crio-d4386a9cd58db8bd2a2cb785ebd2d91df49e29a7cee1c088ef312586489c74f4 WatchSource:0}: Error finding container d4386a9cd58db8bd2a2cb785ebd2d91df49e29a7cee1c088ef312586489c74f4: Status 404 returned error can't find the container with id d4386a9cd58db8bd2a2cb785ebd2d91df49e29a7cee1c088ef312586489c74f4 Jun 08 12:51:36.830163 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.830137 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0d5d50_26c7_4151_90e2_828d147c2077.slice/crio-04059ef5ea09fbab2bdf0c46c7dacdccf4e26ca631070c877ff64fcab6318c4c WatchSource:0}: Error finding container 04059ef5ea09fbab2bdf0c46c7dacdccf4e26ca631070c877ff64fcab6318c4c: Status 404 returned error can't find the container with id 04059ef5ea09fbab2bdf0c46c7dacdccf4e26ca631070c877ff64fcab6318c4c Jun 08 12:51:36.833431 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.833409 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c1e8a5_8e6d_4f00_a967_af62c04fb95b.slice/crio-cbf2bd8de15f3f18e3be5a660ad889b81d3982b6728864a6504fce15923d71a0 WatchSource:0}: Error finding container cbf2bd8de15f3f18e3be5a660ad889b81d3982b6728864a6504fce15923d71a0: Status 404 returned error can't find the container with id cbf2bd8de15f3f18e3be5a660ad889b81d3982b6728864a6504fce15923d71a0 Jun 08 12:51:36.834999 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.834979 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3f1627_8b02_4e9a_9d86_7bc91acf1ee5.slice/crio-3ae5051f75a68e041f0308a9890731b10c2cff607e8847e89ba7115c1ea2fe51 WatchSource:0}: Error finding container 3ae5051f75a68e041f0308a9890731b10c2cff607e8847e89ba7115c1ea2fe51: Status 404 returned error can't find the container with id 3ae5051f75a68e041f0308a9890731b10c2cff607e8847e89ba7115c1ea2fe51 Jun 08 12:51:36.835958 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.835939 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef4518f_fc2a_4a5f_b3c5_736317789b10.slice/crio-00a7a92fd6ffe2bd2114facab6287f59dbbdfa3094e881facbac1a83429cfc61 WatchSource:0}: Error finding container 00a7a92fd6ffe2bd2114facab6287f59dbbdfa3094e881facbac1a83429cfc61: Status 404 returned error can't find the container with id 00a7a92fd6ffe2bd2114facab6287f59dbbdfa3094e881facbac1a83429cfc61 Jun 08 12:51:36.837569 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.837328 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6aa13e_f2a2_45c6_b370_ddfcc9c964d1.slice/crio-bc3396eb4080ead304766aa3e9492ceaa231a275db94231aa774c3676d451b07 WatchSource:0}: Error finding container bc3396eb4080ead304766aa3e9492ceaa231a275db94231aa774c3676d451b07: Status 404 returned error can't find the container with id bc3396eb4080ead304766aa3e9492ceaa231a275db94231aa774c3676d451b07 Jun 08 12:51:36.838565 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.837875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc94624_b453_49e5_b9e8_092c996db370.slice/crio-149216aafc29498b5c9650d0cc71fda3119e6d619516cabe84914d67803a7fb1 WatchSource:0}: Error finding container 149216aafc29498b5c9650d0cc71fda3119e6d619516cabe84914d67803a7fb1: Status 404 returned error can't find the container with id 149216aafc29498b5c9650d0cc71fda3119e6d619516cabe84914d67803a7fb1 Jun 08 12:51:36.839144 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.839125 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70cceef_bb33_4d3e_9837_f1de06b43cac.slice/crio-696bf3ab26d021289bf93f0d1cdc80d558c7e6597074d4cd0af82ba8224119ae WatchSource:0}: Error finding container 696bf3ab26d021289bf93f0d1cdc80d558c7e6597074d4cd0af82ba8224119ae: Status 404 returned error can't find the container with id 696bf3ab26d021289bf93f0d1cdc80d558c7e6597074d4cd0af82ba8224119ae Jun 08 12:51:36.840520 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:51:36.840024 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0aa29f6_0f91_43a2_a60f_d11ffdbd5cf3.slice/crio-4a1565149de1da80249cb9d20b18b9b1f395686fc29c9954cd1441f8be3c86d9 WatchSource:0}: Error finding container 4a1565149de1da80249cb9d20b18b9b1f395686fc29c9954cd1441f8be3c86d9: Status 404 returned error can't find the container with id 4a1565149de1da80249cb9d20b18b9b1f395686fc29c9954cd1441f8be3c86d9 Jun 08 12:51:36.857873 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.857846 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerStarted","Data":"4a1565149de1da80249cb9d20b18b9b1f395686fc29c9954cd1441f8be3c86d9"} Jun 08 12:51:36.859039 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.859016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rgll5" event={"ID":"8ef4518f-fc2a-4a5f-b3c5-736317789b10","Type":"ContainerStarted","Data":"00a7a92fd6ffe2bd2114facab6287f59dbbdfa3094e881facbac1a83429cfc61"} Jun 08 12:51:36.860125 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.860097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" event={"ID":"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5","Type":"ContainerStarted","Data":"3ae5051f75a68e041f0308a9890731b10c2cff607e8847e89ba7115c1ea2fe51"} Jun 08 12:51:36.861221 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.861203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w7x7g" event={"ID":"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2","Type":"ContainerStarted","Data":"d4386a9cd58db8bd2a2cb785ebd2d91df49e29a7cee1c088ef312586489c74f4"} Jun 08 12:51:36.862531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.862511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"696bf3ab26d021289bf93f0d1cdc80d558c7e6597074d4cd0af82ba8224119ae"} Jun 08 12:51:36.863617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.863580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jwwcp" event={"ID":"dcc94624-b453-49e5-b9e8-092c996db370","Type":"ContainerStarted","Data":"149216aafc29498b5c9650d0cc71fda3119e6d619516cabe84914d67803a7fb1"} Jun 08 12:51:36.864617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.864599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vnskj" event={"ID":"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1","Type":"ContainerStarted","Data":"bc3396eb4080ead304766aa3e9492ceaa231a275db94231aa774c3676d451b07"} Jun 08 12:51:36.865655 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.865632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bz8sf" event={"ID":"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b","Type":"ContainerStarted","Data":"cbf2bd8de15f3f18e3be5a660ad889b81d3982b6728864a6504fce15923d71a0"} Jun 08 12:51:36.866650 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.866630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-47sk9" event={"ID":"dc0d5d50-26c7-4151-90e2-828d147c2077","Type":"ContainerStarted","Data":"04059ef5ea09fbab2bdf0c46c7dacdccf4e26ca631070c877ff64fcab6318c4c"} Jun 08 12:51:36.936325 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.936296 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:46:35 +0000 UTC" deadline="2028-03-06 11:06:00.967868904 +0000 UTC" Jun 08 12:51:36.936325 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:36.936324 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15286h14m24.031549252s" Jun 08 12:51:37.405841 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.405725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:37.405996 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.405886 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:37.406064 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.405996 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:51:39.405936102 +0000 UTC m=+5.951335202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:37.506930 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.506699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:37.507102 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.506981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:37.507102 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.506995 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:37.507102 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.507070 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:39.507050919 +0000 UTC m=+6.052450034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:37.507292 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.507121 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:37.507292 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.507139 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:37.507292 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.507154 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:37.507292 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.507219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:39.507188304 +0000 UTC m=+6.052587405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:37.858582 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.855424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:37.858582 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.855451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:37.858582 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.855659 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:37.858582 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.855754 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:37.858582 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.855837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:37.858582 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:37.855911 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:37.894824 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.894112 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" event={"ID":"99efa69a4b5a002c8f285a7ebacbc192","Type":"ContainerStarted","Data":"79204db293ba7eee0381848239afef3c42fd8226ae3bc3b0686b77354334e5f5"} Jun 08 12:51:37.901801 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.901764 2578 generic.go:356] "Generic (PLEG): container finished" podID="9b85e035f6f85e14d320e79db36a1dca" containerID="1471c24b0ddecb6432b006a10d0423ae97daeac0014064779be9dc919ef2d72e" exitCode=0 Jun 08 12:51:37.901961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.901825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" event={"ID":"9b85e035f6f85e14d320e79db36a1dca","Type":"ContainerDied","Data":"1471c24b0ddecb6432b006a10d0423ae97daeac0014064779be9dc919ef2d72e"} Jun 08 12:51:37.910588 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.910533 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-240.ec2.internal" podStartSLOduration=3.910514358 podStartE2EDuration="3.910514358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:37.910099158 +0000 UTC m=+4.455498281" watchObservedRunningTime="2026-06-08 12:51:37.910514358 +0000 UTC m=+4.455913479" Jun 08 12:51:37.937082 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.937023 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:46:35 +0000 UTC" deadline="2028-02-25 15:49:28.576292458 +0000 UTC" Jun 08 12:51:37.937082 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:37.937081 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15050h57m50.63921584s" Jun 08 12:51:38.916391 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:38.916343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" event={"ID":"9b85e035f6f85e14d320e79db36a1dca","Type":"ContainerStarted","Data":"12e992caffea2afa00399d6ac8568689d70e5c8791596056441a59848914c0a5"} Jun 08 12:51:38.934041 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:38.933354 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-240.ec2.internal" podStartSLOduration=4.933332587 podStartE2EDuration="4.933332587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:38.932908284 +0000 UTC m=+5.478307415" watchObservedRunningTime="2026-06-08 12:51:38.933332587 +0000 UTC m=+5.478731710" Jun 08 12:51:39.425165 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:39.425126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:39.425381 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.425319 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:39.425443 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.425395 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:51:43.425374 +0000 UTC m=+9.970773112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:39.525910 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:39.525869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:39.526093 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:39.525935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:39.526093 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.526073 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:39.526093 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.526091 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:39.526264 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.526104 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:39.526264 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.526164 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:43.526145337 +0000 UTC m=+10.071544447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:39.526639 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.526618 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:39.526734 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.526675 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:43.526660328 +0000 UTC m=+10.072059440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:39.850129 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:39.849353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:39.850129 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.849488 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:39.850129 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:39.849880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:39.850129 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.849984 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:39.850715 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:39.850555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:39.850715 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:39.850658 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:41.849413 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:41.849377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:41.849864 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:41.849502 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:41.849906 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:41.849866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:41.849988 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:41.849963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:41.850106 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:41.850091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:41.850207 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:41.850188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:43.459657 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:43.459611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:43.460190 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.459777 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:43.460190 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.459849 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:51:51.459829008 +0000 UTC m=+18.005228124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:43.560547 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:43.560502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:43.560745 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:43.560568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:43.560745 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.560680 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:43.560745 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.560740 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:43.560901 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.560758 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:43.560901 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.560768 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:51.560749623 +0000 UTC m=+18.106148735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:43.560901 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.560772 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:43.560901 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.560822 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:51:51.560807295 +0000 UTC m=+18.106206395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:43.851053 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:43.850981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:43.851399 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.851371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:43.851848 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:43.851669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:43.851848 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.851763 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:43.851848 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:43.851820 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:43.852798 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:43.852772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:45.849014 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:45.848930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:45.849458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:45.849060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:45.849458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:45.849085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:45.849458 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:45.849163 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:45.849458 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:45.849065 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:45.849458 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:45.849223 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:47.848426 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:47.848386 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:47.848951 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:47.848390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:47.848951 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:47.848532 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:47.848951 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:47.848391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:47.848951 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:47.848610 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:47.848951 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:47.848659 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:49.848462 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:49.848416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:49.848462 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:49.848456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:49.848924 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:49.848479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:49.848924 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:49.848600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:49.848924 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:49.848675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:49.848924 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:49.848772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:51.521196 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:51.521163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:51.521658 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.521349 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:51.521658 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.521427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.521404716 +0000 UTC m=+34.066803814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:51:51.622158 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:51.622120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:51.622363 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:51.622208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:51.622363 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.622269 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:51:51.622363 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.622297 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:51:51.622363 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.622314 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:51.622363 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.622313 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:51.622606 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.622375 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.622356666 +0000 UTC m=+34.167755764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:51:51.622606 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.622394 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:07.622385993 +0000 UTC m=+34.167785089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:51:51.848730 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:51.848649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:51.848730 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:51.848661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:51.848730 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:51.848695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:51.849001 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.848795 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:51.849001 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.848910 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:51.849086 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:51.849000 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:53.848924 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:53.848897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:53.849427 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:53.849007 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:53.849427 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:53.849085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:53.849427 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:53.849167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:53.849427 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:53.849182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:53.849427 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:53.849318 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:55.851981 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.851796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:55.852462 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.851822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:55.852462 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:55.852088 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:55.852462 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.851822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:55.852462 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:55.852141 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:55.852462 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:55.852259 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:55.951190 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.951155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vnskj" event={"ID":"1f6aa13e-f2a2-45c6-b370-ddfcc9c964d1","Type":"ContainerStarted","Data":"3a9330c5cc5d856efd52ab94078363702cb2b4f7dd11fafeee5d46bf949bc0f2"} Jun 08 12:51:55.955705 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.955674 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bz8sf" event={"ID":"f5c1e8a5-8e6d-4f00-a967-af62c04fb95b","Type":"ContainerStarted","Data":"4bdd9804f82d568f56da9dd14b5aeb198603bd0f386bc433121a554281533baa"} Jun 08 12:51:55.957166 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.957145 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-47sk9" event={"ID":"dc0d5d50-26c7-4151-90e2-828d147c2077","Type":"ContainerStarted","Data":"1dc528e7e535aab517b2d13c23169dfe310eb3677cbdb5475257f3a0fbe4936b"} Jun 08 12:51:55.958728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.958701 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3" containerID="52e51d027f3da7e81e6c5f3a16c0962eb4a6482b16af4d098eea6e704703cbaf" exitCode=0 Jun 08 12:51:55.958942 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.958771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerDied","Data":"52e51d027f3da7e81e6c5f3a16c0962eb4a6482b16af4d098eea6e704703cbaf"} Jun 08 12:51:55.960722 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.960677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rgll5" event={"ID":"8ef4518f-fc2a-4a5f-b3c5-736317789b10","Type":"ContainerStarted","Data":"7f0d9fb84de9978f39b10df3d315d27be5877d98129fc6524cb16562ea3d9ea8"} Jun 08 12:51:55.964322 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.964304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" event={"ID":"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5","Type":"ContainerStarted","Data":"f036af275ac15fd43680b59a682af89b71705d44d3b002b483450cdc14b9a0e6"} Jun 08 12:51:55.966710 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.966694 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:51:55.966979 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.966962 2578 generic.go:356] "Generic (PLEG): container finished" podID="e70cceef-bb33-4d3e-9837-f1de06b43cac" containerID="34a4258bcb292da7d596b08cfdc7a9d1cae4ced5a3464e585fe5cd35c5f0194a" exitCode=1 Jun 08 12:51:55.967042 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.967013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"bd1aecfac306d265dd0379fd84b1e3e6074e2fe25dbf8cdc5618fddcc851b098"} Jun 08 12:51:55.967082 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.967063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"29931d72b41ba896d1ae3a9886bb8dc83a21c6bfb64a0b1c3bcb6b02b074adce"} Jun 08 12:51:55.967115 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.967094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerDied","Data":"34a4258bcb292da7d596b08cfdc7a9d1cae4ced5a3464e585fe5cd35c5f0194a"} Jun 08 12:51:55.967146 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.967130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"a72da5c321133c9070207220bfb451859f33e58891dad4bd3cbfc5fe0ea64cb5"} Jun 08 12:51:55.968424 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.968404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jwwcp" event={"ID":"dcc94624-b453-49e5-b9e8-092c996db370","Type":"ContainerStarted","Data":"385b5e8fcff83dfe2b2c32d9c680e1b6be9c995d0b51aefe970c0ddaaefb1725"} Jun 08 12:51:55.979511 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:55.979476 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vnskj" podStartSLOduration=4.448295996 podStartE2EDuration="22.979464909s" totalImagesPullingTime="18.531168913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:55.978781635 +0000 UTC m=+22.524180758" watchObservedRunningTime="2026-06-08 12:51:55.979464909 +0000 UTC m=+22.524864027" Jun 08 12:51:56.000252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.000192 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jwwcp" podStartSLOduration=11.78035274 podStartE2EDuration="22.000176693s" totalImagesPullingTime="10.219823953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:55.998650999 +0000 UTC m=+22.544050119" watchObservedRunningTime="2026-06-08 12:51:56.000176693 +0000 UTC m=+22.545575842" Jun 08 12:51:56.047098 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.047003 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rgll5" podStartSLOduration=3.560879246 podStartE2EDuration="22.046986494s" totalImagesPullingTime="18.486107248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:56.046836118 +0000 UTC m=+22.592235238" watchObservedRunningTime="2026-06-08 12:51:56.046986494 +0000 UTC m=+22.592385614" Jun 08 12:51:56.097734 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.097555 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-47sk9" podStartSLOduration=3.6072940559999997 podStartE2EDuration="22.097536066s" totalImagesPullingTime="18.49024201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:56.072741112 +0000 UTC m=+22.618140230" watchObservedRunningTime="2026-06-08 12:51:56.097536066 +0000 UTC m=+22.642935184" Jun 08 12:51:56.097915 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.097761 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bz8sf" podStartSLOduration=3.610430658 podStartE2EDuration="22.097756601s" totalImagesPullingTime="18.487325943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:56.096689131 +0000 UTC m=+22.642088251" watchObservedRunningTime="2026-06-08 12:51:56.097756601 +0000 UTC m=+22.643155743" Jun 08 12:51:56.892029 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.892004 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 12:51:56.974193 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.974121 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:51:56.974656 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.974625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"df7bf4d83f3cecd7522e4814429cb8ef391ba4a52bb1300d710adfc5f8e3f0fd"} Jun 08 12:51:56.974756 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.974711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"6e5206744cae235a58719c201825c06c3b8d8558c8bf2e71d8798d20a6410e4a"} Jun 08 12:51:56.976645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.976618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" event={"ID":"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5","Type":"ContainerStarted","Data":"b2bfff494fd2eb5dee76c76c9aa73cba5bb6e03942df2e2d428a05f7a8804209"} Jun 08 12:51:56.978212 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.978166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w7x7g" event={"ID":"e3773b8e-ce87-4ef7-8a30-d3e9e21eccd2","Type":"ContainerStarted","Data":"a7d15a3bbcdd32f10257a97009c33baf4bdf7209c4c9a6b55aee42d2a7013f19"} Jun 08 12:51:56.996919 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:56.996876 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w7x7g" podStartSLOduration=4.505576625 podStartE2EDuration="22.996861697s" totalImagesPullingTime="18.491285072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:56.996202557 +0000 UTC m=+23.541601676" watchObservedRunningTime="2026-06-08 12:51:56.996861697 +0000 UTC m=+23.542260818" Jun 08 12:51:57.368436 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.368398 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:57.369038 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.369018 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:57.849021 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.848987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:57.849204 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.848987 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:57.849204 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.849130 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:57.849204 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:57.849145 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:51:57.849388 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:57.849252 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:57.849388 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:57.849362 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:57.850792 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.850697 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T12:51:56.892021832Z","UUID":"dd2aa54d-523b-4005-a695-abbb228ee55f","Handler":null,"Name":"","Endpoint":""} Jun 08 12:51:57.852416 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.852386 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 12:51:57.852517 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.852456 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 12:51:57.982588 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:57.982498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" event={"ID":"fb3f1627-8b02-4e9a-9d86-7bc91acf1ee5","Type":"ContainerStarted","Data":"8cdd8799ba3f2c21af0f1e5fe96d2e0a7d25b48604b7836e8b4d9df21bc36d55"} Jun 08 12:51:58.000190 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:58.000136 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jm7w5" podStartSLOduration=3.521405251 podStartE2EDuration="24.000115623s" totalImagesPullingTime="20.478710372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:51:57.999853295 +0000 UTC m=+24.545252414" watchObservedRunningTime="2026-06-08 12:51:58.000115623 +0000 UTC m=+24.545514743" Jun 08 12:51:58.988058 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:58.988031 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:51:58.988645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:58.988526 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"916dd3f45c60c7add22fb7c63fd8649a296120ca7607fbc7359ef129093cddfd"} Jun 08 12:51:58.988645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:58.988554 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 12:51:59.693362 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:59.693318 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:59.694257 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:59.694223 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jwwcp" Jun 08 12:51:59.851833 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:59.851798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:51:59.851987 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:59.851894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:51:59.851987 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:59.851902 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:51:59.851987 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:51:59.851929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:51:59.852127 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:59.852021 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:51:59.852127 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:51:59.852098 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:52:00.994546 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.994381 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3" containerID="5b32426c660e2055191d33673757ed1821f92bac6b0d1d014b34ac9eb5bf0be7" exitCode=0 Jun 08 12:52:00.995088 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.994460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerDied","Data":"5b32426c660e2055191d33673757ed1821f92bac6b0d1d014b34ac9eb5bf0be7"} Jun 08 12:52:00.998317 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.998275 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:52:00.998694 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.998670 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"f8a9f5a58c32d4041c72b1f41803108ab6ca166237dcc69e3ea47475b1c8fdee"} Jun 08 12:52:00.998863 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.998844 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:52:00.998947 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.998898 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:52:00.999044 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:00.999026 2578 scope.go:117] "RemoveContainer" containerID="34a4258bcb292da7d596b08cfdc7a9d1cae4ced5a3464e585fe5cd35c5f0194a" Jun 08 12:52:01.015446 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:01.015400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:52:01.849194 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:01.849021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:01.849347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:01.849021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:01.849347 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:01.849281 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:52:01.849423 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:01.849072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:01.849477 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:01.849417 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:52:01.849517 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:01.849502 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:52:02.004527 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.004503 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:52:02.004982 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.004844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" event={"ID":"e70cceef-bb33-4d3e-9837-f1de06b43cac","Type":"ContainerStarted","Data":"fe50b93c15dd4d85fa5332d264c3c89872c6f1b8de68ebb86e7fc1cb505d15d8"} Jun 08 12:52:02.005155 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.005128 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:52:02.007011 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.006993 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3" containerID="e74cdd1ed333470f7595f6f78e83196f3ed213aa225253f1b76623fff9a27487" exitCode=0 Jun 08 12:52:02.007093 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.007026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerDied","Data":"e74cdd1ed333470f7595f6f78e83196f3ed213aa225253f1b76623fff9a27487"} Jun 08 12:52:02.020698 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.020679 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:52:02.038798 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.038761 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" podStartSLOduration=9.518998749 podStartE2EDuration="28.038748102s" totalImagesPullingTime="18.519749353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:02.037440669 +0000 UTC m=+28.582839787" watchObservedRunningTime="2026-06-08 12:52:02.038748102 +0000 UTC m=+28.584147221" Jun 08 12:52:02.193921 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.193889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kv2l6"] Jun 08 12:52:02.194108 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.193994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:02.194174 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:02.194140 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:52:02.194679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.194659 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pbzb2"] Jun 08 12:52:02.194767 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.194733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:02.194833 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:02.194818 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:52:02.198552 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.197299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xjcvp"] Jun 08 12:52:02.198552 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:02.197450 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:02.198552 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:02.197567 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:52:03.011257 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:03.011210 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3" containerID="2792435231f77a2b8de05fa5d32b259feb944c79b2e6713185aa50498ef2ee13" exitCode=0 Jun 08 12:52:03.011696 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:03.011276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerDied","Data":"2792435231f77a2b8de05fa5d32b259feb944c79b2e6713185aa50498ef2ee13"} Jun 08 12:52:03.852090 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:03.852066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:03.852272 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:03.852064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:03.852272 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:03.852179 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:52:03.852399 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:03.852282 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:52:03.852399 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:03.852064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:03.852399 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:03.852368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:52:05.848906 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:05.848876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:05.849491 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:05.848882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:05.849491 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:05.849006 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:52:05.849491 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:05.849071 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:52:05.849491 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:05.848883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:05.849491 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:05.849144 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:52:07.539999 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:07.539822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:07.540355 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.539964 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:52:07.540355 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.540092 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs podName:f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb nodeName:}" failed. No retries permitted until 2026-06-08 12:52:39.540076046 +0000 UTC m=+66.085475143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs") pod "network-metrics-daemon-pbzb2" (UID: "f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:52:07.641067 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:07.640983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:07.641067 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:07.641027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:07.641272 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.641128 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:52:07.641272 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.641190 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret podName:25f5a502-d1dd-47d6-9c52-3ea7d7afe176 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:39.641175132 +0000 UTC m=+66.186574230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret") pod "global-pull-secret-syncer-kv2l6" (UID: "25f5a502-d1dd-47d6-9c52-3ea7d7afe176") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:52:07.641272 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.641133 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:52:07.641272 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.641235 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:52:07.641272 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.641260 2578 projected.go:196] Error preparing data for projected volume kube-api-access-hmcjk for pod openshift-network-diagnostics/network-check-target-xjcvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:52:07.641433 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.641301 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk podName:d8e0b1bd-2cd4-405a-b8e3-29d7c1500974 nodeName:}" failed. No retries permitted until 2026-06-08 12:52:39.641290411 +0000 UTC m=+66.186689509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmcjk" (UniqueName: "kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk") pod "network-check-target-xjcvp" (UID: "d8e0b1bd-2cd4-405a-b8e3-29d7c1500974") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:52:07.852053 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:07.852018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:07.852300 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:07.852121 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:07.852300 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.852135 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xjcvp" podUID="d8e0b1bd-2cd4-405a-b8e3-29d7c1500974" Jun 08 12:52:07.852300 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:07.852146 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:07.852300 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.852248 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kv2l6" podUID="25f5a502-d1dd-47d6-9c52-3ea7d7afe176" Jun 08 12:52:07.852495 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:07.852340 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pbzb2" podUID="f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb" Jun 08 12:52:08.024873 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.024841 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3" containerID="a4e09e305c95b98f1d7520fba9b7165fb377ebb88a61dcb6ecfc5e01835cc519" exitCode=0 Jun 08 12:52:08.025075 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.024889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerDied","Data":"a4e09e305c95b98f1d7520fba9b7165fb377ebb88a61dcb6ecfc5e01835cc519"} Jun 08 12:52:08.280410 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.280380 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-240.ec2.internal" event="NodeReady" Jun 08 12:52:08.280584 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.280513 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 12:52:08.325204 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.325170 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fc68d"] Jun 08 12:52:08.343492 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.343190 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vr4b9"] Jun 08 12:52:08.343492 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.343337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.345564 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.345340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 12:52:08.345564 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.345380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vjkf\"" Jun 08 12:52:08.345923 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.345908 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 12:52:08.361477 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.361446 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fc68d"] Jun 08 12:52:08.361603 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.361491 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vr4b9"] Jun 08 12:52:08.361603 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.361545 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.363757 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.363736 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 12:52:08.363854 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.363792 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 12:52:08.363854 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.363792 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54pl5\"" Jun 08 12:52:08.363941 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.363795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 12:52:08.446349 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.446312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69e875b7-db79-44fc-bc35-72d8ba567990-cert\") pod \"ingress-canary-vr4b9\" (UID: \"69e875b7-db79-44fc-bc35-72d8ba567990\") " pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.446349 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.446349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.446615 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.446376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2vmk\" (UniqueName: \"kubernetes.io/projected/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-kube-api-access-v2vmk\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.446615 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.446409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-config-volume\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.446615 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.446429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-tmp-dir\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.446615 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.446447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pqv5\" (UniqueName: \"kubernetes.io/projected/69e875b7-db79-44fc-bc35-72d8ba567990-kube-api-access-4pqv5\") pod \"ingress-canary-vr4b9\" (UID: \"69e875b7-db79-44fc-bc35-72d8ba567990\") " pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.547653 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.547602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69e875b7-db79-44fc-bc35-72d8ba567990-cert\") pod \"ingress-canary-vr4b9\" (UID: \"69e875b7-db79-44fc-bc35-72d8ba567990\") " pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.547653 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.547654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.547691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2vmk\" (UniqueName: \"kubernetes.io/projected/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-kube-api-access-v2vmk\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.547726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-config-volume\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.547748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-tmp-dir\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.547777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pqv5\" (UniqueName: \"kubernetes.io/projected/69e875b7-db79-44fc-bc35-72d8ba567990-kube-api-access-4pqv5\") pod \"ingress-canary-vr4b9\" (UID: \"69e875b7-db79-44fc-bc35-72d8ba567990\") " pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:08.547829 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:08.547901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls podName:c2bfa6ff-b71e-453a-92cf-e8d009d606ab nodeName:}" failed. No retries permitted until 2026-06-08 12:52:09.047881137 +0000 UTC m=+35.593280234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls") pod "dns-default-fc68d" (UID: "c2bfa6ff-b71e-453a-92cf-e8d009d606ab") : secret "dns-default-metrics-tls" not found Jun 08 12:52:08.548113 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.548099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-tmp-dir\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.548386 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.548366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-config-volume\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.551808 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.551790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69e875b7-db79-44fc-bc35-72d8ba567990-cert\") pod \"ingress-canary-vr4b9\" (UID: \"69e875b7-db79-44fc-bc35-72d8ba567990\") " pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.557655 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.557633 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2vmk\" (UniqueName: \"kubernetes.io/projected/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-kube-api-access-v2vmk\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:08.559461 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.559436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pqv5\" (UniqueName: \"kubernetes.io/projected/69e875b7-db79-44fc-bc35-72d8ba567990-kube-api-access-4pqv5\") pod \"ingress-canary-vr4b9\" (UID: \"69e875b7-db79-44fc-bc35-72d8ba567990\") " pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.670302 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.670265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr4b9" Jun 08 12:52:08.846768 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:08.846725 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vr4b9"] Jun 08 12:52:08.851668 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:08.851643 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e875b7_db79_44fc_bc35_72d8ba567990.slice/crio-c99e5eb4f15c871022769f0b184082a66a07e98d2db6522f6a930d3dddbb66c8 WatchSource:0}: Error finding container c99e5eb4f15c871022769f0b184082a66a07e98d2db6522f6a930d3dddbb66c8: Status 404 returned error can't find the container with id c99e5eb4f15c871022769f0b184082a66a07e98d2db6522f6a930d3dddbb66c8 Jun 08 12:52:09.028688 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.028591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vr4b9" event={"ID":"69e875b7-db79-44fc-bc35-72d8ba567990","Type":"ContainerStarted","Data":"c99e5eb4f15c871022769f0b184082a66a07e98d2db6522f6a930d3dddbb66c8"} Jun 08 12:52:09.031645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.031613 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3" containerID="89eba4f9acef397b2e30d7a6095d1122442fed548b894b4ef35081e75e307772" exitCode=0 Jun 08 12:52:09.031645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.031646 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerDied","Data":"89eba4f9acef397b2e30d7a6095d1122442fed548b894b4ef35081e75e307772"} Jun 08 12:52:09.052411 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.052363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:09.052652 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:09.052560 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:09.052696 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:09.052671 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls podName:c2bfa6ff-b71e-453a-92cf-e8d009d606ab nodeName:}" failed. No retries permitted until 2026-06-08 12:52:10.052647923 +0000 UTC m=+36.598047029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls") pod "dns-default-fc68d" (UID: "c2bfa6ff-b71e-453a-92cf-e8d009d606ab") : secret "dns-default-metrics-tls" not found Jun 08 12:52:09.849399 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.849356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:09.850087 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.849355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:09.850087 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.849602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:09.852519 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.852269 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:52:09.852519 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.852280 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:52:09.852519 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.852287 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:52:09.853060 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.853038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4jlgv\"" Jun 08 12:52:09.853178 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.853084 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzgqm\"" Jun 08 12:52:09.853347 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:09.853260 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:52:10.038662 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:10.038626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" event={"ID":"a0aa29f6-0f91-43a2-a60f-d11ffdbd5cf3","Type":"ContainerStarted","Data":"c93283bc21d891dd067f26629232db856eb165854c4ee74a5a34e7818ef91ea9"} Jun 08 12:52:10.061512 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:10.061476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:10.061697 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:10.061675 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:10.061782 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:10.061770 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls podName:c2bfa6ff-b71e-453a-92cf-e8d009d606ab nodeName:}" failed. No retries permitted until 2026-06-08 12:52:12.061746914 +0000 UTC m=+38.607146014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls") pod "dns-default-fc68d" (UID: "c2bfa6ff-b71e-453a-92cf-e8d009d606ab") : secret "dns-default-metrics-tls" not found Jun 08 12:52:10.065052 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:10.065008 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l2h5w" podStartSLOduration=7.888990305 podStartE2EDuration="36.064994096s" totalImagesPullingTime="28.176003791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:10.063971331 +0000 UTC m=+36.609370451" watchObservedRunningTime="2026-06-08 12:52:10.064994096 +0000 UTC m=+36.610393214" Jun 08 12:52:11.043728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.043693 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vr4b9" event={"ID":"69e875b7-db79-44fc-bc35-72d8ba567990","Type":"ContainerStarted","Data":"3942279ae7a9e7a7701a47eb65d382a455e1e2e1265b9254d8526a2f3f338573"} Jun 08 12:52:11.092961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.092862 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vr4b9" podStartSLOduration=1.109271064 podStartE2EDuration="3.092844191s" totalImagesPullingTime="1.983573127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:11.085095798 +0000 UTC m=+37.630494916" watchObservedRunningTime="2026-06-08 12:52:11.092844191 +0000 UTC m=+37.638243349" Jun 08 12:52:11.212202 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.212172 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx"] Jun 08 12:52:11.236837 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.236812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" Jun 08 12:52:11.241780 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.241751 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pgbqf\"" Jun 08 12:52:11.241942 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.241912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 08 12:52:11.242032 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.242009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 08 12:52:11.257873 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.257842 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx"] Jun 08 12:52:11.371611 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.371536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlr2v\" (UniqueName: \"kubernetes.io/projected/0ef4f66c-9c68-434b-8633-2914ae133832-kube-api-access-tlr2v\") pod \"migrator-955ffdf5f-n8vvx\" (UID: \"0ef4f66c-9c68-434b-8633-2914ae133832\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" Jun 08 12:52:11.472894 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.472861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlr2v\" (UniqueName: \"kubernetes.io/projected/0ef4f66c-9c68-434b-8633-2914ae133832-kube-api-access-tlr2v\") pod \"migrator-955ffdf5f-n8vvx\" (UID: \"0ef4f66c-9c68-434b-8633-2914ae133832\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" Jun 08 12:52:11.487138 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.487108 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlr2v\" (UniqueName: \"kubernetes.io/projected/0ef4f66c-9c68-434b-8633-2914ae133832-kube-api-access-tlr2v\") pod \"migrator-955ffdf5f-n8vvx\" (UID: \"0ef4f66c-9c68-434b-8633-2914ae133832\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" Jun 08 12:52:11.545130 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.545099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" Jun 08 12:52:11.687861 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:11.687697 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx"] Jun 08 12:52:11.690802 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:11.690780 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef4f66c_9c68_434b_8633_2914ae133832.slice/crio-a091e1a99db75f1f721e89cc15712f1837e438c2060a8b601359888b1ce92b5a WatchSource:0}: Error finding container a091e1a99db75f1f721e89cc15712f1837e438c2060a8b601359888b1ce92b5a: Status 404 returned error can't find the container with id a091e1a99db75f1f721e89cc15712f1837e438c2060a8b601359888b1ce92b5a Jun 08 12:52:12.047359 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:12.047327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" event={"ID":"0ef4f66c-9c68-434b-8633-2914ae133832","Type":"ContainerStarted","Data":"a091e1a99db75f1f721e89cc15712f1837e438c2060a8b601359888b1ce92b5a"} Jun 08 12:52:12.077773 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:12.077744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:12.077931 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:12.077862 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:12.077931 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:12.077926 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls podName:c2bfa6ff-b71e-453a-92cf-e8d009d606ab nodeName:}" failed. No retries permitted until 2026-06-08 12:52:16.077911168 +0000 UTC m=+42.623310266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls") pod "dns-default-fc68d" (UID: "c2bfa6ff-b71e-453a-92cf-e8d009d606ab") : secret "dns-default-metrics-tls" not found Jun 08 12:52:13.960954 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:13.960929 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-47sk9_dc0d5d50-26c7-4151-90e2-828d147c2077/dns-node-resolver/0.log" Jun 08 12:52:14.054496 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:14.054462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" event={"ID":"0ef4f66c-9c68-434b-8633-2914ae133832","Type":"ContainerStarted","Data":"ccf9b58b9223b04de7145e7e7078dd346322f5039a763841f533290198d0649f"} Jun 08 12:52:14.054682 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:14.054512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" event={"ID":"0ef4f66c-9c68-434b-8633-2914ae133832","Type":"ContainerStarted","Data":"c1a7a545162928533d564f4ec448c9a0527cbf75b4e4b7175b2f9b5d1f081591"} Jun 08 12:52:14.077847 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:14.077790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-n8vvx" podStartSLOduration=1.553587239 podStartE2EDuration="3.077771081s" totalImagesPullingTime="1.524183842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:14.076925685 +0000 UTC m=+40.622324814" watchObservedRunningTime="2026-06-08 12:52:14.077771081 +0000 UTC m=+40.623170199" Jun 08 12:52:14.966054 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:14.966024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bz8sf_f5c1e8a5-8e6d-4f00-a967-af62c04fb95b/node-ca/0.log" Jun 08 12:52:16.106513 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:16.106467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:16.106878 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:16.106619 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:52:16.106878 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:52:16.106684 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls podName:c2bfa6ff-b71e-453a-92cf-e8d009d606ab nodeName:}" failed. No retries permitted until 2026-06-08 12:52:24.106668766 +0000 UTC m=+50.652067867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls") pod "dns-default-fc68d" (UID: "c2bfa6ff-b71e-453a-92cf-e8d009d606ab") : secret "dns-default-metrics-tls" not found Jun 08 12:52:16.160102 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:16.160071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vr4b9_69e875b7-db79-44fc-bc35-72d8ba567990/serve-healthcheck-canary/0.log" Jun 08 12:52:16.360226 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:16.360152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-n8vvx_0ef4f66c-9c68-434b-8633-2914ae133832/migrator/0.log" Jun 08 12:52:16.562029 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:16.561999 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-n8vvx_0ef4f66c-9c68-434b-8633-2914ae133832/graceful-termination/0.log" Jun 08 12:52:24.168063 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:24.168025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:24.171076 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:24.171055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2bfa6ff-b71e-453a-92cf-e8d009d606ab-metrics-tls\") pod \"dns-default-fc68d\" (UID: \"c2bfa6ff-b71e-453a-92cf-e8d009d606ab\") " pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:24.253087 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:24.253046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:24.411615 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:24.411587 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fc68d"] Jun 08 12:52:24.414648 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:24.414621 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2bfa6ff_b71e_453a_92cf_e8d009d606ab.slice/crio-0e8ce29d26964f71a7f118cc7a8395164ae9b035a853cff2e8b64a2328df0ea5 WatchSource:0}: Error finding container 0e8ce29d26964f71a7f118cc7a8395164ae9b035a853cff2e8b64a2328df0ea5: Status 404 returned error can't find the container with id 0e8ce29d26964f71a7f118cc7a8395164ae9b035a853cff2e8b64a2328df0ea5 Jun 08 12:52:25.082598 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:25.082548 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fc68d" event={"ID":"c2bfa6ff-b71e-453a-92cf-e8d009d606ab","Type":"ContainerStarted","Data":"0e8ce29d26964f71a7f118cc7a8395164ae9b035a853cff2e8b64a2328df0ea5"} Jun 08 12:52:27.090660 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:27.090621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fc68d" event={"ID":"c2bfa6ff-b71e-453a-92cf-e8d009d606ab","Type":"ContainerStarted","Data":"787322d005cb12c537102d72eb0fb38ee893ab8ce48a925543c9333b6e9438fb"} Jun 08 12:52:27.091164 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:27.090713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fc68d" event={"ID":"c2bfa6ff-b71e-453a-92cf-e8d009d606ab","Type":"ContainerStarted","Data":"229d16d73098ba3881463d5061e3a8ca2a46c8b492d23309c2444e0ef06c5a47"} Jun 08 12:52:27.091164 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:27.090744 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:27.114755 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:27.114706 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fc68d" podStartSLOduration=17.081214984 podStartE2EDuration="19.114692385s" totalImagesPullingTime="2.033477401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:27.113267425 +0000 UTC m=+53.658666540" watchObservedRunningTime="2026-06-08 12:52:27.114692385 +0000 UTC m=+53.660091503" Jun 08 12:52:34.024074 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.024047 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2p2nz" Jun 08 12:52:34.593036 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.593000 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk"] Jun 08 12:52:34.595577 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.595556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.597687 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.597654 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 12:52:34.597792 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.597729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 12:52:34.597792 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.597740 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qcz8c\"" Jun 08 12:52:34.598497 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.598481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 12:52:34.598674 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.598568 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 12:52:34.605870 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.605848 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg"] Jun 08 12:52:34.607838 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.607821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.611234 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.611214 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk"] Jun 08 12:52:34.613141 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.613121 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 12:52:34.613230 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.613149 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 12:52:34.613314 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.613232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 12:52:34.624064 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.624045 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 12:52:34.636444 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.636412 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg"] Jun 08 12:52:34.639232 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-ca\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.639343 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45jb5\" (UniqueName: \"kubernetes.io/projected/3da5998a-832c-4c0c-a1e1-401b3a39de46-kube-api-access-45jb5\") pod \"managed-serviceaccount-addon-agent-669994d688-6lqqk\" (UID: \"3da5998a-832c-4c0c-a1e1-401b3a39de46\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.639343 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-hub\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.639343 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3da5998a-832c-4c0c-a1e1-401b3a39de46-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-669994d688-6lqqk\" (UID: \"3da5998a-832c-4c0c-a1e1-401b3a39de46\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.639477 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.639477 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnj8k\" (UniqueName: \"kubernetes.io/projected/270edbb7-951b-4e01-885d-fb32087514c0-kube-api-access-cnj8k\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.639577 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.639633 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.639581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/270edbb7-951b-4e01-885d-fb32087514c0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.704947 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.704915 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gtqhs"] Jun 08 12:52:34.707264 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.707230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.719402 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.719379 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9trt4\"" Jun 08 12:52:34.719739 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.719712 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 12:52:34.719807 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.719757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 12:52:34.723675 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.723660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 12:52:34.731475 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.731458 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 12:52:34.740411 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-crio-socket\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.740513 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkssc\" (UniqueName: \"kubernetes.io/projected/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-kube-api-access-hkssc\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.740513 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740449 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-ca\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.740596 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.740636 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45jb5\" (UniqueName: \"kubernetes.io/projected/3da5998a-832c-4c0c-a1e1-401b3a39de46-kube-api-access-45jb5\") pod \"managed-serviceaccount-addon-agent-669994d688-6lqqk\" (UID: \"3da5998a-832c-4c0c-a1e1-401b3a39de46\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.740636 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-data-volume\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.740712 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-hub\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.740712 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3da5998a-832c-4c0c-a1e1-401b3a39de46-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-669994d688-6lqqk\" (UID: \"3da5998a-832c-4c0c-a1e1-401b3a39de46\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.740712 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740701 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.740859 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.740914 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnj8k\" (UniqueName: \"kubernetes.io/projected/270edbb7-951b-4e01-885d-fb32087514c0-kube-api-access-cnj8k\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.740983 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.741038 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.740997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/270edbb7-951b-4e01-885d-fb32087514c0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.741854 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.741826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/270edbb7-951b-4e01-885d-fb32087514c0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.743020 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.743000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-ca\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.743211 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.743192 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-hub\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.743306 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.743214 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.743595 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.743577 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3da5998a-832c-4c0c-a1e1-401b3a39de46-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-669994d688-6lqqk\" (UID: \"3da5998a-832c-4c0c-a1e1-401b3a39de46\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.743639 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.743592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/270edbb7-951b-4e01-885d-fb32087514c0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.765058 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.765026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gtqhs"] Jun 08 12:52:34.773988 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.773959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45jb5\" (UniqueName: \"kubernetes.io/projected/3da5998a-832c-4c0c-a1e1-401b3a39de46-kube-api-access-45jb5\") pod \"managed-serviceaccount-addon-agent-669994d688-6lqqk\" (UID: \"3da5998a-832c-4c0c-a1e1-401b3a39de46\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.774203 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.774181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnj8k\" (UniqueName: \"kubernetes.io/projected/270edbb7-951b-4e01-885d-fb32087514c0-kube-api-access-cnj8k\") pod \"cluster-proxy-proxy-agent-5568d5f799-wprrg\" (UID: \"270edbb7-951b-4e01-885d-fb32087514c0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:34.842225 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-data-volume\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842225 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842448 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-crio-socket\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842448 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkssc\" (UniqueName: \"kubernetes.io/projected/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-kube-api-access-hkssc\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842448 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842542 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-crio-socket\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842630 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-data-volume\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.842861 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.842834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.844497 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.844447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.877822 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.877790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkssc\" (UniqueName: \"kubernetes.io/projected/48bd3eb6-56ce-4dd2-bb15-e4306c266c1f-kube-api-access-hkssc\") pod \"insights-runtime-extractor-gtqhs\" (UID: \"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f\") " pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:34.916499 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.916468 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" Jun 08 12:52:34.923808 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:34.923782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" Jun 08 12:52:35.025710 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:35.025679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gtqhs" Jun 08 12:52:35.048435 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:35.048373 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk"] Jun 08 12:52:35.053033 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:35.053007 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da5998a_832c_4c0c_a1e1_401b3a39de46.slice/crio-43fbe8705edbf10e1fba55ac0c89672e1e06044e8e6cf6972bb75164721f15a3 WatchSource:0}: Error finding container 43fbe8705edbf10e1fba55ac0c89672e1e06044e8e6cf6972bb75164721f15a3: Status 404 returned error can't find the container with id 43fbe8705edbf10e1fba55ac0c89672e1e06044e8e6cf6972bb75164721f15a3 Jun 08 12:52:35.082970 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:35.082934 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg"] Jun 08 12:52:35.086937 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:35.086904 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod270edbb7_951b_4e01_885d_fb32087514c0.slice/crio-c2e201f913a5da20347b16d467a7d3a913ef771ebbcf8d1d4d1a02d1bd32a9e6 WatchSource:0}: Error finding container c2e201f913a5da20347b16d467a7d3a913ef771ebbcf8d1d4d1a02d1bd32a9e6: Status 404 returned error can't find the container with id c2e201f913a5da20347b16d467a7d3a913ef771ebbcf8d1d4d1a02d1bd32a9e6 Jun 08 12:52:35.116085 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:35.116041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" event={"ID":"270edbb7-951b-4e01-885d-fb32087514c0","Type":"ContainerStarted","Data":"c2e201f913a5da20347b16d467a7d3a913ef771ebbcf8d1d4d1a02d1bd32a9e6"} Jun 08 12:52:35.117249 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:35.117213 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" event={"ID":"3da5998a-832c-4c0c-a1e1-401b3a39de46","Type":"ContainerStarted","Data":"43fbe8705edbf10e1fba55ac0c89672e1e06044e8e6cf6972bb75164721f15a3"} Jun 08 12:52:35.166141 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:35.166106 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gtqhs"] Jun 08 12:52:35.169308 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:35.169282 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48bd3eb6_56ce_4dd2_bb15_e4306c266c1f.slice/crio-013b3b59b58709f8fa6d3b4368f76672bfc6e5689dc26f5ebc5bb85199d9ec8f WatchSource:0}: Error finding container 013b3b59b58709f8fa6d3b4368f76672bfc6e5689dc26f5ebc5bb85199d9ec8f: Status 404 returned error can't find the container with id 013b3b59b58709f8fa6d3b4368f76672bfc6e5689dc26f5ebc5bb85199d9ec8f Jun 08 12:52:36.125372 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:36.125334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtqhs" event={"ID":"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f","Type":"ContainerStarted","Data":"7037fa0a29b0936fb5e96ab4515f5ae15fad740531098803a10e75722de78158"} Jun 08 12:52:36.125835 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:36.125409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtqhs" event={"ID":"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f","Type":"ContainerStarted","Data":"693c71719e75d2820d374635f06c39d0ea85875cff03af836a3298589df041d5"} Jun 08 12:52:36.125835 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:36.125440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtqhs" event={"ID":"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f","Type":"ContainerStarted","Data":"013b3b59b58709f8fa6d3b4368f76672bfc6e5689dc26f5ebc5bb85199d9ec8f"} Jun 08 12:52:37.096182 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:37.096150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fc68d" Jun 08 12:52:39.582254 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.582211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:39.584699 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.584679 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:52:39.595118 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.595085 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb-metrics-certs\") pod \"network-metrics-daemon-pbzb2\" (UID: \"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb\") " pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:39.682632 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.682594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:39.682816 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.682660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:39.685301 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.685275 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:52:39.685414 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.685277 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:52:39.695232 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.695202 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:52:39.695501 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.695480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25f5a502-d1dd-47d6-9c52-3ea7d7afe176-original-pull-secret\") pod \"global-pull-secret-syncer-kv2l6\" (UID: \"25f5a502-d1dd-47d6-9c52-3ea7d7afe176\") " pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:39.705860 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.705834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmcjk\" (UniqueName: \"kubernetes.io/projected/d8e0b1bd-2cd4-405a-b8e3-29d7c1500974-kube-api-access-hmcjk\") pod \"network-check-target-xjcvp\" (UID: \"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974\") " pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:39.861596 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.861515 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kv2l6" Jun 08 12:52:39.869227 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.869206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xzgqm\"" Jun 08 12:52:39.873045 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.873017 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4jlgv\"" Jun 08 12:52:39.877785 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.877766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pbzb2" Jun 08 12:52:39.881258 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:39.881062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:40.830387 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:40.829826 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pbzb2"] Jun 08 12:52:40.835536 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:40.835402 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a608f3_1e5a_4ce3_b13c_dd0506c1b5cb.slice/crio-99974ec9fa53253d59632688e7fb5fb07958256297320b07277c0bf447888a65 WatchSource:0}: Error finding container 99974ec9fa53253d59632688e7fb5fb07958256297320b07277c0bf447888a65: Status 404 returned error can't find the container with id 99974ec9fa53253d59632688e7fb5fb07958256297320b07277c0bf447888a65 Jun 08 12:52:40.855644 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:40.855343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xjcvp"] Jun 08 12:52:40.858226 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:40.858172 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e0b1bd_2cd4_405a_b8e3_29d7c1500974.slice/crio-e50f0214c065e115859905fed9cd91717081129677dfe8b9cb82e91da4ea335c WatchSource:0}: Error finding container e50f0214c065e115859905fed9cd91717081129677dfe8b9cb82e91da4ea335c: Status 404 returned error can't find the container with id e50f0214c065e115859905fed9cd91717081129677dfe8b9cb82e91da4ea335c Jun 08 12:52:40.889968 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:40.889943 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kv2l6"] Jun 08 12:52:40.893185 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:40.893154 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f5a502_d1dd_47d6_9c52_3ea7d7afe176.slice/crio-787ca55cadeb22130bddf6cd41290a131d5ef11f21e12e3ffeacc7ce3b5b4655 WatchSource:0}: Error finding container 787ca55cadeb22130bddf6cd41290a131d5ef11f21e12e3ffeacc7ce3b5b4655: Status 404 returned error can't find the container with id 787ca55cadeb22130bddf6cd41290a131d5ef11f21e12e3ffeacc7ce3b5b4655 Jun 08 12:52:41.143174 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.143141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xjcvp" event={"ID":"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974","Type":"ContainerStarted","Data":"e50f0214c065e115859905fed9cd91717081129677dfe8b9cb82e91da4ea335c"} Jun 08 12:52:41.144211 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.144184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbzb2" event={"ID":"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb","Type":"ContainerStarted","Data":"99974ec9fa53253d59632688e7fb5fb07958256297320b07277c0bf447888a65"} Jun 08 12:52:41.145984 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.145955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" event={"ID":"270edbb7-951b-4e01-885d-fb32087514c0","Type":"ContainerStarted","Data":"0165562f8d38e5d2a8c088e86236b04ca5ffa2cbff66b7ac573bf78db3d89281"} Jun 08 12:52:41.146080 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.145990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" event={"ID":"270edbb7-951b-4e01-885d-fb32087514c0","Type":"ContainerStarted","Data":"27f255b784190c10df50029524d4d0df9db7fb30198313ec2718fbf8347679b0"} Jun 08 12:52:41.146080 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.146007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" event={"ID":"270edbb7-951b-4e01-885d-fb32087514c0","Type":"ContainerStarted","Data":"c476e78471a840ac84a0e466eaf3a6da5a91318652521dba1d1638a97d22373e"} Jun 08 12:52:41.147429 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.147400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" event={"ID":"3da5998a-832c-4c0c-a1e1-401b3a39de46","Type":"ContainerStarted","Data":"81e39634e54ef063c4304f69f062b9226e2afa1661de8945cdc34f0416d09afd"} Jun 08 12:52:41.149383 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.149363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtqhs" event={"ID":"48bd3eb6-56ce-4dd2-bb15-e4306c266c1f","Type":"ContainerStarted","Data":"615a2744d66e5bfb56ab18773ce09bd3b29ea6aa0ed262f09fad74381400cd08"} Jun 08 12:52:41.150393 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.150373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kv2l6" event={"ID":"25f5a502-d1dd-47d6-9c52-3ea7d7afe176","Type":"ContainerStarted","Data":"787ca55cadeb22130bddf6cd41290a131d5ef11f21e12e3ffeacc7ce3b5b4655"} Jun 08 12:52:41.173172 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.173127 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5568d5f799-wprrg" podStartSLOduration=1.517547123 podStartE2EDuration="7.173115095s" totalImagesPullingTime="5.655567972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:41.170407955 +0000 UTC m=+67.715807092" watchObservedRunningTime="2026-06-08 12:52:41.173115095 +0000 UTC m=+67.718514215" Jun 08 12:52:41.194014 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.193921 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gtqhs" podStartSLOduration=1.790975317 podStartE2EDuration="7.193904013s" totalImagesPullingTime="5.402928696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:52:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:41.193285316 +0000 UTC m=+67.738684434" watchObservedRunningTime="2026-06-08 12:52:41.193904013 +0000 UTC m=+67.739303122" Jun 08 12:52:41.217593 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:41.217499 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-669994d688-6lqqk" podStartSLOduration=1.6061764570000001 podStartE2EDuration="7.217477656s" totalImagesPullingTime="5.611301199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:41.216650522 +0000 UTC m=+67.762049641" watchObservedRunningTime="2026-06-08 12:52:41.217477656 +0000 UTC m=+67.762876774" Jun 08 12:52:42.158730 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:42.158662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbzb2" event={"ID":"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb","Type":"ContainerStarted","Data":"a347ae1c57937ae93d74bc9910500e3a53e5a17847c5cdd87578c1de500b80f2"} Jun 08 12:52:43.164609 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:43.164568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pbzb2" event={"ID":"f9a608f3-1e5a-4ce3-b13c-dd0506c1b5cb","Type":"ContainerStarted","Data":"ef3da1106e9146c234a61ed6a1b1ff1a2cc4999cbaa8d5dd96c2d5406d26cd3c"} Jun 08 12:52:46.177731 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.177686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kv2l6" event={"ID":"25f5a502-d1dd-47d6-9c52-3ea7d7afe176","Type":"ContainerStarted","Data":"40b3e1f7a14297ca4d5aabbab6cede25a555c6906a2d741f387e026a5ba59a89"} Jun 08 12:52:46.179093 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.179069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xjcvp" event={"ID":"d8e0b1bd-2cd4-405a-b8e3-29d7c1500974","Type":"ContainerStarted","Data":"120e6ee482a7ec880ca4056a8817feb511cacb74b20df833d7d938b7da54f124"} Jun 08 12:52:46.179228 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.179123 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:52:46.223377 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.223317 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pbzb2" podStartSLOduration=72.078208335 podStartE2EDuration="1m13.223296645s" totalImagesPullingTime="1.14508831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:43.221940639 +0000 UTC m=+69.767339758" watchObservedRunningTime="2026-06-08 12:52:46.223296645 +0000 UTC m=+72.768695765" Jun 08 12:52:46.260741 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.260669 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xjcvp" podStartSLOduration=67.82078185 podStartE2EDuration="1m12.260645665s" totalImagesPullingTime="4.439863815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:46.260013387 +0000 UTC m=+72.805412506" watchObservedRunningTime="2026-06-08 12:52:46.260645665 +0000 UTC m=+72.806044992" Jun 08 12:52:46.261045 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.261019 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kv2l6" podStartSLOduration=67.851841589 podStartE2EDuration="1m12.261010545s" totalImagesPullingTime="4.409168956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:46.223603551 +0000 UTC m=+72.769002670" watchObservedRunningTime="2026-06-08 12:52:46.261010545 +0000 UTC m=+72.806409683" Jun 08 12:52:46.537055 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.536960 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pbmr5"] Jun 08 12:52:46.540200 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.540175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.542494 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.542470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 12:52:46.542616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.542495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 12:52:46.542616 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.542546 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 12:52:46.551219 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.551196 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 12:52:46.552671 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.552652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mpbnz\"" Jun 08 12:52:46.552891 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.552878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 12:52:46.552967 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.552948 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 12:52:46.644492 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-root\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644492 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds7qt\" (UniqueName: \"kubernetes.io/projected/a4779105-24a8-4080-9c20-0f13aef5e508-kube-api-access-ds7qt\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644717 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-wtmp\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644717 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-sys\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644717 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-textfile\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644717 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4779105-24a8-4080-9c20-0f13aef5e508-metrics-client-ca\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644717 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644671 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-accelerators-collector-config\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644717 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-tls\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.644898 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.644740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746021 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.745977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4779105-24a8-4080-9c20-0f13aef5e508-metrics-client-ca\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746021 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-accelerators-collector-config\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-tls\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-root\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746142 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds7qt\" (UniqueName: \"kubernetes.io/projected/a4779105-24a8-4080-9c20-0f13aef5e508-kube-api-access-ds7qt\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746211 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-root\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-wtmp\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-sys\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-textfile\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-sys\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-wtmp\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746827 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-textfile\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746827 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4779105-24a8-4080-9c20-0f13aef5e508-metrics-client-ca\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.746903 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.746801 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-accelerators-collector-config\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.748613 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.748595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.748711 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.748690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a4779105-24a8-4080-9c20-0f13aef5e508-node-exporter-tls\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.759538 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.759508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds7qt\" (UniqueName: \"kubernetes.io/projected/a4779105-24a8-4080-9c20-0f13aef5e508-kube-api-access-ds7qt\") pod \"node-exporter-pbmr5\" (UID: \"a4779105-24a8-4080-9c20-0f13aef5e508\") " pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.849138 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:46.849107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pbmr5" Jun 08 12:52:46.860035 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:46.860008 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4779105_24a8_4080_9c20_0f13aef5e508.slice/crio-6568032a37c59c2ad06cb7338213b988c59bffe25066e467e806ac157076497c WatchSource:0}: Error finding container 6568032a37c59c2ad06cb7338213b988c59bffe25066e467e806ac157076497c: Status 404 returned error can't find the container with id 6568032a37c59c2ad06cb7338213b988c59bffe25066e467e806ac157076497c Jun 08 12:52:47.183334 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:47.183226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbmr5" event={"ID":"a4779105-24a8-4080-9c20-0f13aef5e508","Type":"ContainerStarted","Data":"6568032a37c59c2ad06cb7338213b988c59bffe25066e467e806ac157076497c"} Jun 08 12:52:48.188963 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:48.188929 2578 generic.go:356] "Generic (PLEG): container finished" podID="a4779105-24a8-4080-9c20-0f13aef5e508" containerID="bb60f9b0616994dd7b7c71b8d6728a6de6394d11927dd0571a829a810ba8a272" exitCode=0 Jun 08 12:52:48.189336 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:48.189017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbmr5" event={"ID":"a4779105-24a8-4080-9c20-0f13aef5e508","Type":"ContainerDied","Data":"bb60f9b0616994dd7b7c71b8d6728a6de6394d11927dd0571a829a810ba8a272"} Jun 08 12:52:49.195294 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:49.195260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbmr5" event={"ID":"a4779105-24a8-4080-9c20-0f13aef5e508","Type":"ContainerStarted","Data":"da16cfdb1f8b530d7f75a35931d678c2f2c238de762bc4e000e9cc8922ac1165"} Jun 08 12:52:49.195645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:49.195314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pbmr5" event={"ID":"a4779105-24a8-4080-9c20-0f13aef5e508","Type":"ContainerStarted","Data":"bf06c3f6388fc138c569b17bf4196fb4f8961b12be274b54d7eab3cb2fd5c445"} Jun 08 12:52:50.622709 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.622660 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pbmr5" podStartSLOduration=3.679741826 podStartE2EDuration="4.62263908s" totalImagesPullingTime="875.723327ms" totalInitContainerRuntime="67.173927ms" isStatefulPod=true podCreationTimestamp="2026-06-08 12:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:49.249463705 +0000 UTC m=+75.794862818" watchObservedRunningTime="2026-06-08 12:52:50.62263908 +0000 UTC m=+77.168038225" Jun 08 12:52:50.623103 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.623089 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-857bf9b6ff-g68mj"] Jun 08 12:52:50.626470 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.626453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.629899 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.629881 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 12:52:50.630032 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.629884 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 12:52:50.630599 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.630584 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 12:52:50.630955 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.630941 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 12:52:50.631946 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.631926 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 12:52:50.632110 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.632097 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2g4hc\"" Jun 08 12:52:50.632974 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.632954 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8k1dmbq46spj6\"" Jun 08 12:52:50.641124 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.641103 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-857bf9b6ff-g68mj"] Jun 08 12:52:50.674524 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-tls\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674524 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-grpc-tls\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/434c44f5-8266-4239-b597-3d7ee70633ca-metrics-client-ca\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jm4r\" (UniqueName: \"kubernetes.io/projected/434c44f5-8266-4239-b597-3d7ee70633ca-kube-api-access-7jm4r\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.674728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.674704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775199 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jm4r\" (UniqueName: \"kubernetes.io/projected/434c44f5-8266-4239-b597-3d7ee70633ca-kube-api-access-7jm4r\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775362 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775362 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-tls\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775467 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775467 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775467 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775646 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-grpc-tls\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.775701 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.775667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/434c44f5-8266-4239-b597-3d7ee70633ca-metrics-client-ca\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.776617 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.776581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/434c44f5-8266-4239-b597-3d7ee70633ca-metrics-client-ca\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.778131 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.778106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.778318 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.778296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-grpc-tls\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.778407 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.778309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.778467 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.778413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.778525 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.778485 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.778583 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.778535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/434c44f5-8266-4239-b597-3d7ee70633ca-secret-thanos-querier-tls\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.784173 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.784154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jm4r\" (UniqueName: \"kubernetes.io/projected/434c44f5-8266-4239-b597-3d7ee70633ca-kube-api-access-7jm4r\") pod \"thanos-querier-857bf9b6ff-g68mj\" (UID: \"434c44f5-8266-4239-b597-3d7ee70633ca\") " pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:50.935490 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:50.935396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:51.125016 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:51.124983 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-857bf9b6ff-g68mj"] Jun 08 12:52:51.127674 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:51.127639 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434c44f5_8266_4239_b597_3d7ee70633ca.slice/crio-6dcb714e5e8822c06423806adccec4b9be35f132fae0a6522dad7ad2cdd52642 WatchSource:0}: Error finding container 6dcb714e5e8822c06423806adccec4b9be35f132fae0a6522dad7ad2cdd52642: Status 404 returned error can't find the container with id 6dcb714e5e8822c06423806adccec4b9be35f132fae0a6522dad7ad2cdd52642 Jun 08 12:52:51.207024 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:51.206922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"6dcb714e5e8822c06423806adccec4b9be35f132fae0a6522dad7ad2cdd52642"} Jun 08 12:52:54.219716 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:54.219673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"2116d867fe85adbb6fc2660595d7709dd1674ead76e092e61b829969ee6c03ca"} Jun 08 12:52:54.220099 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:54.219804 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"6e2085764bda97af4ada254170496245dbadf2c9486bf16675d9c3cc70a87bdd"} Jun 08 12:52:54.220099 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:54.219850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"add3690b96e358ec162c95fb54bd057c4f9fcc179494e18c6e94df7d5a19f24a"} Jun 08 12:52:55.225530 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.225489 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"d8d4d5d4f0fb0c06432053922fe5b236e92f4f8a963a65de5af6ff5fbe48ad2a"} Jun 08 12:52:55.225886 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.225552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"5da0996a4634e179bf8e7b5fabd1dccb8e320945aec3ab5aba09c6855e5cbb1c"} Jun 08 12:52:55.225886 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.225578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" event={"ID":"434c44f5-8266-4239-b597-3d7ee70633ca","Type":"ContainerStarted","Data":"136b0f74ce939ce9336a63fcd31b914422f8ac08fe7724b2b3d188ae2d8b3c3d"} Jun 08 12:52:55.225886 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.225656 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:52:55.248930 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.248864 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" podStartSLOduration=2.200544328 podStartE2EDuration="5.248847691s" totalImagesPullingTime="3.048303363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:55.24759259 +0000 UTC m=+81.792991722" watchObservedRunningTime="2026-06-08 12:52:55.248847691 +0000 UTC m=+81.794246840" Jun 08 12:52:55.593049 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.593020 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c977656f-7whm5"] Jun 08 12:52:55.596949 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.596932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.599345 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 12:52:55.599345 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599333 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 12:52:55.599516 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 12:52:55.599516 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2sdql\"" Jun 08 12:52:55.599662 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 12:52:55.599715 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 12:52:55.599757 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599649 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 12:52:55.599757 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.599652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 12:52:55.605313 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.605294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 12:52:55.608817 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.608793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c977656f-7whm5"] Jun 08 12:52:55.720128 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-oauth-serving-cert\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.720350 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-trusted-ca-bundle\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.720350 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-oauth-config\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.720350 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-serving-cert\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.720350 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-console-config\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.720545 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-service-ca\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.720545 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.720433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fb6l\" (UniqueName: \"kubernetes.io/projected/df92f08c-692a-4882-aa98-8df13d519be0-kube-api-access-5fb6l\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821279 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fb6l\" (UniqueName: \"kubernetes.io/projected/df92f08c-692a-4882-aa98-8df13d519be0-kube-api-access-5fb6l\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821417 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-oauth-serving-cert\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821417 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-trusted-ca-bundle\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821417 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-oauth-config\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821578 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-serving-cert\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821578 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-console-config\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.821578 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.821495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-service-ca\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.822155 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.822129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-oauth-serving-cert\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.822155 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.822151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-trusted-ca-bundle\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.822374 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.822134 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-console-config\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.822374 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.822223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-service-ca\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.823986 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.823959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-oauth-config\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.824075 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.824005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-serving-cert\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.831942 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.831919 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fb6l\" (UniqueName: \"kubernetes.io/projected/df92f08c-692a-4882-aa98-8df13d519be0-kube-api-access-5fb6l\") pod \"console-74c977656f-7whm5\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:55.907211 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:55.907123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:52:56.032700 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:56.032672 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c977656f-7whm5"] Jun 08 12:52:56.035667 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:52:56.035643 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf92f08c_692a_4882_aa98_8df13d519be0.slice/crio-3385d05b5100794e715679acb963a158733dad7578b04ea041696f8b00dc06e6 WatchSource:0}: Error finding container 3385d05b5100794e715679acb963a158733dad7578b04ea041696f8b00dc06e6: Status 404 returned error can't find the container with id 3385d05b5100794e715679acb963a158733dad7578b04ea041696f8b00dc06e6 Jun 08 12:52:56.229865 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:56.229775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c977656f-7whm5" event={"ID":"df92f08c-692a-4882-aa98-8df13d519be0","Type":"ContainerStarted","Data":"3385d05b5100794e715679acb963a158733dad7578b04ea041696f8b00dc06e6"} Jun 08 12:52:59.243996 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:59.243954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c977656f-7whm5" event={"ID":"df92f08c-692a-4882-aa98-8df13d519be0","Type":"ContainerStarted","Data":"d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be"} Jun 08 12:52:59.262732 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:52:59.262683 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c977656f-7whm5" podStartSLOduration=1.783951948 podStartE2EDuration="4.262668447s" totalImagesPullingTime="2.478716499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:52:59.260904511 +0000 UTC m=+85.806303632" watchObservedRunningTime="2026-06-08 12:52:59.262668447 +0000 UTC m=+85.808067623" Jun 08 12:53:01.236285 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:01.236072 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-857bf9b6ff-g68mj" Jun 08 12:53:05.907999 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:05.907961 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:53:05.908402 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:05.908039 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:53:05.912645 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:05.912617 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:53:06.271926 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:06.271833 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:53:14.900376 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:14.900341 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c977656f-7whm5"] Jun 08 12:53:17.186216 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:17.186188 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xjcvp" Jun 08 12:53:39.923648 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:39.923581 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74c977656f-7whm5" podUID="df92f08c-692a-4882-aa98-8df13d519be0" containerName="console" containerID="cri-o://d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be" gracePeriod=15 Jun 08 12:53:40.168448 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.168425 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:53:40.251720 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251636 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-oauth-serving-cert\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.251720 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251676 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-console-config\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.251946 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251744 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-trusted-ca-bundle\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.251946 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251760 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-service-ca\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.251946 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251783 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fb6l\" (UniqueName: \"kubernetes.io/projected/df92f08c-692a-4882-aa98-8df13d519be0-kube-api-access-5fb6l\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.251946 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251815 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-serving-cert\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.251946 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.251832 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-oauth-config\") pod \"df92f08c-692a-4882-aa98-8df13d519be0\" (UID: \"df92f08c-692a-4882-aa98-8df13d519be0\") " Jun 08 12:53:40.252932 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.252391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-console-config" (OuterVolumeSpecName: "console-config") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:40.252932 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.252528 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:40.252932 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.252411 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:40.252932 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.252600 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-service-ca" (OuterVolumeSpecName: "service-ca") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:53:40.257511 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.256388 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df92f08c-692a-4882-aa98-8df13d519be0-kube-api-access-5fb6l" (OuterVolumeSpecName: "kube-api-access-5fb6l") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "kube-api-access-5fb6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:53:40.257511 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.256404 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:40.257511 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.256635 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "df92f08c-692a-4882-aa98-8df13d519be0" (UID: "df92f08c-692a-4882-aa98-8df13d519be0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:53:40.353523 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353492 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-trusted-ca-bundle\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.353523 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353519 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-service-ca\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.353679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353529 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fb6l\" (UniqueName: \"kubernetes.io/projected/df92f08c-692a-4882-aa98-8df13d519be0-kube-api-access-5fb6l\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.353679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353538 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-serving-cert\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.353679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353546 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df92f08c-692a-4882-aa98-8df13d519be0-console-oauth-config\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.353679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353555 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-oauth-serving-cert\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.353679 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.353562 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df92f08c-692a-4882-aa98-8df13d519be0-console-config\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 12:53:40.382826 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.382790 2578 generic.go:356] "Generic (PLEG): container finished" podID="df92f08c-692a-4882-aa98-8df13d519be0" containerID="d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be" exitCode=0 Jun 08 12:53:40.382972 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.382840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c977656f-7whm5" event={"ID":"df92f08c-692a-4882-aa98-8df13d519be0","Type":"ContainerDied","Data":"d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be"} Jun 08 12:53:40.382972 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.382861 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c977656f-7whm5" Jun 08 12:53:40.382972 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.382913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c977656f-7whm5" event={"ID":"df92f08c-692a-4882-aa98-8df13d519be0","Type":"ContainerDied","Data":"3385d05b5100794e715679acb963a158733dad7578b04ea041696f8b00dc06e6"} Jun 08 12:53:40.382972 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.382936 2578 scope.go:117] "RemoveContainer" containerID="d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be" Jun 08 12:53:40.391510 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.391489 2578 scope.go:117] "RemoveContainer" containerID="d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be" Jun 08 12:53:40.391788 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:53:40.391768 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be\": container with ID starting with d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be not found: ID does not exist" containerID="d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be" Jun 08 12:53:40.391831 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.391797 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be"} err="failed to get container status \"d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be\": rpc error: code = NotFound desc = could not find container \"d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be\": container with ID starting with d7c8a63085fe35ced98994f5deeaecb7da7ca981386cca0a8b72c4036b3014be not found: ID does not exist" Jun 08 12:53:40.404542 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.404512 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c977656f-7whm5"] Jun 08 12:53:40.410705 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:40.410684 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c977656f-7whm5"] Jun 08 12:53:41.853597 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:53:41.853565 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df92f08c-692a-4882-aa98-8df13d519be0" path="/var/lib/kubelet/pods/df92f08c-692a-4882-aa98-8df13d519be0/volumes" Jun 08 12:55:23.836778 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.836739 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc"] Jun 08 12:55:23.837326 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.837099 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df92f08c-692a-4882-aa98-8df13d519be0" containerName="console" Jun 08 12:55:23.837326 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.837116 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df92f08c-692a-4882-aa98-8df13d519be0" containerName="console" Jun 08 12:55:23.837326 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.837176 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="df92f08c-692a-4882-aa98-8df13d519be0" containerName="console" Jun 08 12:55:23.839960 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.839941 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:23.842168 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.842147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 12:55:23.842311 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.842150 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rz2mn\"" Jun 08 12:55:23.842311 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.842151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 12:55:23.846913 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.846889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc"] Jun 08 12:55:23.885518 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.885484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pjcnc\" (UID: \"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:23.885518 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.885521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2v9w\" (UniqueName: \"kubernetes.io/projected/f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef-kube-api-access-m2v9w\") pod \"cert-manager-cainjector-5d99449ffd-pjcnc\" (UID: \"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:23.985922 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.985886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pjcnc\" (UID: \"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:23.985922 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.985926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2v9w\" (UniqueName: \"kubernetes.io/projected/f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef-kube-api-access-m2v9w\") pod \"cert-manager-cainjector-5d99449ffd-pjcnc\" (UID: \"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:23.993901 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.993874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pjcnc\" (UID: \"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:23.994038 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:23.994005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2v9w\" (UniqueName: \"kubernetes.io/projected/f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef-kube-api-access-m2v9w\") pod \"cert-manager-cainjector-5d99449ffd-pjcnc\" (UID: \"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:24.149074 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:24.148970 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" Jun 08 12:55:24.280695 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:55:24.280649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9c9cc81_42ab_455d_9f8c_c8ae61c2dfef.slice/crio-6c2b120890661caee789b82e756787addc626fa914beb3ec294a69f2ac8cabdb WatchSource:0}: Error finding container 6c2b120890661caee789b82e756787addc626fa914beb3ec294a69f2ac8cabdb: Status 404 returned error can't find the container with id 6c2b120890661caee789b82e756787addc626fa914beb3ec294a69f2ac8cabdb Jun 08 12:55:24.281341 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:24.281307 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc"] Jun 08 12:55:24.744368 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:24.744336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" event={"ID":"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef","Type":"ContainerStarted","Data":"6c2b120890661caee789b82e756787addc626fa914beb3ec294a69f2ac8cabdb"} Jun 08 12:55:26.752481 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:26.752441 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" event={"ID":"f9c9cc81-42ab-455d-9f8c-c8ae61c2dfef","Type":"ContainerStarted","Data":"43312bd6b466e3596711301bba0531a94ac6222ae587adca18f4255c6f41ff14"} Jun 08 12:55:26.768786 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:26.768736 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pjcnc" podStartSLOduration=1.421024791 podStartE2EDuration="3.768717587s" totalImagesPullingTime="2.347692796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:26.767407468 +0000 UTC m=+233.312806592" watchObservedRunningTime="2026-06-08 12:55:26.768717587 +0000 UTC m=+233.314116706" Jun 08 12:55:52.928490 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.928407 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz"] Jun 08 12:55:52.931572 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.931552 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:52.935756 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.935737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 12:55:52.935839 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.935762 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k5jxm\"" Jun 08 12:55:52.935839 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.935782 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:55:52.937923 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.937904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 12:55:52.938709 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.938693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:55:52.967887 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.967833 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz"] Jun 08 12:55:52.996328 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.996303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vccmh\" (UniqueName: \"kubernetes.io/projected/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-kube-api-access-vccmh\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:52.996452 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.996335 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-manifests\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:52.996452 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.996354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:52.996452 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.996406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:52.996572 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:52.996485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-tmp\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.097285 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.097231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-tmp\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.097458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.097303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vccmh\" (UniqueName: \"kubernetes.io/projected/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-kube-api-access-vccmh\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.097458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.097324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-manifests\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.097458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.097341 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.097458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.097370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.097734 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.097713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-manifests\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.099619 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.099585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-tmp\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.099709 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.099634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.099709 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.099684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.108320 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.108301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vccmh\" (UniqueName: \"kubernetes.io/projected/ffd3e19a-fd37-4011-b0ce-88efe3ae798f-kube-api-access-vccmh\") pod \"opendatahub-operator-controller-manager-85bcc7b555-6xfwz\" (UID: \"ffd3e19a-fd37-4011-b0ce-88efe3ae798f\") " pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.241207 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.241121 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:53.391387 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.391363 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz"] Jun 08 12:55:53.392968 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:55:53.392943 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd3e19a_fd37_4011_b0ce_88efe3ae798f.slice/crio-87f5db19682265267680b48b90dc81ab016a9f30603ae9f83d5d64e1a7885aa3 WatchSource:0}: Error finding container 87f5db19682265267680b48b90dc81ab016a9f30603ae9f83d5d64e1a7885aa3: Status 404 returned error can't find the container with id 87f5db19682265267680b48b90dc81ab016a9f30603ae9f83d5d64e1a7885aa3 Jun 08 12:55:53.844677 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:53.844644 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" event={"ID":"ffd3e19a-fd37-4011-b0ce-88efe3ae798f","Type":"ContainerStarted","Data":"87f5db19682265267680b48b90dc81ab016a9f30603ae9f83d5d64e1a7885aa3"} Jun 08 12:55:56.858603 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:56.858553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" event={"ID":"ffd3e19a-fd37-4011-b0ce-88efe3ae798f","Type":"ContainerStarted","Data":"cde56a03f2d04ddb88b474c81c6cd84fd888917f4cca7e98bd5b9842c2945a26"} Jun 08 12:55:57.862913 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:57.862881 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffd3e19a-fd37-4011-b0ce-88efe3ae798f" containerID="cde56a03f2d04ddb88b474c81c6cd84fd888917f4cca7e98bd5b9842c2945a26" exitCode=0 Jun 08 12:55:57.863396 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:57.862932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" event={"ID":"ffd3e19a-fd37-4011-b0ce-88efe3ae798f","Type":"ContainerDied","Data":"cde56a03f2d04ddb88b474c81c6cd84fd888917f4cca7e98bd5b9842c2945a26"} Jun 08 12:55:58.873588 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:58.873546 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" event={"ID":"ffd3e19a-fd37-4011-b0ce-88efe3ae798f","Type":"ContainerStarted","Data":"cb996de8fd59f4f8f8aaa4901da34a6272337b2e33d2e64236b8cd7e62c1955c"} Jun 08 12:55:58.874061 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:58.873647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:55:58.894832 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:55:58.894779 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" podStartSLOduration=2.95777018 podStartE2EDuration="6.894765064s" totalImagesPullingTime="2.981744987s" totalInitContainerRuntime="955.249897ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:55:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:55:58.893146612 +0000 UTC m=+265.438545730" watchObservedRunningTime="2026-06-08 12:55:58.894765064 +0000 UTC m=+265.440164183" Jun 08 12:56:09.878923 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:09.878892 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85bcc7b555-6xfwz" Jun 08 12:56:12.353909 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.353874 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69996bcc67-6drmd"] Jun 08 12:56:12.361986 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.361962 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.365653 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.365632 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 12:56:12.366309 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.366292 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 12:56:12.366398 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.366308 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 12:56:12.366398 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.366376 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 12:56:12.377252 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.377215 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69996bcc67-6drmd"] Jun 08 12:56:12.441175 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.441140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496fd6ed-6474-4105-bdb0-3578cb976075-tmp\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.441344 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.441184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/496fd6ed-6474-4105-bdb0-3578cb976075-tls-certs\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.441344 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.441205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wt55\" (UniqueName: \"kubernetes.io/projected/496fd6ed-6474-4105-bdb0-3578cb976075-kube-api-access-8wt55\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.542207 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.542171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/496fd6ed-6474-4105-bdb0-3578cb976075-tls-certs\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.542207 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.542205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wt55\" (UniqueName: \"kubernetes.io/projected/496fd6ed-6474-4105-bdb0-3578cb976075-kube-api-access-8wt55\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.542433 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.542263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496fd6ed-6474-4105-bdb0-3578cb976075-tmp\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.544488 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.544454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/496fd6ed-6474-4105-bdb0-3578cb976075-tmp\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.544724 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.544702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/496fd6ed-6474-4105-bdb0-3578cb976075-tls-certs\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.566613 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.566583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wt55\" (UniqueName: \"kubernetes.io/projected/496fd6ed-6474-4105-bdb0-3578cb976075-kube-api-access-8wt55\") pod \"kube-auth-proxy-69996bcc67-6drmd\" (UID: \"496fd6ed-6474-4105-bdb0-3578cb976075\") " pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.670685 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.670605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" Jun 08 12:56:12.801166 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.801141 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69996bcc67-6drmd"] Jun 08 12:56:12.803623 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:56:12.803589 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496fd6ed_6474_4105_bdb0_3578cb976075.slice/crio-1e7e71563e1d999c87e425eb88e57ba8046a27dff8db3dd9950dbff4dad09b53 WatchSource:0}: Error finding container 1e7e71563e1d999c87e425eb88e57ba8046a27dff8db3dd9950dbff4dad09b53: Status 404 returned error can't find the container with id 1e7e71563e1d999c87e425eb88e57ba8046a27dff8db3dd9950dbff4dad09b53 Jun 08 12:56:12.922565 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:12.922479 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" event={"ID":"496fd6ed-6474-4105-bdb0-3578cb976075","Type":"ContainerStarted","Data":"1e7e71563e1d999c87e425eb88e57ba8046a27dff8db3dd9950dbff4dad09b53"} Jun 08 12:56:13.081841 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.081805 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nw77q"] Jun 08 12:56:13.086149 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.086132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.088731 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.088705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 12:56:13.088873 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.088745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nvpwl\"" Jun 08 12:56:13.098526 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.098504 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nw77q"] Jun 08 12:56:13.147765 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.147727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c118ed4e-941b-483d-9082-bcab6e5ec6e6-tls-certs\") pod \"model-serving-api-5dd488fc48-nw77q\" (UID: \"c118ed4e-941b-483d-9082-bcab6e5ec6e6\") " pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.147922 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.147773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntgp\" (UniqueName: \"kubernetes.io/projected/c118ed4e-941b-483d-9082-bcab6e5ec6e6-kube-api-access-rntgp\") pod \"model-serving-api-5dd488fc48-nw77q\" (UID: \"c118ed4e-941b-483d-9082-bcab6e5ec6e6\") " pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.248217 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.248141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c118ed4e-941b-483d-9082-bcab6e5ec6e6-tls-certs\") pod \"model-serving-api-5dd488fc48-nw77q\" (UID: \"c118ed4e-941b-483d-9082-bcab6e5ec6e6\") " pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.248217 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.248186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntgp\" (UniqueName: \"kubernetes.io/projected/c118ed4e-941b-483d-9082-bcab6e5ec6e6-kube-api-access-rntgp\") pod \"model-serving-api-5dd488fc48-nw77q\" (UID: \"c118ed4e-941b-483d-9082-bcab6e5ec6e6\") " pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.250596 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.250577 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c118ed4e-941b-483d-9082-bcab6e5ec6e6-tls-certs\") pod \"model-serving-api-5dd488fc48-nw77q\" (UID: \"c118ed4e-941b-483d-9082-bcab6e5ec6e6\") " pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.260720 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.260691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntgp\" (UniqueName: \"kubernetes.io/projected/c118ed4e-941b-483d-9082-bcab6e5ec6e6-kube-api-access-rntgp\") pod \"model-serving-api-5dd488fc48-nw77q\" (UID: \"c118ed4e-941b-483d-9082-bcab6e5ec6e6\") " pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.398189 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.398154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:13.549168 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.549138 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-nw77q"] Jun 08 12:56:13.552709 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:56:13.552683 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc118ed4e_941b_483d_9082_bcab6e5ec6e6.slice/crio-ede9af82d36f9dbef9934957e4982d9dab0c570c3e7522833fb4e7a66bcd0ea5 WatchSource:0}: Error finding container ede9af82d36f9dbef9934957e4982d9dab0c570c3e7522833fb4e7a66bcd0ea5: Status 404 returned error can't find the container with id ede9af82d36f9dbef9934957e4982d9dab0c570c3e7522833fb4e7a66bcd0ea5 Jun 08 12:56:13.927847 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:13.927759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" event={"ID":"c118ed4e-941b-483d-9082-bcab6e5ec6e6","Type":"ContainerStarted","Data":"ede9af82d36f9dbef9934957e4982d9dab0c570c3e7522833fb4e7a66bcd0ea5"} Jun 08 12:56:16.941210 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:16.941167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" event={"ID":"496fd6ed-6474-4105-bdb0-3578cb976075","Type":"ContainerStarted","Data":"f57ceee6537d9a77590ce156fcbe00533c1bd99269afd1fe51742881e3a45f58"} Jun 08 12:56:16.942649 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:16.942626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" event={"ID":"c118ed4e-941b-483d-9082-bcab6e5ec6e6","Type":"ContainerStarted","Data":"478e143325b584f52478ea7c36ba54b4adc5a86de7a5cb4d2ef0ad2d19573e9a"} Jun 08 12:56:16.942773 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:16.942758 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:16.961845 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:16.961793 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69996bcc67-6drmd" podStartSLOduration=1.826967417 podStartE2EDuration="4.961776473s" totalImagesPullingTime="3.134809056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:16.959767826 +0000 UTC m=+283.505166955" watchObservedRunningTime="2026-06-08 12:56:16.961776473 +0000 UTC m=+283.507175617" Jun 08 12:56:16.978039 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:16.977983 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" podStartSLOduration=1.594283587 podStartE2EDuration="3.977965917s" totalImagesPullingTime="2.38368233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:16.977099126 +0000 UTC m=+283.522498259" watchObservedRunningTime="2026-06-08 12:56:16.977965917 +0000 UTC m=+283.523365036" Jun 08 12:56:23.321039 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.321007 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hbdrb"] Jun 08 12:56:23.324458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.324441 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:23.330904 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.330886 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 08 12:56:23.331453 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.331436 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h67gp\"" Jun 08 12:56:23.348961 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.348932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hbdrb"] Jun 08 12:56:23.363191 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.363162 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf"] Jun 08 12:56:23.366903 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.366880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:23.373181 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.373155 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6bvvm\"" Jun 08 12:56:23.373298 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.373221 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 08 12:56:23.395643 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.395616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf"] Jun 08 12:56:23.425284 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.425234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/050d6b04-5778-4e47-a649-c25eee5cce9d-cert\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:23.425454 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.425330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74xwj\" (UniqueName: \"kubernetes.io/projected/050d6b04-5778-4e47-a649-c25eee5cce9d-kube-api-access-74xwj\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:23.526177 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.526135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74xwj\" (UniqueName: \"kubernetes.io/projected/050d6b04-5778-4e47-a649-c25eee5cce9d-kube-api-access-74xwj\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:23.526177 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.526180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbbb75e1-ee6e-47c9-a81b-7d855f327110-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:23.526477 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.526308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/050d6b04-5778-4e47-a649-c25eee5cce9d-cert\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:23.526477 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.526390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnsv7\" (UniqueName: \"kubernetes.io/projected/fbbb75e1-ee6e-47c9-a81b-7d855f327110-kube-api-access-rnsv7\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:23.526477 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:56:23.526424 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 08 12:56:23.526644 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:56:23.526481 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050d6b04-5778-4e47-a649-c25eee5cce9d-cert podName:050d6b04-5778-4e47-a649-c25eee5cce9d nodeName:}" failed. No retries permitted until 2026-06-08 12:56:24.026461229 +0000 UTC m=+290.571860331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/050d6b04-5778-4e47-a649-c25eee5cce9d-cert") pod "kserve-controller-manager-69fc866d76-hbdrb" (UID: "050d6b04-5778-4e47-a649-c25eee5cce9d") : secret "kserve-webhook-server-cert" not found Jun 08 12:56:23.537622 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.537592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74xwj\" (UniqueName: \"kubernetes.io/projected/050d6b04-5778-4e47-a649-c25eee5cce9d-kube-api-access-74xwj\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:23.627508 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.627405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnsv7\" (UniqueName: \"kubernetes.io/projected/fbbb75e1-ee6e-47c9-a81b-7d855f327110-kube-api-access-rnsv7\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:23.627508 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.627448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbbb75e1-ee6e-47c9-a81b-7d855f327110-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:23.627748 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:56:23.627553 2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 08 12:56:23.627748 ip-10-0-133-240 kubenswrapper[2578]: E0608 12:56:23.627615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbbb75e1-ee6e-47c9-a81b-7d855f327110-cert podName:fbbb75e1-ee6e-47c9-a81b-7d855f327110 nodeName:}" failed. No retries permitted until 2026-06-08 12:56:24.127599478 +0000 UTC m=+290.672998575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fbbb75e1-ee6e-47c9-a81b-7d855f327110-cert") pod "llmisvc-controller-manager-864bfd7bc9-mzhnf" (UID: "fbbb75e1-ee6e-47c9-a81b-7d855f327110") : secret "llmisvc-webhook-server-cert" not found Jun 08 12:56:23.660872 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:23.660836 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnsv7\" (UniqueName: \"kubernetes.io/projected/fbbb75e1-ee6e-47c9-a81b-7d855f327110-kube-api-access-rnsv7\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:24.030531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.030434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/050d6b04-5778-4e47-a649-c25eee5cce9d-cert\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:24.032852 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.032830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/050d6b04-5778-4e47-a649-c25eee5cce9d-cert\") pod \"kserve-controller-manager-69fc866d76-hbdrb\" (UID: \"050d6b04-5778-4e47-a649-c25eee5cce9d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:24.131312 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.131273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbbb75e1-ee6e-47c9-a81b-7d855f327110-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:24.133760 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.133736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbbb75e1-ee6e-47c9-a81b-7d855f327110-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-mzhnf\" (UID: \"fbbb75e1-ee6e-47c9-a81b-7d855f327110\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:24.234052 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.234010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:24.276703 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.276667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:24.377385 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.377324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-hbdrb"] Jun 08 12:56:24.379965 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:56:24.379929 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050d6b04_5778_4e47_a649_c25eee5cce9d.slice/crio-bd46bbb90957950b1bc080b35919388443b3548e1daf429c4cf98149da3043e8 WatchSource:0}: Error finding container bd46bbb90957950b1bc080b35919388443b3548e1daf429c4cf98149da3043e8: Status 404 returned error can't find the container with id bd46bbb90957950b1bc080b35919388443b3548e1daf429c4cf98149da3043e8 Jun 08 12:56:24.424689 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.424659 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf"] Jun 08 12:56:24.427761 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:56:24.427731 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfbbb75e1_ee6e_47c9_a81b_7d855f327110.slice/crio-003602493a2a4afd27da2f93c281742cbd8a08e2f225d4bff8a07947500e7e1d WatchSource:0}: Error finding container 003602493a2a4afd27da2f93c281742cbd8a08e2f225d4bff8a07947500e7e1d: Status 404 returned error can't find the container with id 003602493a2a4afd27da2f93c281742cbd8a08e2f225d4bff8a07947500e7e1d Jun 08 12:56:24.974000 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.973962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" event={"ID":"050d6b04-5778-4e47-a649-c25eee5cce9d","Type":"ContainerStarted","Data":"bd46bbb90957950b1bc080b35919388443b3548e1daf429c4cf98149da3043e8"} Jun 08 12:56:24.975548 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:24.975515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" event={"ID":"fbbb75e1-ee6e-47c9-a81b-7d855f327110","Type":"ContainerStarted","Data":"003602493a2a4afd27da2f93c281742cbd8a08e2f225d4bff8a07947500e7e1d"} Jun 08 12:56:27.950248 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:27.950219 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-nw77q" Jun 08 12:56:27.989317 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:27.989277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" event={"ID":"050d6b04-5778-4e47-a649-c25eee5cce9d","Type":"ContainerStarted","Data":"82246f68373858b54dd6f0a15892f76a4954a53dad613084af12fe93f0e2868f"} Jun 08 12:56:27.989491 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:27.989429 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:27.991450 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:27.991421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" event={"ID":"fbbb75e1-ee6e-47c9-a81b-7d855f327110","Type":"ContainerStarted","Data":"495e3c82aafe830bfddb1d7419853b71b8eb1f91bb859b5c6a92b934fb56fed9"} Jun 08 12:56:27.991583 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:27.991551 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:28.008922 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:28.008869 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" podStartSLOduration=2.084160171 podStartE2EDuration="5.008855702s" totalImagesPullingTime="2.924695531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:28.008769883 +0000 UTC m=+294.554169002" watchObservedRunningTime="2026-06-08 12:56:28.008855702 +0000 UTC m=+294.554254820" Jun 08 12:56:28.047208 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:28.047044 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" podStartSLOduration=2.166906338 podStartE2EDuration="5.047028752s" totalImagesPullingTime="2.880122414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:28.043649733 +0000 UTC m=+294.589048852" watchObservedRunningTime="2026-06-08 12:56:28.047028752 +0000 UTC m=+294.592427872" Jun 08 12:56:31.423934 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.423899 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr"] Jun 08 12:56:31.427049 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.427033 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.430794 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.430764 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 08 12:56:31.430919 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.430865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-q9q44\"" Jun 08 12:56:31.430919 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.430914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 08 12:56:31.449593 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.449570 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr"] Jun 08 12:56:31.594299 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.594264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv79x\" (UniqueName: \"kubernetes.io/projected/294470cd-28c2-4ad1-a478-cebee57ea279-kube-api-access-qv79x\") pod \"servicemesh-operator3-57f65f65fb-xzbjr\" (UID: \"294470cd-28c2-4ad1-a478-cebee57ea279\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.594460 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.594322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/294470cd-28c2-4ad1-a478-cebee57ea279-operator-config\") pod \"servicemesh-operator3-57f65f65fb-xzbjr\" (UID: \"294470cd-28c2-4ad1-a478-cebee57ea279\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.695603 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.695519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv79x\" (UniqueName: \"kubernetes.io/projected/294470cd-28c2-4ad1-a478-cebee57ea279-kube-api-access-qv79x\") pod \"servicemesh-operator3-57f65f65fb-xzbjr\" (UID: \"294470cd-28c2-4ad1-a478-cebee57ea279\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.695603 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.695560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/294470cd-28c2-4ad1-a478-cebee57ea279-operator-config\") pod \"servicemesh-operator3-57f65f65fb-xzbjr\" (UID: \"294470cd-28c2-4ad1-a478-cebee57ea279\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.698225 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.698200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/294470cd-28c2-4ad1-a478-cebee57ea279-operator-config\") pod \"servicemesh-operator3-57f65f65fb-xzbjr\" (UID: \"294470cd-28c2-4ad1-a478-cebee57ea279\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.704018 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.703994 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv79x\" (UniqueName: \"kubernetes.io/projected/294470cd-28c2-4ad1-a478-cebee57ea279-kube-api-access-qv79x\") pod \"servicemesh-operator3-57f65f65fb-xzbjr\" (UID: \"294470cd-28c2-4ad1-a478-cebee57ea279\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.735586 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.735561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:31.866804 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:31.866671 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr"] Jun 08 12:56:31.869624 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:56:31.869596 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294470cd_28c2_4ad1_a478_cebee57ea279.slice/crio-177c7f2aa2487a38c03e7c2b10b2738b7d85fa100675b05353a5812f3484be40 WatchSource:0}: Error finding container 177c7f2aa2487a38c03e7c2b10b2738b7d85fa100675b05353a5812f3484be40: Status 404 returned error can't find the container with id 177c7f2aa2487a38c03e7c2b10b2738b7d85fa100675b05353a5812f3484be40 Jun 08 12:56:32.008514 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:32.008418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" event={"ID":"294470cd-28c2-4ad1-a478-cebee57ea279","Type":"ContainerStarted","Data":"177c7f2aa2487a38c03e7c2b10b2738b7d85fa100675b05353a5812f3484be40"} Jun 08 12:56:34.686294 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:34.686270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:56:34.688607 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:34.686272 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 12:56:34.691582 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:34.691564 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 12:56:35.026690 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:35.026585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" event={"ID":"294470cd-28c2-4ad1-a478-cebee57ea279","Type":"ContainerStarted","Data":"c3e9613bd1f1c2d20ee717bf0e5d806594e2a0cc15aa3d11de6f06d922025db1"} Jun 08 12:56:35.026862 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:35.026696 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:35.051158 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:35.051096 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" podStartSLOduration=1.199579945 podStartE2EDuration="4.05107597s" totalImagesPullingTime="2.851496025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:35.049797541 +0000 UTC m=+301.595196661" watchObservedRunningTime="2026-06-08 12:56:35.05107597 +0000 UTC m=+301.596475091" Jun 08 12:56:42.723753 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.723718 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc"] Jun 08 12:56:42.727049 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.727029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:42.729534 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.729511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5ppng\"" Jun 08 12:56:42.730124 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.730108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 12:56:42.735636 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.735611 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc"] Jun 08 12:56:42.884671 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.884622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqmxz\" (UniqueName: \"kubernetes.io/projected/0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35-kube-api-access-gqmxz\") pod \"dashboard-redirect-9d8bf5dcd-fmgfc\" (UID: \"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:42.884862 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.884696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35-redirect-config\") pod \"dashboard-redirect-9d8bf5dcd-fmgfc\" (UID: \"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:42.985449 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.985349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqmxz\" (UniqueName: \"kubernetes.io/projected/0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35-kube-api-access-gqmxz\") pod \"dashboard-redirect-9d8bf5dcd-fmgfc\" (UID: \"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:42.985449 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.985432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35-redirect-config\") pod \"dashboard-redirect-9d8bf5dcd-fmgfc\" (UID: \"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:42.986103 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.986078 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35-redirect-config\") pod \"dashboard-redirect-9d8bf5dcd-fmgfc\" (UID: \"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:42.993890 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:42.993863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqmxz\" (UniqueName: \"kubernetes.io/projected/0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35-kube-api-access-gqmxz\") pod \"dashboard-redirect-9d8bf5dcd-fmgfc\" (UID: \"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35\") " pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:43.037853 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:43.037822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" Jun 08 12:56:43.170497 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:43.170464 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc"] Jun 08 12:56:43.173594 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:56:43.173567 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b09c4dd_3989_4f4b_8dda_d1bbe31aeb35.slice/crio-7c73b48692876b46d2dbb783e7baeb645a546d1f558692cf87141762222fc062 WatchSource:0}: Error finding container 7c73b48692876b46d2dbb783e7baeb645a546d1f558692cf87141762222fc062: Status 404 returned error can't find the container with id 7c73b48692876b46d2dbb783e7baeb645a546d1f558692cf87141762222fc062 Jun 08 12:56:43.175341 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:43.175325 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:56:44.063803 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:44.063768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" event={"ID":"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35","Type":"ContainerStarted","Data":"7c73b48692876b46d2dbb783e7baeb645a546d1f558692cf87141762222fc062"} Jun 08 12:56:46.033157 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:46.033119 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-xzbjr" Jun 08 12:56:46.075072 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:46.075038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" event={"ID":"0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35","Type":"ContainerStarted","Data":"c103fa026417e4d2575b99b47d166166e2cb6671b2a036b6669181a9da819a8e"} Jun 08 12:56:46.092370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:46.092325 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-9d8bf5dcd-fmgfc" podStartSLOduration=1.966388319 podStartE2EDuration="4.09231019s" totalImagesPullingTime="2.125921871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:56:46.091756544 +0000 UTC m=+312.637155664" watchObservedRunningTime="2026-06-08 12:56:46.09231019 +0000 UTC m=+312.637709335" Jun 08 12:56:58.997423 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:58.997393 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-mzhnf" Jun 08 12:56:59.000282 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.000263 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-hbdrb" Jun 08 12:56:59.863899 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.863867 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8"] Jun 08 12:56:59.869583 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.869561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.873415 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.873392 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 08 12:56:59.873522 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.873483 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 08 12:56:59.873583 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.873517 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vnr78\"" Jun 08 12:56:59.873583 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.873532 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 12:56:59.873744 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.873731 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 08 12:56:59.907177 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907355 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a729e50-bebf-401a-9da4-946992c55a58-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907355 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907355 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnrh2\" (UniqueName: \"kubernetes.io/projected/3a729e50-bebf-401a-9da4-946992c55a58-kube-api-access-hnrh2\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907421 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a729e50-bebf-401a-9da4-946992c55a58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907531 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a729e50-bebf-401a-9da4-946992c55a58-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:56:59.907735 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:56:59.907712 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8"] Jun 08 12:57:00.008791 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.008758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a729e50-bebf-401a-9da4-946992c55a58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009267 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.008805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a729e50-bebf-401a-9da4-946992c55a58-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009267 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.008835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009267 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.008860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a729e50-bebf-401a-9da4-946992c55a58-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009267 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.008875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009267 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.008897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnrh2\" (UniqueName: \"kubernetes.io/projected/3a729e50-bebf-401a-9da4-946992c55a58-kube-api-access-hnrh2\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009267 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.009132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.009573 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.009460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3a729e50-bebf-401a-9da4-946992c55a58-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.011330 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.011307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a729e50-bebf-401a-9da4-946992c55a58-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.011480 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.011457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.011525 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.011502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.011560 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.011534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3a729e50-bebf-401a-9da4-946992c55a58-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.023447 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.023424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a729e50-bebf-401a-9da4-946992c55a58-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.025911 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.025889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnrh2\" (UniqueName: \"kubernetes.io/projected/3a729e50-bebf-401a-9da4-946992c55a58-kube-api-access-hnrh2\") pod \"istiod-openshift-gateway-75c67f8887-fxhz8\" (UID: \"3a729e50-bebf-401a-9da4-946992c55a58\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.179458 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.179377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:00.357618 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:00.357582 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8"] Jun 08 12:57:00.360659 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:57:00.360636 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a729e50_bebf_401a_9da4_946992c55a58.slice/crio-6caf1c7d87722427ea004e61fcc4872077266b6e6285b79d8b735de23ebac53f WatchSource:0}: Error finding container 6caf1c7d87722427ea004e61fcc4872077266b6e6285b79d8b735de23ebac53f: Status 404 returned error can't find the container with id 6caf1c7d87722427ea004e61fcc4872077266b6e6285b79d8b735de23ebac53f Jun 08 12:57:01.141728 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:01.141694 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" event={"ID":"3a729e50-bebf-401a-9da4-946992c55a58","Type":"ContainerStarted","Data":"6caf1c7d87722427ea004e61fcc4872077266b6e6285b79d8b735de23ebac53f"} Jun 08 12:57:03.174995 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:03.174954 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 12:57:03.175402 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:03.175034 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 12:57:04.158198 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:04.158166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" event={"ID":"3a729e50-bebf-401a-9da4-946992c55a58","Type":"ContainerStarted","Data":"2ba3f6dd63cb4f6ab2158826e0ace2b7d6d8842e46f99a2356cd1942e59be094"} Jun 08 12:57:04.158402 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:04.158366 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:04.159868 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:04.159838 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-fxhz8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 08 12:57:04.159969 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:04.159903 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" podUID="3a729e50-bebf-401a-9da4-946992c55a58" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 12:57:04.180969 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:04.180921 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" podStartSLOduration=2.368946159 podStartE2EDuration="5.180907615s" totalImagesPullingTime="2.811961456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:04.179333119 +0000 UTC m=+330.724732238" watchObservedRunningTime="2026-06-08 12:57:04.180907615 +0000 UTC m=+330.726306733" Jun 08 12:57:05.162660 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:05.162624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-fxhz8" Jun 08 12:57:53.131100 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.131007 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h5b92"] Jun 08 12:57:53.133109 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.133089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:57:53.136407 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.136383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-89wl2\"" Jun 08 12:57:53.137001 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.136984 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:57:53.137088 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.137022 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:57:53.153918 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.153886 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h5b92"] Jun 08 12:57:53.240934 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.240897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8vc\" (UniqueName: \"kubernetes.io/projected/a3b229e2-6340-493c-984c-9c5246f9ae52-kube-api-access-ts8vc\") pod \"authorino-operator-75cc8d5cb7-h5b92\" (UID: \"a3b229e2-6340-493c-984c-9c5246f9ae52\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:57:53.341676 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.341638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8vc\" (UniqueName: \"kubernetes.io/projected/a3b229e2-6340-493c-984c-9c5246f9ae52-kube-api-access-ts8vc\") pod \"authorino-operator-75cc8d5cb7-h5b92\" (UID: \"a3b229e2-6340-493c-984c-9c5246f9ae52\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:57:53.352188 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.352152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8vc\" (UniqueName: \"kubernetes.io/projected/a3b229e2-6340-493c-984c-9c5246f9ae52-kube-api-access-ts8vc\") pod \"authorino-operator-75cc8d5cb7-h5b92\" (UID: \"a3b229e2-6340-493c-984c-9c5246f9ae52\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:57:53.450976 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.450892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:57:53.619846 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:53.619809 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h5b92"] Jun 08 12:57:53.623985 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:57:53.623954 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b229e2_6340_493c_984c_9c5246f9ae52.slice/crio-6a781cece7237e3797b184a36caad59a6015ca3fa2f2c1d25b406c4e27d8e589 WatchSource:0}: Error finding container 6a781cece7237e3797b184a36caad59a6015ca3fa2f2c1d25b406c4e27d8e589: Status 404 returned error can't find the container with id 6a781cece7237e3797b184a36caad59a6015ca3fa2f2c1d25b406c4e27d8e589 Jun 08 12:57:54.368376 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:54.368336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" event={"ID":"a3b229e2-6340-493c-984c-9c5246f9ae52","Type":"ContainerStarted","Data":"6a781cece7237e3797b184a36caad59a6015ca3fa2f2c1d25b406c4e27d8e589"} Jun 08 12:57:56.381059 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:56.381023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" event={"ID":"a3b229e2-6340-493c-984c-9c5246f9ae52","Type":"ContainerStarted","Data":"e039025400a62dcdb66d7883c70b604c6e13637ffc92b18fd3ff61e6a4adf067"} Jun 08 12:57:56.381597 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:56.381162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:57:56.399578 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:57:56.399529 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" podStartSLOduration=1.166900459 podStartE2EDuration="3.399513546s" totalImagesPullingTime="2.232613087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:57:56.397892635 +0000 UTC m=+382.943291755" watchObservedRunningTime="2026-06-08 12:57:56.399513546 +0000 UTC m=+382.944912664" Jun 08 12:58:07.387497 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:07.387466 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h5b92" Jun 08 12:58:52.160799 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.160675 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d"] Jun 08 12:58:52.164452 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.164429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.166755 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.166733 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-z27qs\"" Jun 08 12:58:52.183209 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.183172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d"] Jun 08 12:58:52.208578 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1cac630-234d-471e-a524-4744cbd2377c-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208729 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208729 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208729 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1cac630-234d-471e-a524-4744cbd2377c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208729 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208729 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208729 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1cac630-234d-471e-a524-4744cbd2377c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208929 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwcml\" (UniqueName: \"kubernetes.io/projected/d1cac630-234d-471e-a524-4744cbd2377c-kube-api-access-mwcml\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.208929 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.208800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309591 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309781 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1cac630-234d-471e-a524-4744cbd2377c-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309781 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309781 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309950 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1cac630-234d-471e-a524-4744cbd2377c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309950 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309950 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309950 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1cac630-234d-471e-a524-4744cbd2377c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.309950 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwcml\" (UniqueName: \"kubernetes.io/projected/d1cac630-234d-471e-a524-4744cbd2377c-kube-api-access-mwcml\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.310219 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.309998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.310219 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.310104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.310361 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.310297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.310361 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.310333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.310546 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.310524 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1cac630-234d-471e-a524-4744cbd2377c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.312045 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.312020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1cac630-234d-471e-a524-4744cbd2377c-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.312288 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.312270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1cac630-234d-471e-a524-4744cbd2377c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.322416 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.322388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1cac630-234d-471e-a524-4744cbd2377c-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.322658 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.322631 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwcml\" (UniqueName: \"kubernetes.io/projected/d1cac630-234d-471e-a524-4744cbd2377c-kube-api-access-mwcml\") pod \"maas-default-gateway-openshift-default-8559cd5744-v8b7d\" (UID: \"d1cac630-234d-471e-a524-4744cbd2377c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.481501 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.481409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:52.624486 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:52.624339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d"] Jun 08 12:58:52.627369 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:58:52.627343 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cac630_234d_471e_a524_4744cbd2377c.slice/crio-98296c7d29d003c81d6d0478f543bbda3b195fbd62a1b844247ab3511f297361 WatchSource:0}: Error finding container 98296c7d29d003c81d6d0478f543bbda3b195fbd62a1b844247ab3511f297361: Status 404 returned error can't find the container with id 98296c7d29d003c81d6d0478f543bbda3b195fbd62a1b844247ab3511f297361 Jun 08 12:58:53.635223 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:53.635184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" event={"ID":"d1cac630-234d-471e-a524-4744cbd2377c","Type":"ContainerStarted","Data":"98296c7d29d003c81d6d0478f543bbda3b195fbd62a1b844247ab3511f297361"} Jun 08 12:58:56.101131 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:56.101096 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 12:58:56.101509 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:56.101180 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 12:58:56.101509 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:56.101228 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 12:58:56.650185 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:56.650143 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" event={"ID":"d1cac630-234d-471e-a524-4744cbd2377c","Type":"ContainerStarted","Data":"7cafea27f5cc515ebd86bff9d25277cf0c8cdd6d7ab7e6a71d6c827b43eea123"} Jun 08 12:58:56.671514 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:56.671174 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" podStartSLOduration=1.199592773 podStartE2EDuration="4.671154988s" totalImagesPullingTime="3.471562215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:58:56.6699298 +0000 UTC m=+443.215328913" watchObservedRunningTime="2026-06-08 12:58:56.671154988 +0000 UTC m=+443.216554109" Jun 08 12:58:57.482628 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:57.482591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:57.488376 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:57.488353 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:57.654587 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:57.654548 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:58:57.655587 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:58:57.655570 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 12:59:54.063370 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.063337 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:59:54.065481 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.065463 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:59:54.067902 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.067884 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xrsm4\"" Jun 08 12:59:54.068694 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.068666 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 12:59:54.068794 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.068668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:59:54.068794 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.068715 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:59:54.080178 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.080156 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:59:54.112457 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.112427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlf44\" (UniqueName: \"kubernetes.io/projected/70d88506-28dd-411a-ae8b-c314f1898f55-kube-api-access-zlf44\") pod \"maas-keycloak-0\" (UID: \"70d88506-28dd-411a-ae8b-c314f1898f55\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:59:54.212813 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.212778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlf44\" (UniqueName: \"kubernetes.io/projected/70d88506-28dd-411a-ae8b-c314f1898f55-kube-api-access-zlf44\") pod \"maas-keycloak-0\" (UID: \"70d88506-28dd-411a-ae8b-c314f1898f55\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:59:54.222475 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.222437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlf44\" (UniqueName: \"kubernetes.io/projected/70d88506-28dd-411a-ae8b-c314f1898f55-kube-api-access-zlf44\") pod \"maas-keycloak-0\" (UID: \"70d88506-28dd-411a-ae8b-c314f1898f55\") " pod="keycloak-system/maas-keycloak-0" Jun 08 12:59:54.374487 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.374381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 12:59:54.502747 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.502678 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 12:59:54.504970 ip-10-0-133-240 kubenswrapper[2578]: W0608 12:59:54.504944 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d88506_28dd_411a_ae8b_c314f1898f55.slice/crio-b4d95646a6a4bef5f9d9c7475983e17033a6f89e680a7f7f189994d6deeee598 WatchSource:0}: Error finding container b4d95646a6a4bef5f9d9c7475983e17033a6f89e680a7f7f189994d6deeee598: Status 404 returned error can't find the container with id b4d95646a6a4bef5f9d9c7475983e17033a6f89e680a7f7f189994d6deeee598 Jun 08 12:59:54.909540 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:54.909500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"70d88506-28dd-411a-ae8b-c314f1898f55","Type":"ContainerStarted","Data":"b4d95646a6a4bef5f9d9c7475983e17033a6f89e680a7f7f189994d6deeee598"} Jun 08 12:59:59.937676 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:59.937633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"70d88506-28dd-411a-ae8b-c314f1898f55","Type":"ContainerStarted","Data":"85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f"} Jun 08 12:59:59.962068 ip-10-0-133-240 kubenswrapper[2578]: I0608 12:59:59.962009 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.438684347 podStartE2EDuration="5.961992246s" totalImagesPullingTime="4.523307899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:59:59.960451111 +0000 UTC m=+506.505850231" watchObservedRunningTime="2026-06-08 12:59:59.961992246 +0000 UTC m=+506.507391365" Jun 08 13:00:00.374931 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:00.374895 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:00:00.376296 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:00.376258 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:01.375709 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:01.375654 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:02.375865 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:02.375808 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:03.375551 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:03.375491 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:04.376323 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:04.375875 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:04.377604 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:04.376922 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:00:05.375410 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:05.375356 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:06.375704 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:06.375647 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:07.375133 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:07.375077 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:08.375379 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:08.375321 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:09.375370 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:09.375312 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:10.375259 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:10.375189 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:11.374795 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:11.374751 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 08 13:00:12.503504 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:12.503454 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:00:12.521916 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:12.521856 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:00:22.509967 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:22.509867 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:00:28.995045 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:28.995012 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cdf689cd7-lh8vw"] Jun 08 13:00:28.997382 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:28.997363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:28.999648 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:28.999628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 13:00:28.999830 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:28.999817 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 13:00:29.000393 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.000380 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kl8pt\"" Jun 08 13:00:29.009219 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.009196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cdf689cd7-lh8vw"] Jun 08 13:00:29.132375 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.132345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45db04a4-ac3a-4254-9672-92113c47b530-webhook-cert\") pod \"maas-controller-cdf689cd7-lh8vw\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.132572 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.132423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n6pm\" (UniqueName: \"kubernetes.io/projected/45db04a4-ac3a-4254-9672-92113c47b530-kube-api-access-8n6pm\") pod \"maas-controller-cdf689cd7-lh8vw\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.154767 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.154741 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-776788969f-9wqtg"] Jun 08 13:00:29.156947 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.156931 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.172106 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.172082 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-776788969f-9wqtg"] Jun 08 13:00:29.233326 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.233295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n6pm\" (UniqueName: \"kubernetes.io/projected/45db04a4-ac3a-4254-9672-92113c47b530-kube-api-access-8n6pm\") pod \"maas-controller-cdf689cd7-lh8vw\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.233509 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.233343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45db04a4-ac3a-4254-9672-92113c47b530-webhook-cert\") pod \"maas-controller-cdf689cd7-lh8vw\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.235848 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.235825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45db04a4-ac3a-4254-9672-92113c47b530-webhook-cert\") pod \"maas-controller-cdf689cd7-lh8vw\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.244796 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.244777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n6pm\" (UniqueName: \"kubernetes.io/projected/45db04a4-ac3a-4254-9672-92113c47b530-kube-api-access-8n6pm\") pod \"maas-controller-cdf689cd7-lh8vw\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.307939 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.307901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:29.334165 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.334126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-webhook-cert\") pod \"maas-controller-776788969f-9wqtg\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.334352 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.334183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5f5\" (UniqueName: \"kubernetes.io/projected/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-kube-api-access-8w5f5\") pod \"maas-controller-776788969f-9wqtg\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.435221 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.435190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-webhook-cert\") pod \"maas-controller-776788969f-9wqtg\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.435221 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.435226 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5f5\" (UniqueName: \"kubernetes.io/projected/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-kube-api-access-8w5f5\") pod \"maas-controller-776788969f-9wqtg\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.437498 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.437472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-webhook-cert\") pod \"maas-controller-776788969f-9wqtg\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.442416 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.442390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cdf689cd7-lh8vw"] Jun 08 13:00:29.445184 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:00:29.445123 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45db04a4_ac3a_4254_9672_92113c47b530.slice/crio-74e9dc54978f24877bd4b7f4c7f84e4130df1d408aa48342f92c71e1146f857a WatchSource:0}: Error finding container 74e9dc54978f24877bd4b7f4c7f84e4130df1d408aa48342f92c71e1146f857a: Status 404 returned error can't find the container with id 74e9dc54978f24877bd4b7f4c7f84e4130df1d408aa48342f92c71e1146f857a Jun 08 13:00:29.446059 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.446018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5f5\" (UniqueName: \"kubernetes.io/projected/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-kube-api-access-8w5f5\") pod \"maas-controller-776788969f-9wqtg\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.466976 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.466952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:29.594342 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:29.594313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-776788969f-9wqtg"] Jun 08 13:00:29.596562 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:00:29.596540 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c8dcb4_5f4c_4375_b2c3_1e777eeab154.slice/crio-7eb3141abb9b1f7f1d976a280e868e18c4e6bed85edb1d183c7df8208bb562b6 WatchSource:0}: Error finding container 7eb3141abb9b1f7f1d976a280e868e18c4e6bed85edb1d183c7df8208bb562b6: Status 404 returned error can't find the container with id 7eb3141abb9b1f7f1d976a280e868e18c4e6bed85edb1d183c7df8208bb562b6 Jun 08 13:00:30.114402 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:30.114360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776788969f-9wqtg" event={"ID":"57c8dcb4-5f4c-4375-b2c3-1e777eeab154","Type":"ContainerStarted","Data":"7eb3141abb9b1f7f1d976a280e868e18c4e6bed85edb1d183c7df8208bb562b6"} Jun 08 13:00:30.115865 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:30.115832 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" event={"ID":"45db04a4-ac3a-4254-9672-92113c47b530","Type":"ContainerStarted","Data":"74e9dc54978f24877bd4b7f4c7f84e4130df1d408aa48342f92c71e1146f857a"} Jun 08 13:00:33.133387 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:33.133292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776788969f-9wqtg" event={"ID":"57c8dcb4-5f4c-4375-b2c3-1e777eeab154","Type":"ContainerStarted","Data":"e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28"} Jun 08 13:00:33.133801 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:33.133403 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:33.134818 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:33.134793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" event={"ID":"45db04a4-ac3a-4254-9672-92113c47b530","Type":"ContainerStarted","Data":"aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b"} Jun 08 13:00:33.134962 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:33.134900 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:33.167187 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:33.167133 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-776788969f-9wqtg" podStartSLOduration=1.0198799649999999 podStartE2EDuration="4.167118368s" totalImagesPullingTime="3.147238403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:00:33.163106177 +0000 UTC m=+539.708505298" watchObservedRunningTime="2026-06-08 13:00:33.167118368 +0000 UTC m=+539.712517487" Jun 08 13:00:33.236191 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:33.236134 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" podStartSLOduration=1.944540819 podStartE2EDuration="5.236113236s" totalImagesPullingTime="3.291572417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:00:33.235290565 +0000 UTC m=+539.780689684" watchObservedRunningTime="2026-06-08 13:00:33.236113236 +0000 UTC m=+539.781512356" Jun 08 13:00:44.152033 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.151999 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:44.152516 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.152075 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:00:44.229124 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.229087 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cdf689cd7-lh8vw"] Jun 08 13:00:44.229350 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.229329 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" podUID="45db04a4-ac3a-4254-9672-92113c47b530" containerName="manager" containerID="cri-o://aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b" gracePeriod=30 Jun 08 13:00:44.465841 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.465813 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:44.553788 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.553755 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n6pm\" (UniqueName: \"kubernetes.io/projected/45db04a4-ac3a-4254-9672-92113c47b530-kube-api-access-8n6pm\") pod \"45db04a4-ac3a-4254-9672-92113c47b530\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " Jun 08 13:00:44.553988 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.553853 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45db04a4-ac3a-4254-9672-92113c47b530-webhook-cert\") pod \"45db04a4-ac3a-4254-9672-92113c47b530\" (UID: \"45db04a4-ac3a-4254-9672-92113c47b530\") " Jun 08 13:00:44.555997 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.555958 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45db04a4-ac3a-4254-9672-92113c47b530-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "45db04a4-ac3a-4254-9672-92113c47b530" (UID: "45db04a4-ac3a-4254-9672-92113c47b530"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:00:44.555997 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.555992 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45db04a4-ac3a-4254-9672-92113c47b530-kube-api-access-8n6pm" (OuterVolumeSpecName: "kube-api-access-8n6pm") pod "45db04a4-ac3a-4254-9672-92113c47b530" (UID: "45db04a4-ac3a-4254-9672-92113c47b530"). InnerVolumeSpecName "kube-api-access-8n6pm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:00:44.654538 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.654504 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45db04a4-ac3a-4254-9672-92113c47b530-webhook-cert\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 13:00:44.654538 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:44.654533 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n6pm\" (UniqueName: \"kubernetes.io/projected/45db04a4-ac3a-4254-9672-92113c47b530-kube-api-access-8n6pm\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 13:00:45.189409 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.189376 2578 generic.go:356] "Generic (PLEG): container finished" podID="45db04a4-ac3a-4254-9672-92113c47b530" containerID="aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b" exitCode=0 Jun 08 13:00:45.189861 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.189425 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" Jun 08 13:00:45.189861 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.189465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" event={"ID":"45db04a4-ac3a-4254-9672-92113c47b530","Type":"ContainerDied","Data":"aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b"} Jun 08 13:00:45.189861 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.189534 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cdf689cd7-lh8vw" event={"ID":"45db04a4-ac3a-4254-9672-92113c47b530","Type":"ContainerDied","Data":"74e9dc54978f24877bd4b7f4c7f84e4130df1d408aa48342f92c71e1146f857a"} Jun 08 13:00:45.189861 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.189570 2578 scope.go:117] "RemoveContainer" containerID="aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b" Jun 08 13:00:45.198408 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.198372 2578 scope.go:117] "RemoveContainer" containerID="aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b" Jun 08 13:00:45.198633 ip-10-0-133-240 kubenswrapper[2578]: E0608 13:00:45.198614 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b\": container with ID starting with aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b not found: ID does not exist" containerID="aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b" Jun 08 13:00:45.198695 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.198645 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b"} err="failed to get container status \"aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b\": rpc error: code = NotFound desc = could not find container \"aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b\": container with ID starting with aa3dd9a95a89225d75a6c8b9095466deaa70e87e82ebde105f4ac427850a4b1b not found: ID does not exist" Jun 08 13:00:45.209516 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.209494 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cdf689cd7-lh8vw"] Jun 08 13:00:45.215732 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.215711 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cdf689cd7-lh8vw"] Jun 08 13:00:45.854731 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:00:45.854693 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45db04a4-ac3a-4254-9672-92113c47b530" path="/var/lib/kubelet/pods/45db04a4-ac3a-4254-9672-92113c47b530/volumes" Jun 08 13:01:04.232707 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.232666 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6cd5cb5d7f-7x5pz"] Jun 08 13:01:04.233184 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.233046 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45db04a4-ac3a-4254-9672-92113c47b530" containerName="manager" Jun 08 13:01:04.233184 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.233058 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="45db04a4-ac3a-4254-9672-92113c47b530" containerName="manager" Jun 08 13:01:04.233184 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.233127 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="45db04a4-ac3a-4254-9672-92113c47b530" containerName="manager" Jun 08 13:01:04.246875 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.246842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.247500 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.247474 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cd5cb5d7f-7x5pz"] Jun 08 13:01:04.249270 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.249214 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 13:01:04.249382 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.249334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n5rls\"" Jun 08 13:01:04.315962 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.315920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgbbm\" (UniqueName: \"kubernetes.io/projected/6d7b77b5-839e-4c50-8016-d88cb7048dc0-kube-api-access-sgbbm\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.316137 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.316061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7b77b5-839e-4c50-8016-d88cb7048dc0-maas-api-tls\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.416683 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.416639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7b77b5-839e-4c50-8016-d88cb7048dc0-maas-api-tls\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.416888 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.416707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgbbm\" (UniqueName: \"kubernetes.io/projected/6d7b77b5-839e-4c50-8016-d88cb7048dc0-kube-api-access-sgbbm\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.416888 ip-10-0-133-240 kubenswrapper[2578]: E0608 13:01:04.416820 2578 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 08 13:01:04.417008 ip-10-0-133-240 kubenswrapper[2578]: E0608 13:01:04.416972 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b77b5-839e-4c50-8016-d88cb7048dc0-maas-api-tls podName:6d7b77b5-839e-4c50-8016-d88cb7048dc0 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:04.916946768 +0000 UTC m=+571.462345883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d7b77b5-839e-4c50-8016-d88cb7048dc0-maas-api-tls") pod "maas-api-6cd5cb5d7f-7x5pz" (UID: "6d7b77b5-839e-4c50-8016-d88cb7048dc0") : secret "maas-api-serving-cert" not found Jun 08 13:01:04.425715 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.425677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgbbm\" (UniqueName: \"kubernetes.io/projected/6d7b77b5-839e-4c50-8016-d88cb7048dc0-kube-api-access-sgbbm\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.889985 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.889948 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-v7grm"] Jun 08 13:01:04.914297 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.914264 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-v7grm"] Jun 08 13:01:04.914464 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.914347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:04.918703 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.918676 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 13:01:04.918703 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.918690 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9k5gg\"" Jun 08 13:01:04.922672 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.922651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7b77b5-839e-4c50-8016-d88cb7048dc0-maas-api-tls\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:04.925280 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:04.925257 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d7b77b5-839e-4c50-8016-d88cb7048dc0-maas-api-tls\") pod \"maas-api-6cd5cb5d7f-7x5pz\" (UID: \"6d7b77b5-839e-4c50-8016-d88cb7048dc0\") " pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:05.023578 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.023549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgf9l\" (UniqueName: \"kubernetes.io/projected/25d89dcc-b22a-4970-804b-3fca7f693a66-kube-api-access-fgf9l\") pod \"payload-pre-processing-67d7689b65-v7grm\" (UID: \"25d89dcc-b22a-4970-804b-3fca7f693a66\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:05.124489 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.124454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgf9l\" (UniqueName: \"kubernetes.io/projected/25d89dcc-b22a-4970-804b-3fca7f693a66-kube-api-access-fgf9l\") pod \"payload-pre-processing-67d7689b65-v7grm\" (UID: \"25d89dcc-b22a-4970-804b-3fca7f693a66\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:05.133179 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.133148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgf9l\" (UniqueName: \"kubernetes.io/projected/25d89dcc-b22a-4970-804b-3fca7f693a66-kube-api-access-fgf9l\") pod \"payload-pre-processing-67d7689b65-v7grm\" (UID: \"25d89dcc-b22a-4970-804b-3fca7f693a66\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:05.158121 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.158048 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:05.225671 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.225640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:05.293647 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.293422 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6cd5cb5d7f-7x5pz"] Jun 08 13:01:05.299533 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:01:05.299508 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7b77b5_839e_4c50_8016_d88cb7048dc0.slice/crio-dbcf5670a1ea3d5e07b926d39c36bcd1d2cf7e9c9d59c6eb416ccf04913e07fb WatchSource:0}: Error finding container dbcf5670a1ea3d5e07b926d39c36bcd1d2cf7e9c9d59c6eb416ccf04913e07fb: Status 404 returned error can't find the container with id dbcf5670a1ea3d5e07b926d39c36bcd1d2cf7e9c9d59c6eb416ccf04913e07fb Jun 08 13:01:05.371921 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:05.371898 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-v7grm"] Jun 08 13:01:05.374212 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:01:05.374185 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d89dcc_b22a_4970_804b_3fca7f693a66.slice/crio-9e3528e2871b3817289ce2c9b33244405fdde13177e507d50ec1ec02f06add86 WatchSource:0}: Error finding container 9e3528e2871b3817289ce2c9b33244405fdde13177e507d50ec1ec02f06add86: Status 404 returned error can't find the container with id 9e3528e2871b3817289ce2c9b33244405fdde13177e507d50ec1ec02f06add86 Jun 08 13:01:06.300600 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:06.300226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" event={"ID":"25d89dcc-b22a-4970-804b-3fca7f693a66","Type":"ContainerStarted","Data":"9e3528e2871b3817289ce2c9b33244405fdde13177e507d50ec1ec02f06add86"} Jun 08 13:01:06.301937 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:06.301905 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" event={"ID":"6d7b77b5-839e-4c50-8016-d88cb7048dc0","Type":"ContainerStarted","Data":"dbcf5670a1ea3d5e07b926d39c36bcd1d2cf7e9c9d59c6eb416ccf04913e07fb"} Jun 08 13:01:08.313349 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:08.313307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" event={"ID":"25d89dcc-b22a-4970-804b-3fca7f693a66","Type":"ContainerStarted","Data":"fff3575f064fd7225780430aff6eb44dc0ffc5832a118b4da472f507b8f8bf46"} Jun 08 13:01:08.313805 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:08.313373 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:08.314706 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:08.314683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" event={"ID":"6d7b77b5-839e-4c50-8016-d88cb7048dc0","Type":"ContainerStarted","Data":"f40d1245ea3b26f53a2db02b89e06aa1a9385d7d3c448059c8d73fb9f09e1e2d"} Jun 08 13:01:08.314829 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:08.314733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:08.329878 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:08.329836 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" podStartSLOduration=2.4830590900000002 podStartE2EDuration="4.329822255s" totalImagesPullingTime="1.846763165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:08.327760061 +0000 UTC m=+574.873159179" watchObservedRunningTime="2026-06-08 13:01:08.329822255 +0000 UTC m=+574.875221423" Jun 08 13:01:08.342669 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:08.342627 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" podStartSLOduration=2.422144383 podStartE2EDuration="4.342617422s" totalImagesPullingTime="1.920473039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:08.341582427 +0000 UTC m=+574.886981548" watchObservedRunningTime="2026-06-08 13:01:08.342617422 +0000 UTC m=+574.888016542" Jun 08 13:01:12.656094 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:12.656011 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8b7d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 08 13:01:12.656094 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:12.656067 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" podUID="d1cac630-234d-471e-a524-4744cbd2377c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 08 13:01:13.342417 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:13.342384 2578 generic.go:356] "Generic (PLEG): container finished" podID="d1cac630-234d-471e-a524-4744cbd2377c" containerID="7cafea27f5cc515ebd86bff9d25277cf0c8cdd6d7ab7e6a71d6c827b43eea123" exitCode=0 Jun 08 13:01:13.342604 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:13.342456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" event={"ID":"d1cac630-234d-471e-a524-4744cbd2377c","Type":"ContainerDied","Data":"7cafea27f5cc515ebd86bff9d25277cf0c8cdd6d7ab7e6a71d6c827b43eea123"} Jun 08 13:01:13.342868 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:13.342852 2578 scope.go:117] "RemoveContainer" containerID="7cafea27f5cc515ebd86bff9d25277cf0c8cdd6d7ab7e6a71d6c827b43eea123" Jun 08 13:01:13.343828 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:13.343800 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:01:13.343925 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:13.343885 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:01:13.343985 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:13.343935 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 08 13:01:14.329958 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:14.329924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6cd5cb5d7f-7x5pz" Jun 08 13:01:14.349291 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:14.349263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" event={"ID":"d1cac630-234d-471e-a524-4744cbd2377c","Type":"ContainerStarted","Data":"e1a17ed6997be13d8fccf0f4113a3bafa7467fe85869ded778b1a5a59f2c113b"} Jun 08 13:01:14.488263 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:14.487655 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 13:01:14.488263 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:14.487779 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8b7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 08 13:01:14.488263 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:14.487819 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" podUID="d1cac630-234d-471e-a524-4744cbd2377c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 08 13:01:15.484264 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:15.483608 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8b7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 08 13:01:15.484264 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:15.483671 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" podUID="d1cac630-234d-471e-a524-4744cbd2377c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 08 13:01:16.139761 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:16.139723 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:01:16.139966 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:16.139921 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" containerID="cri-o://85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f" gracePeriod=30 Jun 08 13:01:16.482704 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:16.482610 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8b7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 08 13:01:16.482970 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:16.482942 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" podUID="d1cac630-234d-471e-a524-4744cbd2377c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 08 13:01:17.482428 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:17.482386 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-v8b7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body= Jun 08 13:01:17.482931 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:17.482466 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" podUID="d1cac630-234d-471e-a524-4744cbd2377c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" Jun 08 13:01:17.825543 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:17.825520 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:17.939984 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:17.939948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlf44\" (UniqueName: \"kubernetes.io/projected/70d88506-28dd-411a-ae8b-c314f1898f55-kube-api-access-zlf44\") pod \"70d88506-28dd-411a-ae8b-c314f1898f55\" (UID: \"70d88506-28dd-411a-ae8b-c314f1898f55\") " Jun 08 13:01:17.942053 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:17.942026 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70d88506-28dd-411a-ae8b-c314f1898f55-kube-api-access-zlf44" (OuterVolumeSpecName: "kube-api-access-zlf44") pod "70d88506-28dd-411a-ae8b-c314f1898f55" (UID: "70d88506-28dd-411a-ae8b-c314f1898f55"). InnerVolumeSpecName "kube-api-access-zlf44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:01:18.041535 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.041500 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlf44\" (UniqueName: \"kubernetes.io/projected/70d88506-28dd-411a-ae8b-c314f1898f55-kube-api-access-zlf44\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 13:01:18.369014 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.368981 2578 generic.go:356] "Generic (PLEG): container finished" podID="70d88506-28dd-411a-ae8b-c314f1898f55" containerID="85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f" exitCode=143 Jun 08 13:01:18.369014 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.369017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"70d88506-28dd-411a-ae8b-c314f1898f55","Type":"ContainerDied","Data":"85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f"} Jun 08 13:01:18.369219 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.369025 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.369219 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.369056 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"70d88506-28dd-411a-ae8b-c314f1898f55","Type":"ContainerDied","Data":"b4d95646a6a4bef5f9d9c7475983e17033a6f89e680a7f7f189994d6deeee598"} Jun 08 13:01:18.369219 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.369076 2578 scope.go:117] "RemoveContainer" containerID="85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f" Jun 08 13:01:18.381501 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.381480 2578 scope.go:117] "RemoveContainer" containerID="85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f" Jun 08 13:01:18.381781 ip-10-0-133-240 kubenswrapper[2578]: E0608 13:01:18.381754 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f\": container with ID starting with 85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f not found: ID does not exist" containerID="85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f" Jun 08 13:01:18.381839 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.381794 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f"} err="failed to get container status \"85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f\": rpc error: code = NotFound desc = could not find container \"85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f\": container with ID starting with 85db0f0491a5f2dced98675904b38da40ff163769c9d780a36a4b80794812c6f not found: ID does not exist" Jun 08 13:01:18.395460 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.395427 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:01:18.399107 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.399081 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:01:18.430464 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.430433 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:01:18.430801 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.430788 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" Jun 08 13:01:18.430864 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.430803 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" Jun 08 13:01:18.430864 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.430861 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" containerName="keycloak" Jun 08 13:01:18.433500 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.433479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.436124 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.436091 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:01:18.436263 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.436129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xrsm4\"" Jun 08 13:01:18.436263 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.436151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 13:01:18.436462 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.436434 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:01:18.436703 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.436677 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:01:18.445419 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.445391 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:01:18.485556 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.485532 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 13:01:18.485931 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.485915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 13:01:18.486520 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.486505 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-v8b7d" Jun 08 13:01:18.545532 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.545500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7e558a16-f4cc-4431-9a1a-0b6ff2f56209-test-realms\") pod \"maas-keycloak-0\" (UID: \"7e558a16-f4cc-4431-9a1a-0b6ff2f56209\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.545728 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.545548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jskw\" (UniqueName: \"kubernetes.io/projected/7e558a16-f4cc-4431-9a1a-0b6ff2f56209-kube-api-access-6jskw\") pod \"maas-keycloak-0\" (UID: \"7e558a16-f4cc-4431-9a1a-0b6ff2f56209\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.646947 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.646871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7e558a16-f4cc-4431-9a1a-0b6ff2f56209-test-realms\") pod \"maas-keycloak-0\" (UID: \"7e558a16-f4cc-4431-9a1a-0b6ff2f56209\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.646947 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.646906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jskw\" (UniqueName: \"kubernetes.io/projected/7e558a16-f4cc-4431-9a1a-0b6ff2f56209-kube-api-access-6jskw\") pod \"maas-keycloak-0\" (UID: \"7e558a16-f4cc-4431-9a1a-0b6ff2f56209\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.647687 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.647667 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7e558a16-f4cc-4431-9a1a-0b6ff2f56209-test-realms\") pod \"maas-keycloak-0\" (UID: \"7e558a16-f4cc-4431-9a1a-0b6ff2f56209\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.656005 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.655975 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jskw\" (UniqueName: \"kubernetes.io/projected/7e558a16-f4cc-4431-9a1a-0b6ff2f56209-kube-api-access-6jskw\") pod \"maas-keycloak-0\" (UID: \"7e558a16-f4cc-4431-9a1a-0b6ff2f56209\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.745571 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.745528 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:18.895439 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:18.895411 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:01:18.897430 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:01:18.897369 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e558a16_f4cc_4431_9a1a_0b6ff2f56209.slice/crio-c017f0d4d5a503a534f9444ff345c9e33b6dfd8c748fa94d596e1034d943f511 WatchSource:0}: Error finding container c017f0d4d5a503a534f9444ff345c9e33b6dfd8c748fa94d596e1034d943f511: Status 404 returned error can't find the container with id c017f0d4d5a503a534f9444ff345c9e33b6dfd8c748fa94d596e1034d943f511 Jun 08 13:01:19.327418 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.327391 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-v7grm" Jun 08 13:01:19.376143 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.376104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7e558a16-f4cc-4431-9a1a-0b6ff2f56209","Type":"ContainerStarted","Data":"3695e11dd45a7761c532afd0db2769c432917e5c578a2ebe71a35abc138e1baf"} Jun 08 13:01:19.376353 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.376170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7e558a16-f4cc-4431-9a1a-0b6ff2f56209","Type":"ContainerStarted","Data":"c017f0d4d5a503a534f9444ff345c9e33b6dfd8c748fa94d596e1034d943f511"} Jun 08 13:01:19.397182 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.397118 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.0985165669999999 podStartE2EDuration="1.397094738s" totalImagesPullingTime="298.578171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:19.394781017 +0000 UTC m=+585.940180139" watchObservedRunningTime="2026-06-08 13:01:19.397094738 +0000 UTC m=+585.942493857" Jun 08 13:01:19.746459 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.746408 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:19.748394 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.748356 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:19.855223 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:19.855179 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d88506-28dd-411a-ae8b-c314f1898f55" path="/var/lib/kubelet/pods/70d88506-28dd-411a-ae8b-c314f1898f55/volumes" Jun 08 13:01:20.746879 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:20.746818 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:21.746881 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:21.746836 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:22.746169 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:22.746119 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:23.747039 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:23.746991 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:24.746298 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:24.746215 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:25.746515 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:25.746469 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:26.746323 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:26.746265 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:27.746623 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:27.746576 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:28.746217 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:28.746175 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:28.746554 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:28.746522 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:29.746666 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:29.746619 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:30.746130 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:30.746082 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:31.746063 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:31.746017 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 08 13:01:32.872066 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:32.872010 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:01:32.889564 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:32.889501 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7e558a16-f4cc-4431-9a1a-0b6ff2f56209" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:01:34.725471 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:34.725441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:01:34.726493 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:34.726455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:01:42.878825 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:01:42.878783 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:02:00.943980 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.943948 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt"] Jun 08 13:02:00.951550 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.951519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:00.954002 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.953973 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 13:02:00.954002 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.953972 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l4v8p\"" Jun 08 13:02:00.954833 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.954815 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 13:02:00.954954 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.954878 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 13:02:00.969933 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:00.969907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt"] Jun 08 13:02:01.040125 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.040096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.040337 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.040161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.040337 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.040188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.040337 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.040218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.040337 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.040262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50bb437-0068-459e-8529-f2528e3be21c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.040337 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.040287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hvk\" (UniqueName: \"kubernetes.io/projected/c50bb437-0068-459e-8529-f2528e3be21c-kube-api-access-r5hvk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141514 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141514 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141782 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141782 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50bb437-0068-459e-8529-f2528e3be21c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141782 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hvk\" (UniqueName: \"kubernetes.io/projected/c50bb437-0068-459e-8529-f2528e3be21c-kube-api-access-r5hvk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141782 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.141981 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.141947 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.142030 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.142003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.142030 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.142019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.143894 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.143877 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50bb437-0068-459e-8529-f2528e3be21c-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.143999 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.143983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50bb437-0068-459e-8529-f2528e3be21c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.149150 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.149131 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hvk\" (UniqueName: \"kubernetes.io/projected/c50bb437-0068-459e-8529-f2528e3be21c-kube-api-access-r5hvk\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt\" (UID: \"c50bb437-0068-459e-8529-f2528e3be21c\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.262580 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.262487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:01.407959 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.407934 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt"] Jun 08 13:02:01.410106 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:02:01.410077 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50bb437_0068_459e_8529_f2528e3be21c.slice/crio-da49c4ef3d7b755b206ce6f896056f8028eab8bc829507850bac039602d235ed WatchSource:0}: Error finding container da49c4ef3d7b755b206ce6f896056f8028eab8bc829507850bac039602d235ed: Status 404 returned error can't find the container with id da49c4ef3d7b755b206ce6f896056f8028eab8bc829507850bac039602d235ed Jun 08 13:02:01.411930 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.411913 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:02:01.602598 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:01.602557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" event={"ID":"c50bb437-0068-459e-8529-f2528e3be21c","Type":"ContainerStarted","Data":"da49c4ef3d7b755b206ce6f896056f8028eab8bc829507850bac039602d235ed"} Jun 08 13:02:05.625603 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:05.625565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" event={"ID":"c50bb437-0068-459e-8529-f2528e3be21c","Type":"ContainerStarted","Data":"7d7fe02f54167b7e6f4b4231ea59967dba2ef1d591fe50bdc9ea45b3471ae40e"} Jun 08 13:02:06.632342 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:06.632305 2578 generic.go:356] "Generic (PLEG): container finished" podID="c50bb437-0068-459e-8529-f2528e3be21c" containerID="7d7fe02f54167b7e6f4b4231ea59967dba2ef1d591fe50bdc9ea45b3471ae40e" exitCode=0 Jun 08 13:02:06.632739 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:06.632393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" event={"ID":"c50bb437-0068-459e-8529-f2528e3be21c","Type":"ContainerDied","Data":"7d7fe02f54167b7e6f4b4231ea59967dba2ef1d591fe50bdc9ea45b3471ae40e"} Jun 08 13:02:08.644273 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:08.644222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" event={"ID":"c50bb437-0068-459e-8529-f2528e3be21c","Type":"ContainerStarted","Data":"8585423686c03a0cdee66481fb661ebf6d9b499bd94b1d0bb4e244e3ca78399c"} Jun 08 13:02:08.664864 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:08.664808 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" podStartSLOduration=2.9775079460000002 podStartE2EDuration="8.664791271s" totalImagesPullingTime="4.411083204s" totalInitContainerRuntime="1.276200121s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:08.662670802 +0000 UTC m=+635.208069921" watchObservedRunningTime="2026-06-08 13:02:08.664791271 +0000 UTC m=+635.210190389" Jun 08 13:02:11.262802 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:11.262763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:11.263298 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:11.262851 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:11.275503 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:11.275476 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:11.670024 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:11.669993 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt" Jun 08 13:02:24.741082 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.741048 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz"] Jun 08 13:02:24.743726 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.743706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.747881 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.747860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 13:02:24.758381 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.758360 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz"] Jun 08 13:02:24.855704 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.855657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.855929 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.855779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gscl\" (UniqueName: \"kubernetes.io/projected/3b4523de-4102-4485-92a2-895c5e6a3402-kube-api-access-8gscl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.855929 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.855835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.855929 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.855871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.855929 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.855921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b4523de-4102-4485-92a2-895c5e6a3402-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.856128 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.855997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957359 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957359 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957362 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957625 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b4523de-4102-4485-92a2-895c5e6a3402-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957625 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957625 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957625 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gscl\" (UniqueName: \"kubernetes.io/projected/3b4523de-4102-4485-92a2-895c5e6a3402-kube-api-access-8gscl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957843 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957843 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.957940 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.957909 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.959781 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.959760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b4523de-4102-4485-92a2-895c5e6a3402-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.959946 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.959929 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b4523de-4102-4485-92a2-895c5e6a3402-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:24.967409 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:24.967375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gscl\" (UniqueName: \"kubernetes.io/projected/3b4523de-4102-4485-92a2-895c5e6a3402-kube-api-access-8gscl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-lwgvz\" (UID: \"3b4523de-4102-4485-92a2-895c5e6a3402\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:25.055279 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:25.055248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:25.215626 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:25.215445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz"] Jun 08 13:02:25.218401 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:02:25.218374 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4523de_4102_4485_92a2_895c5e6a3402.slice/crio-507ae556ce69aff9c68484d437e0f9a1bfb3a5596090faaebc98d913a6511f08 WatchSource:0}: Error finding container 507ae556ce69aff9c68484d437e0f9a1bfb3a5596090faaebc98d913a6511f08: Status 404 returned error can't find the container with id 507ae556ce69aff9c68484d437e0f9a1bfb3a5596090faaebc98d913a6511f08 Jun 08 13:02:25.726926 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:25.726885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" event={"ID":"3b4523de-4102-4485-92a2-895c5e6a3402","Type":"ContainerStarted","Data":"5eca75948555e2d2171bf295b09dbb8d264849770c29770d1230cdb84d01e491"} Jun 08 13:02:25.727128 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:25.726948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" event={"ID":"3b4523de-4102-4485-92a2-895c5e6a3402","Type":"ContainerStarted","Data":"507ae556ce69aff9c68484d437e0f9a1bfb3a5596090faaebc98d913a6511f08"} Jun 08 13:02:29.746653 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:29.746615 2578 generic.go:356] "Generic (PLEG): container finished" podID="3b4523de-4102-4485-92a2-895c5e6a3402" containerID="5eca75948555e2d2171bf295b09dbb8d264849770c29770d1230cdb84d01e491" exitCode=0 Jun 08 13:02:29.747088 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:29.746689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" event={"ID":"3b4523de-4102-4485-92a2-895c5e6a3402","Type":"ContainerDied","Data":"5eca75948555e2d2171bf295b09dbb8d264849770c29770d1230cdb84d01e491"} Jun 08 13:02:30.725943 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.725908 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc"] Jun 08 13:02:30.728296 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.728279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:30.730609 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.730589 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 13:02:30.740232 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.740208 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc"] Jun 08 13:02:30.910114 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.910075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:30.910576 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.910144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6plb\" (UniqueName: \"kubernetes.io/projected/0ea01452-eac8-443e-9cb1-97941ec195a2-kube-api-access-r6plb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:30.910576 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.910175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea01452-eac8-443e-9cb1-97941ec195a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:30.910576 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.910214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:30.910576 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.910266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:30.910576 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:30.910332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.010990 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.010884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6plb\" (UniqueName: \"kubernetes.io/projected/0ea01452-eac8-443e-9cb1-97941ec195a2-kube-api-access-r6plb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.010990 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.010935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea01452-eac8-443e-9cb1-97941ec195a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.010990 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.010981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.011305 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.011009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.011305 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.011060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.011305 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.011126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.011584 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.011558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.011584 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.011575 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.011768 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.011744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.013519 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.013497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea01452-eac8-443e-9cb1-97941ec195a2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.020515 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.020447 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea01452-eac8-443e-9cb1-97941ec195a2-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.020909 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.020885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6plb\" (UniqueName: \"kubernetes.io/projected/0ea01452-eac8-443e-9cb1-97941ec195a2-kube-api-access-r6plb\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc\" (UID: \"0ea01452-eac8-443e-9cb1-97941ec195a2\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.040938 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.040908 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:02:31.177522 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.177493 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc"] Jun 08 13:02:31.179336 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:02:31.179306 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea01452_eac8_443e_9cb1_97941ec195a2.slice/crio-3fd0e046a3aac37961a1b7c72530aadf91bb49a02da7c0c83487efe9b3aff198 WatchSource:0}: Error finding container 3fd0e046a3aac37961a1b7c72530aadf91bb49a02da7c0c83487efe9b3aff198: Status 404 returned error can't find the container with id 3fd0e046a3aac37961a1b7c72530aadf91bb49a02da7c0c83487efe9b3aff198 Jun 08 13:02:31.758398 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.758360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" event={"ID":"0ea01452-eac8-443e-9cb1-97941ec195a2","Type":"ContainerStarted","Data":"a086f557d77c0336e0a82da297e535dd273776c4838068c29f2eff8524e4631d"} Jun 08 13:02:31.758601 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:31.758417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" event={"ID":"0ea01452-eac8-443e-9cb1-97941ec195a2","Type":"ContainerStarted","Data":"3fd0e046a3aac37961a1b7c72530aadf91bb49a02da7c0c83487efe9b3aff198"} Jun 08 13:02:32.764400 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:32.764366 2578 generic.go:356] "Generic (PLEG): container finished" podID="0ea01452-eac8-443e-9cb1-97941ec195a2" containerID="a086f557d77c0336e0a82da297e535dd273776c4838068c29f2eff8524e4631d" exitCode=0 Jun 08 13:02:32.764826 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:32.764453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" event={"ID":"0ea01452-eac8-443e-9cb1-97941ec195a2","Type":"ContainerDied","Data":"a086f557d77c0336e0a82da297e535dd273776c4838068c29f2eff8524e4631d"} Jun 08 13:02:33.770981 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:33.770942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" event={"ID":"3b4523de-4102-4485-92a2-895c5e6a3402","Type":"ContainerStarted","Data":"69d3f7ef16986b989853d7a865ffa78b66f2cb16f8a1a6381b613f67d48190cf"} Jun 08 13:02:33.794637 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:33.794584 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" podStartSLOduration=2.950625941 podStartE2EDuration="9.794567914s" totalImagesPullingTime="3.334693154s" totalInitContainerRuntime="3.509248819s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:33.791933586 +0000 UTC m=+660.337332705" watchObservedRunningTime="2026-06-08 13:02:33.794567914 +0000 UTC m=+660.339967033" Jun 08 13:02:35.055980 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:35.055951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:35.056436 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:35.056089 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:35.069041 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:35.069019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:35.792233 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:35.792195 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-lwgvz" Jun 08 13:02:43.242853 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.242821 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2"] Jun 08 13:02:43.245884 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.245864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.248209 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.248190 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 13:02:43.263179 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.263153 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2"] Jun 08 13:02:43.306339 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.306299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd995cf-7805-4452-8ae7-4200606e02bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.306552 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.306399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.306552 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.306435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.306552 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.306463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27sjk\" (UniqueName: \"kubernetes.io/projected/bdd995cf-7805-4452-8ae7-4200606e02bf-kube-api-access-27sjk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.306697 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.306615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.306697 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.306650 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408191 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408482 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408587 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd995cf-7805-4452-8ae7-4200606e02bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408587 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408587 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408587 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408738 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27sjk\" (UniqueName: \"kubernetes.io/projected/bdd995cf-7805-4452-8ae7-4200606e02bf-kube-api-access-27sjk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.408800 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.408782 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.409265 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.409213 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.411015 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.410997 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd995cf-7805-4452-8ae7-4200606e02bf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.411417 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.411395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd995cf-7805-4452-8ae7-4200606e02bf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.416258 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.416225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27sjk\" (UniqueName: \"kubernetes.io/projected/bdd995cf-7805-4452-8ae7-4200606e02bf-kube-api-access-27sjk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2\" (UID: \"bdd995cf-7805-4452-8ae7-4200606e02bf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.555998 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.555966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:02:43.691591 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.691560 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2"] Jun 08 13:02:43.694672 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:02:43.694642 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd995cf_7805_4452_8ae7_4200606e02bf.slice/crio-323771907b5a026c5f54ec972db456c4d8649de1b516476b8e123197946feec4 WatchSource:0}: Error finding container 323771907b5a026c5f54ec972db456c4d8649de1b516476b8e123197946feec4: Status 404 returned error can't find the container with id 323771907b5a026c5f54ec972db456c4d8649de1b516476b8e123197946feec4 Jun 08 13:02:43.819069 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.818971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" event={"ID":"bdd995cf-7805-4452-8ae7-4200606e02bf","Type":"ContainerStarted","Data":"19a1e3c83752e5d5a3a7e0e7c9c45430b7bcdca8802af7de70a6fa63a864c6b4"} Jun 08 13:02:43.819259 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:43.819069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" event={"ID":"bdd995cf-7805-4452-8ae7-4200606e02bf","Type":"ContainerStarted","Data":"323771907b5a026c5f54ec972db456c4d8649de1b516476b8e123197946feec4"} Jun 08 13:02:46.834729 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:46.834693 2578 generic.go:356] "Generic (PLEG): container finished" podID="bdd995cf-7805-4452-8ae7-4200606e02bf" containerID="19a1e3c83752e5d5a3a7e0e7c9c45430b7bcdca8802af7de70a6fa63a864c6b4" exitCode=0 Jun 08 13:02:46.835121 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:46.834764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" event={"ID":"bdd995cf-7805-4452-8ae7-4200606e02bf","Type":"ContainerDied","Data":"19a1e3c83752e5d5a3a7e0e7c9c45430b7bcdca8802af7de70a6fa63a864c6b4"} Jun 08 13:02:51.036821 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.036790 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45"] Jun 08 13:02:51.040534 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.040514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.042751 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.042726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 13:02:51.054116 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.054090 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45"] Jun 08 13:02:51.085805 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.085767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.085974 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.085835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.085974 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.085888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrc8\" (UniqueName: \"kubernetes.io/projected/5e998de9-9c4e-45c8-a492-42af5ff78849-kube-api-access-zhrc8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.086066 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.086046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e998de9-9c4e-45c8-a492-42af5ff78849-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.086119 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.086102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.086162 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.086120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.186825 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.186779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e998de9-9c4e-45c8-a492-42af5ff78849-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187036 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.186854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187036 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.186876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187036 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.186903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187036 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.186953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187036 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.186979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrc8\" (UniqueName: \"kubernetes.io/projected/5e998de9-9c4e-45c8-a492-42af5ff78849-kube-api-access-zhrc8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187408 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.187385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187473 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.187385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.187473 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.187456 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.189212 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.189186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e998de9-9c4e-45c8-a492-42af5ff78849-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.189371 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.189355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e998de9-9c4e-45c8-a492-42af5ff78849-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.195882 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.195862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrc8\" (UniqueName: \"kubernetes.io/projected/5e998de9-9c4e-45c8-a492-42af5ff78849-kube-api-access-zhrc8\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-vwx45\" (UID: \"5e998de9-9c4e-45c8-a492-42af5ff78849\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.354401 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.354364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:02:51.491488 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.491462 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45"] Jun 08 13:02:51.493171 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:02:51.493150 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e998de9_9c4e_45c8_a492_42af5ff78849.slice/crio-beefb34f22042b385ff7d09556d4de4f7a9cc65081c2249bb86d9dbf6961c5cb WatchSource:0}: Error finding container beefb34f22042b385ff7d09556d4de4f7a9cc65081c2249bb86d9dbf6961c5cb: Status 404 returned error can't find the container with id beefb34f22042b385ff7d09556d4de4f7a9cc65081c2249bb86d9dbf6961c5cb Jun 08 13:02:51.860590 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.860490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" event={"ID":"0ea01452-eac8-443e-9cb1-97941ec195a2","Type":"ContainerStarted","Data":"8bfb8139717970ae3bf2c3c6b1e11fe4651ed9a8066144ac121f323d53434510"} Jun 08 13:02:51.861984 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.861957 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" event={"ID":"5e998de9-9c4e-45c8-a492-42af5ff78849","Type":"ContainerStarted","Data":"e5d751e0641b6878137bf50efe6855b7e06752effb7b3e388c83852b29d1a348"} Jun 08 13:02:51.862121 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.862003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" event={"ID":"5e998de9-9c4e-45c8-a492-42af5ff78849","Type":"ContainerStarted","Data":"beefb34f22042b385ff7d09556d4de4f7a9cc65081c2249bb86d9dbf6961c5cb"} Jun 08 13:02:51.877985 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:51.877918 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" podStartSLOduration=2.05894693 podStartE2EDuration="21.877899402s" totalImagesPullingTime="18.487847731s" totalInitContainerRuntime="1.331104741s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:51.877454443 +0000 UTC m=+678.422853605" watchObservedRunningTime="2026-06-08 13:02:51.877899402 +0000 UTC m=+678.423298522" Jun 08 13:02:52.868431 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:52.868366 2578 generic.go:356] "Generic (PLEG): container finished" podID="5e998de9-9c4e-45c8-a492-42af5ff78849" containerID="e5d751e0641b6878137bf50efe6855b7e06752effb7b3e388c83852b29d1a348" exitCode=0 Jun 08 13:02:52.868826 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:52.868460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" event={"ID":"5e998de9-9c4e-45c8-a492-42af5ff78849","Type":"ContainerDied","Data":"e5d751e0641b6878137bf50efe6855b7e06752effb7b3e388c83852b29d1a348"} Jun 08 13:02:53.875575 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:53.875543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" event={"ID":"5e998de9-9c4e-45c8-a492-42af5ff78849","Type":"ContainerStarted","Data":"d242edd2da6cd96d32e3fa6cfe930d5d6186a7a677e4db03c7a0a653c7e94945"} Jun 08 13:02:53.899956 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:53.899904 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" podStartSLOduration=1.16604345 podStartE2EDuration="2.899888512s" totalImagesPullingTime="450.904379ms" totalInitContainerRuntime="1.282940683s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:53.896867901 +0000 UTC m=+680.442267031" watchObservedRunningTime="2026-06-08 13:02:53.899888512 +0000 UTC m=+680.445287631" Jun 08 13:02:58.038121 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.038088 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2"] Jun 08 13:02:58.042733 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.042716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.045123 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.045105 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 13:02:58.051272 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.051229 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2"] Jun 08 13:02:58.148325 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.148287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.148325 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.148328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwj62\" (UniqueName: \"kubernetes.io/projected/31d774fb-fbb2-401e-97c6-7c57b699a768-kube-api-access-wwj62\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.148559 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.148380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.148559 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.148429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31d774fb-fbb2-401e-97c6-7c57b699a768-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.148559 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.148511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.148720 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.148559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.249918 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.249884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.249918 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.249918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250129 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.249965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250129 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.249981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwj62\" (UniqueName: \"kubernetes.io/projected/31d774fb-fbb2-401e-97c6-7c57b699a768-kube-api-access-wwj62\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250129 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.250004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250354 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.250198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31d774fb-fbb2-401e-97c6-7c57b699a768-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250403 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.250364 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250439 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.250422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.250496 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.250475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.252208 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.252188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31d774fb-fbb2-401e-97c6-7c57b699a768-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.252546 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.252530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31d774fb-fbb2-401e-97c6-7c57b699a768-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.258602 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.258582 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwj62\" (UniqueName: \"kubernetes.io/projected/31d774fb-fbb2-401e-97c6-7c57b699a768-kube-api-access-wwj62\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xq9f2\" (UID: \"31d774fb-fbb2-401e-97c6-7c57b699a768\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.352988 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.352952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:02:58.489020 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.488995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2"] Jun 08 13:02:58.490678 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:02:58.490646 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d774fb_fbb2_401e_97c6_7c57b699a768.slice/crio-6acfcdc32b9afa78d534494ae813de80a16a0be89b08d9ff4f479691f04f4b47 WatchSource:0}: Error finding container 6acfcdc32b9afa78d534494ae813de80a16a0be89b08d9ff4f479691f04f4b47: Status 404 returned error can't find the container with id 6acfcdc32b9afa78d534494ae813de80a16a0be89b08d9ff4f479691f04f4b47 Jun 08 13:02:58.900575 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.900532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" event={"ID":"31d774fb-fbb2-401e-97c6-7c57b699a768","Type":"ContainerStarted","Data":"25b486e9f59202b1433908763bad5c8f4efee1aa54924add33faf22fd0d62ffc"} Jun 08 13:02:58.900767 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:58.900588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" event={"ID":"31d774fb-fbb2-401e-97c6-7c57b699a768","Type":"ContainerStarted","Data":"6acfcdc32b9afa78d534494ae813de80a16a0be89b08d9ff4f479691f04f4b47"} Jun 08 13:02:59.907290 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:59.907234 2578 generic.go:356] "Generic (PLEG): container finished" podID="31d774fb-fbb2-401e-97c6-7c57b699a768" containerID="25b486e9f59202b1433908763bad5c8f4efee1aa54924add33faf22fd0d62ffc" exitCode=0 Jun 08 13:02:59.907729 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:59.907345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" event={"ID":"31d774fb-fbb2-401e-97c6-7c57b699a768","Type":"ContainerDied","Data":"25b486e9f59202b1433908763bad5c8f4efee1aa54924add33faf22fd0d62ffc"} Jun 08 13:02:59.909352 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:59.909326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" event={"ID":"bdd995cf-7805-4452-8ae7-4200606e02bf","Type":"ContainerStarted","Data":"de4b0574768d2fcd14bfac09880b9bbf3fb8ebc4832fe6f5d280b0dbd8b436c6"} Jun 08 13:02:59.949594 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:02:59.949545 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" podStartSLOduration=1.963762862 podStartE2EDuration="16.949528488s" totalImagesPullingTime="12.653301958s" totalInitContainerRuntime="2.332463668s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:59.948507243 +0000 UTC m=+686.493906387" watchObservedRunningTime="2026-06-08 13:02:59.949528488 +0000 UTC m=+686.494927606" Jun 08 13:03:00.916923 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:00.916886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" event={"ID":"31d774fb-fbb2-401e-97c6-7c57b699a768","Type":"ContainerStarted","Data":"217f3bd21963beb096ccf781a746f279fa35369de8dcac8e0b6eb9f0746d929a"} Jun 08 13:03:00.937182 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:00.937123 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" podStartSLOduration=1.461983075 podStartE2EDuration="2.937108932s" totalImagesPullingTime="238.75775ms" totalInitContainerRuntime="1.236368107s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:03:00.935186591 +0000 UTC m=+687.480585712" watchObservedRunningTime="2026-06-08 13:03:00.937108932 +0000 UTC m=+687.482508101" Jun 08 13:03:01.041515 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.041476 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:03:01.041709 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.041576 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:03:01.053859 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.053839 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:03:01.354806 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.354775 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:03:01.354966 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.354825 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:03:01.366775 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.366749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:03:01.933957 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.933931 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc" Jun 08 13:03:01.934852 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:01.934832 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-vwx45" Jun 08 13:03:03.556973 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:03.556943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:03:03.557376 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:03.556999 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:03:03.569352 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:03.569331 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:03:03.943508 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:03.943426 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2" Jun 08 13:03:08.353861 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:08.353825 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:03:08.354347 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:08.353908 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:03:08.366897 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:08.366873 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:03:08.974305 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:03:08.974274 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xq9f2" Jun 08 13:06:25.461872 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.461778 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-776788969f-9wqtg"] Jun 08 13:06:25.464479 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.462045 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-776788969f-9wqtg" podUID="57c8dcb4-5f4c-4375-b2c3-1e777eeab154" containerName="manager" containerID="cri-o://e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28" gracePeriod=30 Jun 08 13:06:25.712974 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.712907 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:06:25.750220 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.750185 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-webhook-cert\") pod \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " Jun 08 13:06:25.750395 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.750329 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w5f5\" (UniqueName: \"kubernetes.io/projected/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-kube-api-access-8w5f5\") pod \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\" (UID: \"57c8dcb4-5f4c-4375-b2c3-1e777eeab154\") " Jun 08 13:06:25.752782 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.752748 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "57c8dcb4-5f4c-4375-b2c3-1e777eeab154" (UID: "57c8dcb4-5f4c-4375-b2c3-1e777eeab154"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:25.752782 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.752756 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-kube-api-access-8w5f5" (OuterVolumeSpecName: "kube-api-access-8w5f5") pod "57c8dcb4-5f4c-4375-b2c3-1e777eeab154" (UID: "57c8dcb4-5f4c-4375-b2c3-1e777eeab154"). InnerVolumeSpecName "kube-api-access-8w5f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:25.851644 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.851605 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w5f5\" (UniqueName: \"kubernetes.io/projected/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-kube-api-access-8w5f5\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 13:06:25.851644 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.851642 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57c8dcb4-5f4c-4375-b2c3-1e777eeab154-webhook-cert\") on node \"ip-10-0-133-240.ec2.internal\" DevicePath \"\"" Jun 08 13:06:25.935157 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.935120 2578 generic.go:356] "Generic (PLEG): container finished" podID="57c8dcb4-5f4c-4375-b2c3-1e777eeab154" containerID="e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28" exitCode=0 Jun 08 13:06:25.935389 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.935173 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776788969f-9wqtg" Jun 08 13:06:25.935389 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.935178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776788969f-9wqtg" event={"ID":"57c8dcb4-5f4c-4375-b2c3-1e777eeab154","Type":"ContainerDied","Data":"e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28"} Jun 08 13:06:25.935389 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.935231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776788969f-9wqtg" event={"ID":"57c8dcb4-5f4c-4375-b2c3-1e777eeab154","Type":"ContainerDied","Data":"7eb3141abb9b1f7f1d976a280e868e18c4e6bed85edb1d183c7df8208bb562b6"} Jun 08 13:06:25.935389 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.935279 2578 scope.go:117] "RemoveContainer" containerID="e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28" Jun 08 13:06:25.944005 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.943983 2578 scope.go:117] "RemoveContainer" containerID="e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28" Jun 08 13:06:25.944311 ip-10-0-133-240 kubenswrapper[2578]: E0608 13:06:25.944287 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28\": container with ID starting with e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28 not found: ID does not exist" containerID="e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28" Jun 08 13:06:25.944388 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.944314 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28"} err="failed to get container status \"e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28\": rpc error: code = NotFound desc = could not find container \"e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28\": container with ID starting with e9825873cf7249c65c9647fada91af25de7bf39c4434d62ea32c0d065734ac28 not found: ID does not exist" Jun 08 13:06:25.951860 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.951836 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-776788969f-9wqtg"] Jun 08 13:06:25.955778 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:25.955755 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-776788969f-9wqtg"] Jun 08 13:06:27.855232 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:27.855196 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c8dcb4-5f4c-4375-b2c3-1e777eeab154" path="/var/lib/kubelet/pods/57c8dcb4-5f4c-4375-b2c3-1e777eeab154/volumes" Jun 08 13:06:34.756340 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:34.756309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:06:34.759657 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:06:34.759630 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:11:34.786695 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:11:34.786664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:11:34.789817 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:11:34.789795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:16:34.815304 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:16:34.815278 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:16:34.820056 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:16:34.820037 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:21:34.844978 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:21:34.844857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:21:34.851202 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:21:34.851184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:26:34.880199 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:26:34.880073 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:26:34.887255 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:26:34.887226 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2p2nz_e70cceef-bb33-4d3e-9837-f1de06b43cac/ovn-acl-logging/0.log" Jun 08 13:28:12.297048 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:12.297020 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9d8bf5dcd-fmgfc_0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35/nginx/0.log" Jun 08 13:28:12.520504 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:12.520473 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hbdrb_050d6b04-5778-4e47-a649-c25eee5cce9d/manager/0.log" Jun 08 13:28:12.632411 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:12.632337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-mzhnf_fbbb75e1-ee6e-47c9-a81b-7d855f327110/manager/0.log" Jun 08 13:28:12.742879 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:12.742854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cd5cb5d7f-7x5pz_6d7b77b5-839e-4c50-8016-d88cb7048dc0/maas-api/0.log" Jun 08 13:28:13.102030 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:13.102006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-nw77q_c118ed4e-941b-483d-9082-bcab6e5ec6e6/server/0.log" Jun 08 13:28:13.336717 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:13.336686 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-6xfwz_ffd3e19a-fd37-4011-b0ce-88efe3ae798f/copy-manifests/0.log" Jun 08 13:28:13.343336 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:13.343314 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-6xfwz_ffd3e19a-fd37-4011-b0ce-88efe3ae798f/manager/0.log" Jun 08 13:28:15.079113 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:15.079081 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h5b92_a3b229e2-6340-493c-984c-9c5246f9ae52/manager/0.log" Jun 08 13:28:16.285151 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:16.285117 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fxhz8_3a729e50-bebf-401a-9da4-946992c55a58/discovery/0.log" Jun 08 13:28:16.404207 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:16.404182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69996bcc67-6drmd_496fd6ed-6474-4105-bdb0-3578cb976075/kube-auth-proxy/0.log" Jun 08 13:28:16.649148 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:16.649121 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/1.log" Jun 08 13:28:16.767508 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:16.767478 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v7grm_25d89dcc-b22a-4970-804b-3fca7f693a66/payload-pre-processing/0.log" Jun 08 13:28:17.336284 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.336252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt_c50bb437-0068-459e-8529-f2528e3be21c/storage-initializer/0.log" Jun 08 13:28:17.346798 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.346772 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-tzrpt_c50bb437-0068-459e-8529-f2528e3be21c/main/0.log" Jun 08 13:28:17.450693 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.450665 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-lwgvz_3b4523de-4102-4485-92a2-895c5e6a3402/storage-initializer/0.log" Jun 08 13:28:17.457044 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.457018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-lwgvz_3b4523de-4102-4485-92a2-895c5e6a3402/main/0.log" Jun 08 13:28:17.560032 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.560003 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc_0ea01452-eac8-443e-9cb1-97941ec195a2/storage-initializer/0.log" Jun 08 13:28:17.567108 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.567086 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v52lc_0ea01452-eac8-443e-9cb1-97941ec195a2/main/0.log" Jun 08 13:28:17.694219 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.694141 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2_bdd995cf-7805-4452-8ae7-4200606e02bf/storage-initializer/0.log" Jun 08 13:28:17.707796 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.707770 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cktvw2_bdd995cf-7805-4452-8ae7-4200606e02bf/main/0.log" Jun 08 13:28:17.821440 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.821412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-vwx45_5e998de9-9c4e-45c8-a492-42af5ff78849/storage-initializer/0.log" Jun 08 13:28:17.828602 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.828577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-vwx45_5e998de9-9c4e-45c8-a492-42af5ff78849/main/0.log" Jun 08 13:28:17.939719 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.939693 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-xq9f2_31d774fb-fbb2-401e-97c6-7c57b699a768/storage-initializer/0.log" Jun 08 13:28:17.947888 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:17.947823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-xq9f2_31d774fb-fbb2-401e-97c6-7c57b699a768/main/0.log" Jun 08 13:28:25.741538 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:25.741500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kv2l6_25f5a502-d1dd-47d6-9c52-3ea7d7afe176/global-pull-secret-syncer/0.log" Jun 08 13:28:25.873315 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:25.873286 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jwwcp_dcc94624-b453-49e5-b9e8-092c996db370/konnectivity-agent/0.log" Jun 08 13:28:25.959479 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:25.959444 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-240.ec2.internal_99efa69a4b5a002c8f285a7ebacbc192/haproxy/0.log" Jun 08 13:28:28.747009 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:28.746976 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-xzbjr_294470cd-28c2-4ad1-a478-cebee57ea279/sail-operator/0.log" Jun 08 13:28:31.262780 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:31.262751 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h5b92_a3b229e2-6340-493c-984c-9c5246f9ae52/manager/0.log" Jun 08 13:28:33.651821 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:33.651791 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pbmr5_a4779105-24a8-4080-9c20-0f13aef5e508/node-exporter/0.log" Jun 08 13:28:33.674224 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:33.674198 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pbmr5_a4779105-24a8-4080-9c20-0f13aef5e508/kube-rbac-proxy/0.log" Jun 08 13:28:33.698917 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:33.698886 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pbmr5_a4779105-24a8-4080-9c20-0f13aef5e508/init-textfile/0.log" Jun 08 13:28:34.247767 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:34.247741 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857bf9b6ff-g68mj_434c44f5-8266-4239-b597-3d7ee70633ca/thanos-query/0.log" Jun 08 13:28:34.270399 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:34.270375 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857bf9b6ff-g68mj_434c44f5-8266-4239-b597-3d7ee70633ca/kube-rbac-proxy-web/0.log" Jun 08 13:28:34.290950 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:34.290925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857bf9b6ff-g68mj_434c44f5-8266-4239-b597-3d7ee70633ca/kube-rbac-proxy/0.log" Jun 08 13:28:34.314733 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:34.314702 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857bf9b6ff-g68mj_434c44f5-8266-4239-b597-3d7ee70633ca/prom-label-proxy/0.log" Jun 08 13:28:34.337380 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:34.337358 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857bf9b6ff-g68mj_434c44f5-8266-4239-b597-3d7ee70633ca/kube-rbac-proxy-rules/0.log" Jun 08 13:28:34.360163 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:34.360141 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857bf9b6ff-g68mj_434c44f5-8266-4239-b597-3d7ee70633ca/kube-rbac-proxy-metrics/0.log" Jun 08 13:28:37.180051 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.180016 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg"] Jun 08 13:28:37.180456 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.180442 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c8dcb4-5f4c-4375-b2c3-1e777eeab154" containerName="manager" Jun 08 13:28:37.180500 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.180457 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c8dcb4-5f4c-4375-b2c3-1e777eeab154" containerName="manager" Jun 08 13:28:37.180547 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.180529 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c8dcb4-5f4c-4375-b2c3-1e777eeab154" containerName="manager" Jun 08 13:28:37.183230 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.183214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.185570 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.185550 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmw6\"/\"kube-root-ca.crt\"" Jun 08 13:28:37.186325 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.186304 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bzmw6\"/\"default-dockercfg-rqr4g\"" Jun 08 13:28:37.186325 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.186319 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmw6\"/\"openshift-service-ca.crt\"" Jun 08 13:28:37.193559 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.193534 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg"] Jun 08 13:28:37.219249 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.219180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-proc\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.219411 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.219264 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-podres\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.219411 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.219303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d86j8\" (UniqueName: \"kubernetes.io/projected/cf646cdc-9152-49c0-81bd-533818b765a2-kube-api-access-d86j8\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.219411 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.219331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-sys\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.219411 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.219393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-lib-modules\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320045 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-proc\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320045 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-podres\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d86j8\" (UniqueName: \"kubernetes.io/projected/cf646cdc-9152-49c0-81bd-533818b765a2-kube-api-access-d86j8\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-sys\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-proc\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-lib-modules\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-sys\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-podres\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.320368 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.320359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf646cdc-9152-49c0-81bd-533818b765a2-lib-modules\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.328078 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.328056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d86j8\" (UniqueName: \"kubernetes.io/projected/cf646cdc-9152-49c0-81bd-533818b765a2-kube-api-access-d86j8\") pod \"perf-node-gather-daemonset-mz9fg\" (UID: \"cf646cdc-9152-49c0-81bd-533818b765a2\") " pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.494080 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.493995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:37.631102 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:37.630991 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg"] Jun 08 13:28:37.633996 ip-10-0-133-240 kubenswrapper[2578]: W0608 13:28:37.633964 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf646cdc_9152_49c0_81bd_533818b765a2.slice/crio-5bebf58a645c2d12ed17049f1a0eed9acb6c13b2add7ec5e3624cf871d573f44 WatchSource:0}: Error finding container 5bebf58a645c2d12ed17049f1a0eed9acb6c13b2add7ec5e3624cf871d573f44: Status 404 returned error can't find the container with id 5bebf58a645c2d12ed17049f1a0eed9acb6c13b2add7ec5e3624cf871d573f44 Jun 08 13:28:38.458345 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:38.458309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" event={"ID":"cf646cdc-9152-49c0-81bd-533818b765a2","Type":"ContainerStarted","Data":"6a090c705746b7a224e6a552ee623ac5d606da84cd4c33fe5321c20ae84b4616"} Jun 08 13:28:38.458825 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:38.458375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" event={"ID":"cf646cdc-9152-49c0-81bd-533818b765a2","Type":"ContainerStarted","Data":"5bebf58a645c2d12ed17049f1a0eed9acb6c13b2add7ec5e3624cf871d573f44"} Jun 08 13:28:38.458825 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:38.458403 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:38.475814 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:38.475769 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" podStartSLOduration=1.475752124 podStartE2EDuration="1.475752124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:28:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:28:38.473528261 +0000 UTC m=+2225.018927381" watchObservedRunningTime="2026-06-08 13:28:38.475752124 +0000 UTC m=+2225.021151246" Jun 08 13:28:38.980319 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:38.980287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fc68d_c2bfa6ff-b71e-453a-92cf-e8d009d606ab/dns/0.log" Jun 08 13:28:39.003317 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:39.003289 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fc68d_c2bfa6ff-b71e-453a-92cf-e8d009d606ab/kube-rbac-proxy/0.log" Jun 08 13:28:39.267267 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:39.267177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-47sk9_dc0d5d50-26c7-4151-90e2-828d147c2077/dns-node-resolver/0.log" Jun 08 13:28:39.965631 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:39.965606 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bz8sf_f5c1e8a5-8e6d-4f00-a967-af62c04fb95b/node-ca/0.log" Jun 08 13:28:41.137943 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:41.137907 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fxhz8_3a729e50-bebf-401a-9da4-946992c55a58/discovery/0.log" Jun 08 13:28:41.162350 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:41.162322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69996bcc67-6drmd_496fd6ed-6474-4105-bdb0-3578cb976075/kube-auth-proxy/0.log" Jun 08 13:28:41.225799 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:41.225735 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/0.log" Jun 08 13:28:41.258080 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:41.258046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/1.log" Jun 08 13:28:41.301166 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:41.301136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v7grm_25d89dcc-b22a-4970-804b-3fca7f693a66/payload-pre-processing/0.log" Jun 08 13:28:42.114052 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:42.114027 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vr4b9_69e875b7-db79-44fc-bc35-72d8ba567990/serve-healthcheck-canary/0.log" Jun 08 13:28:42.783168 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:42.783140 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gtqhs_48bd3eb6-56ce-4dd2-bb15-e4306c266c1f/kube-rbac-proxy/0.log" Jun 08 13:28:42.805681 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:42.805655 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gtqhs_48bd3eb6-56ce-4dd2-bb15-e4306c266c1f/exporter/0.log" Jun 08 13:28:42.826328 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:42.826302 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gtqhs_48bd3eb6-56ce-4dd2-bb15-e4306c266c1f/extractor/0.log" Jun 08 13:28:44.472798 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:44.472774 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bzmw6/perf-node-gather-daemonset-mz9fg" Jun 08 13:28:45.172871 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.172845 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9d8bf5dcd-fmgfc_0b09c4dd-3989-4f4b-8dda-d1bbe31aeb35/nginx/0.log" Jun 08 13:28:45.226537 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.226509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-hbdrb_050d6b04-5778-4e47-a649-c25eee5cce9d/manager/0.log" Jun 08 13:28:45.322393 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.322347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-mzhnf_fbbb75e1-ee6e-47c9-a81b-7d855f327110/manager/0.log" Jun 08 13:28:45.362721 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.362691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6cd5cb5d7f-7x5pz_6d7b77b5-839e-4c50-8016-d88cb7048dc0/maas-api/0.log" Jun 08 13:28:45.529868 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.529780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-nw77q_c118ed4e-941b-483d-9082-bcab6e5ec6e6/server/0.log" Jun 08 13:28:45.632445 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.632420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-6xfwz_ffd3e19a-fd37-4011-b0ce-88efe3ae798f/manager/0.log" Jun 08 13:28:45.657355 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:45.657330 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85bcc7b555-6xfwz_ffd3e19a-fd37-4011-b0ce-88efe3ae798f/copy-manifests/0.log" Jun 08 13:28:50.819401 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:50.819369 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fxhz8_3a729e50-bebf-401a-9da4-946992c55a58/discovery/0.log" Jun 08 13:28:50.830943 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:50.830919 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69996bcc67-6drmd_496fd6ed-6474-4105-bdb0-3578cb976075/kube-auth-proxy/0.log" Jun 08 13:28:50.869691 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:50.869668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/0.log" Jun 08 13:28:50.903494 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:50.903461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/1.log" Jun 08 13:28:50.939325 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:50.939293 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v7grm_25d89dcc-b22a-4970-804b-3fca7f693a66/payload-pre-processing/0.log" Jun 08 13:28:52.300116 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:52.300011 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fxhz8_3a729e50-bebf-401a-9da4-946992c55a58/discovery/0.log" Jun 08 13:28:52.318532 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:52.318506 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69996bcc67-6drmd_496fd6ed-6474-4105-bdb0-3578cb976075/kube-auth-proxy/0.log" Jun 08 13:28:52.367382 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:52.367354 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/0.log" Jun 08 13:28:52.398823 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:52.398791 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/1.log" Jun 08 13:28:52.437417 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:52.437387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v7grm_25d89dcc-b22a-4970-804b-3fca7f693a66/payload-pre-processing/0.log" Jun 08 13:28:53.631618 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:53.631591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-n8vvx_0ef4f66c-9c68-434b-8633-2914ae133832/migrator/0.log" Jun 08 13:28:53.671476 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:53.671447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-n8vvx_0ef4f66c-9c68-434b-8633-2914ae133832/graceful-termination/0.log" Jun 08 13:28:54.363465 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:54.363429 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-fxhz8_3a729e50-bebf-401a-9da4-946992c55a58/discovery/0.log" Jun 08 13:28:54.377345 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:54.377324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69996bcc67-6drmd_496fd6ed-6474-4105-bdb0-3578cb976075/kube-auth-proxy/0.log" Jun 08 13:28:54.414192 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:54.414161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/0.log" Jun 08 13:28:54.450615 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:54.450559 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-v8b7d_d1cac630-234d-471e-a524-4744cbd2377c/istio-proxy/1.log" Jun 08 13:28:54.483413 ip-10-0-133-240 kubenswrapper[2578]: I0608 13:28:54.483381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-v7grm_25d89dcc-b22a-4970-804b-3fca7f693a66/payload-pre-processing/0.log"