Jun 10 13:01:04.669924 ip-10-0-128-45 systemd[1]: Starting Kubernetes Kubelet... Jun 10 13:01:05.122707 ip-10-0-128-45 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:01:05.122707 ip-10-0-128-45 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 13:01:05.122707 ip-10-0-128-45 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:01:05.122707 ip-10-0-128-45 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 13:01:05.122707 ip-10-0-128-45 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:01:05.123826 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.123613 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 13:01:05.129432 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129408 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:01:05.129432 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129430 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:01:05.129432 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129435 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:01:05.129432 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129440 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129444 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129447 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129450 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129454 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129456 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129459 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129461 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129464 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129467 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129470 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129472 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129475 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129477 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129480 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129482 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129485 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129488 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129491 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129493 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:01:05.129616 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129496 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129498 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129500 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129503 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129505 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129508 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129529 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129531 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129535 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129537 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129540 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129543 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129547 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129550 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129553 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129555 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129558 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129561 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129564 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129566 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:01:05.130092 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129569 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129574 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129578 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129581 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129583 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129586 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129588 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129598 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129600 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129603 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129606 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129608 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129611 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129613 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129616 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129618 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129621 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129625 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:01:05.130596 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129629 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129632 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129636 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129639 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129642 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129646 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129649 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129652 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129655 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129658 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129661 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129663 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129666 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129668 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129671 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129674 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129677 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129679 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129682 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129684 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:01:05.131026 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129687 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129690 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129700 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129703 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129705 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129708 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129711 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129713 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129716 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129724 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129728 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129730 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129734 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129736 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129739 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129741 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129744 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.129747 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130493 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130499 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:01:05.131530 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130502 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130505 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130507 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130525 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130528 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130531 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130534 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130537 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130540 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130542 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130545 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130548 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130551 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130554 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130557 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130560 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130563 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130566 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130568 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130571 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:01:05.132019 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130573 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130576 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130579 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130582 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130584 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130587 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130590 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130594 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130598 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130602 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130605 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130608 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130611 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130614 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130616 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130619 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130621 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130624 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130626 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:01:05.132525 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130629 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130631 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130634 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130637 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130639 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130642 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130645 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130648 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130650 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130654 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130656 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130659 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130661 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130664 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130666 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130669 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130672 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130675 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130677 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:01:05.133000 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130680 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130682 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130685 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130687 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130689 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130692 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130694 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130697 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130700 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130702 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130706 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130709 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130711 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130714 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130717 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130719 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130722 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130724 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130727 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130730 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:01:05.133471 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130733 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130735 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130738 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130741 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130744 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130746 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130749 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130752 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130756 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130759 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130761 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130764 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130766 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130769 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130771 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130774 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130777 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130781 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.130784 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:01:05.133976 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131171 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131176 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131179 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131182 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131185 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131188 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131193 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131196 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131199 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131201 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131204 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131206 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131209 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131212 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131215 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131218 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131221 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131224 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131227 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:01:05.134437 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131230 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131232 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131235 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131238 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131240 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131243 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131245 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131248 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131250 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131253 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131256 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131258 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131261 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131263 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131266 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131268 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131271 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131273 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131275 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131280 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:01:05.134937 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131282 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131285 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131288 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131292 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131294 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131297 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131299 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131303 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131307 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131310 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131313 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131317 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131321 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131323 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131326 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131329 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131332 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131335 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131337 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:01:05.135441 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131340 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131343 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131346 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131348 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131351 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131353 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131356 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131358 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131361 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131364 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131366 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131369 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131373 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131375 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131379 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131382 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131387 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131390 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131392 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:01:05.135945 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131395 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131397 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131431 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131435 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131438 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131441 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131444 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131447 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131450 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131453 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131456 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131458 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131461 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131464 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131467 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131469 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131472 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131475 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131477 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131480 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:01:05.136401 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131483 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.131485 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131563 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131570 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131585 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131591 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131596 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131599 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131603 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131609 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131612 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131615 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131618 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131622 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131625 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131628 2562 flags.go:64] FLAG: --cgroup-root="" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131631 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131634 2562 flags.go:64] FLAG: --client-ca-file="" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131643 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131646 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131654 2562 flags.go:64] FLAG: --cluster-domain="" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131657 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131660 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131663 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 13:01:05.136909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131667 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131670 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131673 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131676 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131679 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131682 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131685 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131688 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131692 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131695 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131699 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131702 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131705 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131707 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131710 2562 flags.go:64] FLAG: --enable-server="true" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131713 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131720 2562 flags.go:64] FLAG: --event-burst="100" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131725 2562 flags.go:64] FLAG: --event-qps="50" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131728 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131731 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131734 2562 flags.go:64] FLAG: --eviction-hard="" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131737 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131740 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131743 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131746 2562 flags.go:64] FLAG: --eviction-soft="" Jun 10 13:01:05.137525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131749 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131752 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131755 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131758 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131762 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131765 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131767 2562 flags.go:64] FLAG: --feature-gates="" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131771 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131774 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131777 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131780 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131783 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131786 2562 flags.go:64] FLAG: --help="false" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131789 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131792 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131795 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131797 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131801 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131804 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131807 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131810 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131812 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131815 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 13:01:05.138123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131818 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131823 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131825 2562 flags.go:64] FLAG: --kube-reserved="" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131828 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131831 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131834 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131837 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131839 2562 flags.go:64] FLAG: --lock-file="" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131842 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131845 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131848 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131853 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131857 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131860 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131863 2562 flags.go:64] FLAG: --logging-format="text" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131866 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131869 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131872 2562 flags.go:64] FLAG: --manifest-url="" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131875 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131879 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131882 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131886 2562 flags.go:64] FLAG: --max-pods="110" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131889 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131892 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131895 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 13:01:05.138725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131897 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131900 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131903 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131906 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131913 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131916 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131919 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131922 2562 flags.go:64] FLAG: --pod-cidr="" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131926 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131931 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131934 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131937 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131940 2562 flags.go:64] FLAG: --port="10250" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131943 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131946 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00d5748310c28fd3c" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131950 2562 flags.go:64] FLAG: --qos-reserved="" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131952 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131955 2562 flags.go:64] FLAG: --register-node="true" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131958 2562 flags.go:64] FLAG: --register-with-taints="" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131962 2562 flags.go:64] FLAG: --registry-burst="10" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131966 2562 flags.go:64] FLAG: --registry-qps="5" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131969 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131972 2562 flags.go:64] FLAG: --reserved-memory="" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131976 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131979 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 13:01:05.139416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131982 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131985 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131988 2562 flags.go:64] FLAG: --runonce="false" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131991 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131994 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131997 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.131999 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132002 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132005 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132008 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132011 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132013 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132016 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132019 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132022 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132025 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132029 2562 flags.go:64] FLAG: --system-cgroups="" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132032 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132037 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132040 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132043 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132049 2562 flags.go:64] FLAG: --tls-min-version="" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132052 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132055 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132057 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 13:01:05.140089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132060 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132063 2562 flags.go:64] FLAG: --v="2" Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132068 2562 flags.go:64] FLAG: --version="false" Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132074 2562 flags.go:64] FLAG: --vmodule="" Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132077 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.132081 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132207 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132211 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132215 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132218 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132221 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132224 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132226 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132229 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132231 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132234 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132236 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132239 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132241 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132244 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:01:05.140755 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132247 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132249 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132252 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132254 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132257 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132260 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132263 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132265 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132268 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132271 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132273 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132276 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132278 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132281 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132285 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132288 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132291 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132294 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132296 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132299 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:01:05.141252 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132301 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132305 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132308 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132311 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132314 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132317 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132319 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132322 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132325 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132328 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132331 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132334 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132337 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132340 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132342 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132345 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132348 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132351 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132355 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:01:05.141754 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132358 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132361 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132364 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132367 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132369 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132372 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132374 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132379 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132382 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132384 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132387 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132390 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132393 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132396 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132398 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132401 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132403 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132406 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132409 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132411 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:01:05.142217 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132414 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132416 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132418 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132421 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132423 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132426 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132429 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132431 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132434 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132437 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132439 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132442 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132444 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132447 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132449 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132451 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132454 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132456 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132460 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132465 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:01:05.142753 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132470 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132476 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132479 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132482 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132485 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.132488 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.133172 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.139968 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.139985 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.140842 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.140858 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140916 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140923 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140929 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140934 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:01:05.143245 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140939 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140944 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140948 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140951 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140954 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140957 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140960 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140963 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140966 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140969 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140973 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140977 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140980 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140982 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140985 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140988 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140991 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140993 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.140996 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:01:05.143646 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141000 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141004 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141009 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141013 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141017 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141020 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141025 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141028 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141031 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141033 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141036 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141038 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141041 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141044 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141047 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141049 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141052 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141054 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141057 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141060 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:01:05.144129 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141062 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141065 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141067 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141070 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141073 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141075 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141078 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141083 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141087 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141092 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141096 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141099 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141101 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141104 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141107 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141109 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141112 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141114 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141118 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141121 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:01:05.144633 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141124 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141127 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141129 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141132 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141136 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141139 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141142 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141144 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141147 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141149 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141152 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141155 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141159 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141163 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141168 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141172 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141176 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141179 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141182 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:01:05.145111 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141184 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141187 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141190 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141192 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141195 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141198 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141200 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141203 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141206 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141209 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141212 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141214 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141217 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141221 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141223 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141226 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:01:05.145713 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141228 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.141233 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141361 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141367 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141370 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141373 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141376 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141379 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141382 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141385 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141388 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141390 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141393 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141397 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141402 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:01:05.146100 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141406 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141411 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141415 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141417 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141420 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141423 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141428 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141432 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141436 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141439 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141441 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141444 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141448 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141450 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141453 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141456 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141459 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141462 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141464 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:01:05.146470 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141467 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141469 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141472 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141476 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141480 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141484 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141488 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141493 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141496 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141498 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141501 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141504 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141506 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141522 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141525 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141528 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141530 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141533 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141535 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141538 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:01:05.146948 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141541 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141543 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141546 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141548 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141551 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141555 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141559 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141564 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141568 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141574 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141577 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141580 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141583 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141585 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141588 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141590 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141593 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141595 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141598 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:01:05.147443 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141600 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141603 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141605 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141608 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141610 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141614 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141617 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141620 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141623 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141626 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141629 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141632 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141635 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141640 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141644 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141649 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141654 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141657 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141659 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:01:05.147911 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141662 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141664 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141667 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141670 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141673 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141676 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141678 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141681 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:05.141683 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.141689 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.141822 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.143864 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.145328 2562 server.go:1019] "Starting client certificate rotation" Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.145442 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:01:05.148404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.145506 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:01:05.148928 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.147888 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:01:05.151037 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.151014 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:01:05.167033 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.167013 2562 log.go:25] "Validated CRI v1 runtime API" Jun 10 13:01:05.169215 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.169198 2562 log.go:25] "Validated CRI v1 image API" Jun 10 13:01:05.169969 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.169955 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 13:01:05.172380 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.172363 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 901ba842-5eef-4330-bb9c-33a8209e93dd:/dev/nvme0n1p4 f29e1e71-e441-42a5-bf6f-a1abc3dcd349:/dev/nvme0n1p3] Jun 10 13:01:05.172429 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.172380 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 13:01:05.177744 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.177638 2562 manager.go:216] Machine: {Timestamp:2026-06-10 13:01:05.176226924 +0000 UTC m=+0.367665130 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099836 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2673715ea75d15ccb9cb38716a9c24 SystemUUID:ec267371-5ea7-5d15-ccb9-cb38716a9c24 BootID:221067c5-677e-478d-ae17-7b36aef534fb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:16:00:de:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:16:00:de:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:6d:ff:f5:2d:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 13:01:05.177744 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.177737 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 13:01:05.177864 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.177813 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 13:01:05.178347 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.178333 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:01:05.181127 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.181097 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 13:01:05.181261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.181130 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 13:01:05.182278 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.182268 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 13:01:05.182316 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.182282 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 13:01:05.182316 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.182291 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:01:05.182316 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.182303 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:01:05.183049 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.183040 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 13:01:05.186029 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186019 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:01:05.186141 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186132 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 13:01:05.186189 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186181 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 10 13:01:05.186223 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186198 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 13:01:05.186223 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186208 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 13:01:05.186223 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186218 2562 kubelet.go:398] "Adding apiserver pod source" Jun 10 13:01:05.186301 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186227 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 13:01:05.186907 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186880 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:01:05.186907 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.186907 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:01:05.189717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.189698 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 13:01:05.191137 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.191124 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 13:01:05.191179 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.191153 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 13:01:05.192882 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192871 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192887 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192893 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192899 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192907 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192912 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192920 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 13:01:05.192926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192926 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 13:01:05.193109 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192936 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 13:01:05.193109 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192941 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 13:01:05.193109 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192949 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 13:01:05.193109 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.192954 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 13:01:05.193838 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.193821 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 13:01:05.194082 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.193977 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 13:01:05.197797 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.197782 2562 server.go:1268] "Started kubelet" Jun 10 13:01:05.197893 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.197862 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 13:01:05.197950 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.197858 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 13:01:05.197950 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.197928 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 13:01:05.198780 ip-10-0-128-45 systemd[1]: Started Kubernetes Kubelet. Jun 10 13:01:05.200127 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.200115 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 10 13:01:05.201809 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.201792 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 13:01:05.202862 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.202844 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 13:01:05.202939 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.202862 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 13:01:05.202939 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.202911 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 13:01:05.205908 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.205890 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 13:01:05.206595 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.206578 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 13:01:05.206679 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.206602 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 13:01:05.206744 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.206664 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.207095 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.206147 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-45.ec2.internal.18b7b9cc66d0e4e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-45.ec2.internal,UID:ip-10-0-128-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-45.ec2.internal,},FirstTimestamp:2026-06-10 13:01:05.197753571 +0000 UTC m=+0.389191775,LastTimestamp:2026-06-10 13:01:05.197753571 +0000 UTC m=+0.389191775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-45.ec2.internal,}" Jun 10 13:01:05.207177 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.207119 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 13:01:05.207177 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.207126 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 13:01:05.207177 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.207135 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 13:01:05.207327 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.207304 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 10 13:01:05.207327 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.207314 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 10 13:01:05.208082 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208068 2562 factory.go:55] Registering systemd factory Jun 10 13:01:05.208142 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208104 2562 factory.go:223] Registration of the systemd container factory successfully Jun 10 13:01:05.208296 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208282 2562 factory.go:153] Registering CRI-O factory Jun 10 13:01:05.208343 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208298 2562 factory.go:223] Registration of the crio container factory successfully Jun 10 13:01:05.208343 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208337 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 13:01:05.208412 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208355 2562 factory.go:103] Registering Raw factory Jun 10 13:01:05.208412 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208366 2562 manager.go:1196] Started watching for new ooms in manager Jun 10 13:01:05.208733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.208720 2562 manager.go:349] Starting recovery of all containers Jun 10 13:01:05.212664 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.212540 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 13:01:05.212664 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.212636 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 13:01:05.216778 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.216743 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rwk4f" Jun 10 13:01:05.219446 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.219428 2562 manager.go:354] Recovery completed Jun 10 13:01:05.222378 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.222348 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 13:01:05.225367 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.225355 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.226192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.226175 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rwk4f" Jun 10 13:01:05.227198 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227181 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.227261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227212 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.227261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227222 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.227762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227749 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 13:01:05.227762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227757 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.227762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227761 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 13:01:05.227895 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.227776 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:01:05.228448 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.228432 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.228582 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.228464 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.228582 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.228479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.228680 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.228586 2562 policy_none.go:49] "None policy: Start" Jun 10 13:01:05.228680 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.228598 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 13:01:05.228680 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.228609 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 13:01:05.229527 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.229438 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-45.ec2.internal.18b7b9cc689231a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-45.ec2.internal,UID:ip-10-0-128-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-45.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-45.ec2.internal,},FirstTimestamp:2026-06-10 13:01:05.22719888 +0000 UTC m=+0.418637088,LastTimestamp:2026-06-10 13:01:05.22719888 +0000 UTC m=+0.418637088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-45.ec2.internal,}" Jun 10 13:01:05.230024 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.230013 2562 policy_none.go:47] "Start" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269101 2562 manager.go:337] "Starting Device Plugin manager" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.269136 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269148 2562 server.go:87] "Starting device plugin registration server" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269446 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269458 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269548 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269618 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269625 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.269943 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.270181 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.270219 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.271178 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.271210 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.271272 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.271311 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 13:01:05.274700 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.274648 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:01:05.370538 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.370489 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.371724 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.371704 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal"] Jun 10 13:01:05.371783 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.371774 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.372566 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.372539 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.372756 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.372575 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.372756 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.372587 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.372756 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.372617 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.373304 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.373288 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.373414 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.373316 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.373414 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.373329 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.374579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.374567 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.374705 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.374691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.374763 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.374727 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.375349 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.375328 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.375426 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.375360 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.375426 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.375369 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.375426 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.375337 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.375542 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.375430 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.375542 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.375443 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.376593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.376580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.376658 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.376608 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:01:05.377359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.377336 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:01:05.377437 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.377364 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:01:05.377437 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.377379 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:01:05.383438 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.383425 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.383494 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.383444 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-45.ec2.internal\": node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.398191 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.398174 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-45.ec2.internal\" not found" node="ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.402663 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.402649 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-45.ec2.internal\" not found" node="ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.409266 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.409251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3f3f2f03d1cd0ad8031b48f05cfc19dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal\" (UID: \"3f3f2f03d1cd0ad8031b48f05cfc19dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.409330 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.409275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3f2f03d1cd0ad8031b48f05cfc19dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal\" (UID: \"3f3f2f03d1cd0ad8031b48f05cfc19dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.409330 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.409291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25a22677b12f5f144809b9c72db24d69-config\") pod \"kube-apiserver-proxy-ip-10-0-128-45.ec2.internal\" (UID: \"25a22677b12f5f144809b9c72db24d69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.411500 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.411483 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.509865 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.509828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3f3f2f03d1cd0ad8031b48f05cfc19dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal\" (UID: \"3f3f2f03d1cd0ad8031b48f05cfc19dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.509865 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.509863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3f2f03d1cd0ad8031b48f05cfc19dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal\" (UID: \"3f3f2f03d1cd0ad8031b48f05cfc19dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.510063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.509882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25a22677b12f5f144809b9c72db24d69-config\") pod \"kube-apiserver-proxy-ip-10-0-128-45.ec2.internal\" (UID: \"25a22677b12f5f144809b9c72db24d69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.510063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.509922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25a22677b12f5f144809b9c72db24d69-config\") pod \"kube-apiserver-proxy-ip-10-0-128-45.ec2.internal\" (UID: \"25a22677b12f5f144809b9c72db24d69\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.510063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.509925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f3f2f03d1cd0ad8031b48f05cfc19dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal\" (UID: \"3f3f2f03d1cd0ad8031b48f05cfc19dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.510063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.509922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3f3f2f03d1cd0ad8031b48f05cfc19dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal\" (UID: \"3f3f2f03d1cd0ad8031b48f05cfc19dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.511899 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.511884 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.612526 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.612479 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.702620 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.702597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.708361 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:05.708345 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:05.712837 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.712814 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.813362 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.813326 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:05.913845 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:05.913808 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:06.014431 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:06.014345 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:06.114932 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:06.114902 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:06.135342 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.135317 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:01:06.144980 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.144963 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 13:01:06.145101 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.145080 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:01:06.145142 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.145124 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:01:06.184462 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:06.184433 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3f2f03d1cd0ad8031b48f05cfc19dd.slice/crio-12bf64189b56fd8a0121190a98534ed519aeb62ded686306f387347e117a164f WatchSource:0}: Error finding container 12bf64189b56fd8a0121190a98534ed519aeb62ded686306f387347e117a164f: Status 404 returned error can't find the container with id 12bf64189b56fd8a0121190a98534ed519aeb62ded686306f387347e117a164f Jun 10 13:01:06.184992 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:06.184965 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a22677b12f5f144809b9c72db24d69.slice/crio-f1fc54a75ccc9e1c3b7de01b202a1ba9668ff9725dc13f88a7361118640fb813 WatchSource:0}: Error finding container f1fc54a75ccc9e1c3b7de01b202a1ba9668ff9725dc13f88a7361118640fb813: Status 404 returned error can't find the container with id f1fc54a75ccc9e1c3b7de01b202a1ba9668ff9725dc13f88a7361118640fb813 Jun 10 13:01:06.190504 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.190489 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:01:06.215627 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:06.215604 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-45.ec2.internal\" not found" Jun 10 13:01:06.228355 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.228314 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:56:05 +0000 UTC" deadline="2028-02-02 20:08:36.339704885 +0000 UTC" Jun 10 13:01:06.228355 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.228352 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14455h7m30.111356082s" Jun 10 13:01:06.245133 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.245115 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:01:06.275174 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.275067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" event={"ID":"3f3f2f03d1cd0ad8031b48f05cfc19dd","Type":"ContainerStarted","Data":"12bf64189b56fd8a0121190a98534ed519aeb62ded686306f387347e117a164f"} Jun 10 13:01:06.276099 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.276079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" event={"ID":"25a22677b12f5f144809b9c72db24d69","Type":"ContainerStarted","Data":"f1fc54a75ccc9e1c3b7de01b202a1ba9668ff9725dc13f88a7361118640fb813"} Jun 10 13:01:06.307263 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.307231 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" Jun 10 13:01:06.319203 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.319179 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:01:06.320358 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.320346 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" Jun 10 13:01:06.328181 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.328165 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:01:06.488093 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:06.488064 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:01:07.188318 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.188064 2562 apiserver.go:52] "Watching apiserver" Jun 10 13:01:07.197299 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.197261 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 13:01:07.197754 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.197723 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8cbh7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg","openshift-image-registry/node-ca-wk7wq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal","openshift-multus/multus-additional-cni-plugins-4fp8j","openshift-multus/multus-nwbv8","openshift-network-diagnostics/network-check-target-mr4rw","kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wgn8w","openshift-dns/node-resolver-wnvzr","openshift-multus/network-metrics-daemon-2xdlv","openshift-network-operator/iptables-alerter-gvph6","openshift-ovn-kubernetes/ovnkube-node-vxq8s","kube-system/global-pull-secret-syncer-4vzpr"] Jun 10 13:01:07.199946 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.199928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.201906 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.201888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.202658 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.202637 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.202751 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.202697 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cdj6w\"" Jun 10 13:01:07.202817 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.202641 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.203828 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.203807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.204954 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.204932 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.204954 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.204931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 13:01:07.205102 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.204985 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.205259 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.205227 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.205328 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.205300 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:07.205483 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.205461 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 13:01:07.207418 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.206837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.207418 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.206998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xdkf5\"" Jun 10 13:01:07.207418 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.207024 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 13:01:07.207418 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.207233 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 13:01:07.208197 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.208173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 13:01:07.208351 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.208315 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 13:01:07.208421 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.208384 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.208542 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.208526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-865kf\"" Jun 10 13:01:07.208607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.208580 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.208669 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.208651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.210612 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.210593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.212082 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.212063 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:07.212178 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.212142 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:07.213412 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.213366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 13:01:07.213971 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.213761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.214805 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.214782 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.215884 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.215538 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.216153 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.216009 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vxjgn\"" Jun 10 13:01:07.216376 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.216294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hptb6\"" Jun 10 13:01:07.217218 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.217197 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h8lf8\"" Jun 10 13:01:07.217563 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.217541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.217725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.217551 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.217788 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.217742 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.217844 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.217788 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 13:01:07.218118 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.218098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 13:01:07.218168 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.218156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 13:01:07.218427 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.218413 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.218464 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.218447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.218578 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.218554 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-os-release\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-k8s-cni-cncf-io\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-node-log\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-etc-kubernetes\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59501f36-8370-4b9c-8666-f699e7e965d4-hosts-file\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-systemd-units\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dt58d\"" Jun 10 13:01:07.219964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.219933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovnkube-config\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.220461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.220461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220189 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 13:01:07.220461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovn-node-metrics-cert\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.220461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovnkube-script-lib\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.220461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-system-cni-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.220461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-slash\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.220759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-run-netns\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.220759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-etc-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.220759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccf1f044-8924-435a-8dc6-bd2f3e816436-kubelet-config\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.220759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-conf-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.220759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-daemon-config\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.220759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221040 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.220770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-log-socket\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221178 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-netns\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.221271 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-cni-multus\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.221271 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-multus-certs\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.221271 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-systemd\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221271 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccf1f044-8924-435a-8dc6-bd2f3e816436-dbus\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.221459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.221459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-os-release\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.221459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.221459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.221459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-ovn\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-system-cni-dir\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-cni-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-cni-bin\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh8kv\" (UniqueName: \"kubernetes.io/projected/d80b95e2-38a2-4e04-bfa2-eca88efdf974-kube-api-access-wh8kv\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/770a343a-ee40-4b93-a3a1-5a3edbf45796-host\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjssh\" (UniqueName: \"kubernetes.io/projected/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-kube-api-access-sjssh\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-cnibin\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.221719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59501f36-8370-4b9c-8666-f699e7e965d4-tmp-dir\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdzcn\" (UniqueName: \"kubernetes.io/projected/59501f36-8370-4b9c-8666-f699e7e965d4-kube-api-access-wdzcn\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94779\" (UniqueName: \"kubernetes.io/projected/770a343a-ee40-4b93-a3a1-5a3edbf45796-kube-api-access-94779\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-socket-dir-parent\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-kubelet\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-cni-netd\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-cnibin\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfpmn\" (UniqueName: \"kubernetes.io/projected/45496b73-c90f-4194-ae2f-7ac3b364163c-kube-api-access-cfpmn\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.221992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-kubelet\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-hostroot\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-env-overrides\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/770a343a-ee40-4b93-a3a1-5a3edbf45796-serviceca\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.222106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-cni-binary-copy\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.222762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-cni-bin\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.222762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-var-lib-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.222762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222754 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 13:01:07.222919 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.222795 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:01:07.223309 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.223106 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ghpbg\"" Jun 10 13:01:07.223309 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.223092 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 13:01:07.223309 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.223143 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j8s4f\"" Jun 10 13:01:07.223309 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.223256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 13:01:07.223556 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.223541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 13:01:07.227194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.227172 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:01:07.254723 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.254698 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pflws" Jun 10 13:01:07.260984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.260965 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:01:07.265191 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.265172 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pflws" Jun 10 13:01:07.309106 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.309081 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 13:01:07.322557 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-cni-bin\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-var-lib-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-os-release\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-k8s-cni-cncf-io\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-systemd\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-run\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-os-release\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-lib-modules\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65d5d995-c4da-40af-963e-34a6cd9621e2-iptables-alerter-script\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.322741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-var-lib-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-cni-bin\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-node-log\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-k8s-cni-cncf-io\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-etc-kubernetes\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-node-log\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59501f36-8370-4b9c-8666-f699e7e965d4-hosts-file\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322932 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-etc-kubernetes\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.322982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnf9z\" (UniqueName: \"kubernetes.io/projected/540eaf34-22e0-4f32-a52f-0cf6b2361c73-kube-api-access-cnf9z\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-systemd-units\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-sys\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323043 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/59501f36-8370-4b9c-8666-f699e7e965d4-hosts-file\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-systemd-units\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-host\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6200ac9-5b53-40f4-b520-972e06e7a6ee-tmp\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.323381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovnkube-config\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovn-node-metrics-cert\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovnkube-script-lib\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-system-cni-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-var-lib-kubelet\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-slash\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-run-netns\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-etc-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccf1f044-8924-435a-8dc6-bd2f3e816436-kubelet-config\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovnkube-script-lib\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.323936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovnkube-config\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-conf-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-modprobe-d\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.324132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-run-netns\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccf1f044-8924-435a-8dc6-bd2f3e816436-kubelet-config\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-slash\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324441 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-etc-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-conf-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-system-cni-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-kubernetes\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-daemon-config\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324591 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-log-socket\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65d5d995-c4da-40af-963e-34a6cd9621e2-host-slash\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdv8h\" (UniqueName: \"kubernetes.io/projected/65d5d995-c4da-40af-963e-34a6cd9621e2-kube-api-access-hdv8h\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.324762 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-netns\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-openvswitch\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-cni-multus\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-multus-certs\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-log-socket\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-systemd\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324876 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccf1f044-8924-435a-8dc6-bd2f3e816436-dbus\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324900 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-cni-multus\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324945 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-systemd\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-os-release\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-multus-certs\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-run-netns\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.324999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325036 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccf1f044-8924-435a-8dc6-bd2f3e816436-dbus\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-ovn\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.325084 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:07.325359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-os-release\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-daemon-config\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.325180 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:07.825125464 +0000 UTC m=+3.016563661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-system-cni-dir\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-system-cni-dir\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-cni-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysctl-d\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg726\" (UniqueName: \"kubernetes.io/projected/a6200ac9-5b53-40f4-b520-972e06e7a6ee-kube-api-access-fg726\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-device-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-cni-bin\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-sys-fs\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-cni-dir\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh8kv\" (UniqueName: \"kubernetes.io/projected/d80b95e2-38a2-4e04-bfa2-eca88efdf974-kube-api-access-wh8kv\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.326294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-registration-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-etc-selinux\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/770a343a-ee40-4b93-a3a1-5a3edbf45796-host\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjssh\" (UniqueName: \"kubernetes.io/projected/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-kube-api-access-sjssh\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcnwj\" (UniqueName: \"kubernetes.io/projected/db9c66fc-6c07-474e-8242-e2e673c7d7f3-kube-api-access-jcnwj\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325637 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-socket-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-cni-bin\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/770a343a-ee40-4b93-a3a1-5a3edbf45796-host\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-run-ovn\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-cnibin\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59501f36-8370-4b9c-8666-f699e7e965d4-tmp-dir\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdzcn\" (UniqueName: \"kubernetes.io/projected/59501f36-8370-4b9c-8666-f699e7e965d4-kube-api-access-wdzcn\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysconfig\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.327192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45496b73-c90f-4194-ae2f-7ac3b364163c-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.325977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/527fedf5-6673-4879-a512-7096aa7e7df6-konnectivity-ca\") pod \"konnectivity-agent-8cbh7\" (UID: \"527fedf5-6673-4879-a512-7096aa7e7df6\") " pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94779\" (UniqueName: \"kubernetes.io/projected/770a343a-ee40-4b93-a3a1-5a3edbf45796-kube-api-access-94779\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-cnibin\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-socket-dir-parent\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59501f36-8370-4b9c-8666-f699e7e965d4-tmp-dir\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-multus-socket-dir-parent\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-tuned\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/527fedf5-6673-4879-a512-7096aa7e7df6-agent-certs\") pod \"konnectivity-agent-8cbh7\" (UID: \"527fedf5-6673-4879-a512-7096aa7e7df6\") " pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-kubelet\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-kubelet\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-cni-netd\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-cnibin\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-cni-netd\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfpmn\" (UniqueName: \"kubernetes.io/projected/45496b73-c90f-4194-ae2f-7ac3b364163c-kube-api-access-cfpmn\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysctl-conf\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.327993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-kubelet\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d80b95e2-38a2-4e04-bfa2-eca88efdf974-host-run-ovn-kubernetes\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-hostroot\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-env-overrides\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/770a343a-ee40-4b93-a3a1-5a3edbf45796-serviceca\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45496b73-c90f-4194-ae2f-7ac3b364163c-cnibin\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-cni-binary-copy\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326630 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-hostroot\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.326674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-host-var-lib-kubelet\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.327086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-cni-binary-copy\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.327097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d80b95e2-38a2-4e04-bfa2-eca88efdf974-env-overrides\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.328642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.327125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/770a343a-ee40-4b93-a3a1-5a3edbf45796-serviceca\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.329644 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.329623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d80b95e2-38a2-4e04-bfa2-eca88efdf974-ovn-node-metrics-cert\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.343940 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.343910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjssh\" (UniqueName: \"kubernetes.io/projected/5f0ab38f-b7a5-4b26-bd3b-6c004e68645a-kube-api-access-sjssh\") pod \"multus-nwbv8\" (UID: \"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a\") " pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.344546 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.344507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdzcn\" (UniqueName: \"kubernetes.io/projected/59501f36-8370-4b9c-8666-f699e7e965d4-kube-api-access-wdzcn\") pod \"node-resolver-wnvzr\" (UID: \"59501f36-8370-4b9c-8666-f699e7e965d4\") " pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.344641 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.344551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfpmn\" (UniqueName: \"kubernetes.io/projected/45496b73-c90f-4194-ae2f-7ac3b364163c-kube-api-access-cfpmn\") pod \"multus-additional-cni-plugins-4fp8j\" (UID: \"45496b73-c90f-4194-ae2f-7ac3b364163c\") " pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.344921 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.344878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh8kv\" (UniqueName: \"kubernetes.io/projected/d80b95e2-38a2-4e04-bfa2-eca88efdf974-kube-api-access-wh8kv\") pod \"ovnkube-node-vxq8s\" (UID: \"d80b95e2-38a2-4e04-bfa2-eca88efdf974\") " pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.345256 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.345163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94779\" (UniqueName: \"kubernetes.io/projected/770a343a-ee40-4b93-a3a1-5a3edbf45796-kube-api-access-94779\") pod \"node-ca-wk7wq\" (UID: \"770a343a-ee40-4b93-a3a1-5a3edbf45796\") " pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.427861 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-modprobe-d\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.427861 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-kubernetes\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65d5d995-c4da-40af-963e-34a6cd9621e2-host-slash\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.428065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdv8h\" (UniqueName: \"kubernetes.io/projected/65d5d995-c4da-40af-963e-34a6cd9621e2-kube-api-access-hdv8h\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.428065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427958 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-kubernetes\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65d5d995-c4da-40af-963e-34a6cd9621e2-host-slash\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.428065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.427990 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-modprobe-d\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysctl-d\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg726\" (UniqueName: \"kubernetes.io/projected/a6200ac9-5b53-40f4-b520-972e06e7a6ee-kube-api-access-fg726\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-device-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428201 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-device-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.428228 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428239 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-sys-fs\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-registration-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428267 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysctl-d\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-etc-selinux\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428300 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.428292 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:07.928272878 +0000 UTC m=+3.119711074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-sys-fs\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428335 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-etc-selinux\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-registration-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcnwj\" (UniqueName: \"kubernetes.io/projected/db9c66fc-6c07-474e-8242-e2e673c7d7f3-kube-api-access-jcnwj\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-socket-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysconfig\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/527fedf5-6673-4879-a512-7096aa7e7df6-konnectivity-ca\") pod \"konnectivity-agent-8cbh7\" (UID: \"527fedf5-6673-4879-a512-7096aa7e7df6\") " pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-tuned\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/527fedf5-6673-4879-a512-7096aa7e7df6-agent-certs\") pod \"konnectivity-agent-8cbh7\" (UID: \"527fedf5-6673-4879-a512-7096aa7e7df6\") " pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/540eaf34-22e0-4f32-a52f-0cf6b2361c73-socket-dir\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysctl-conf\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428557 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysconfig\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-systemd\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-run\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-run\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.428929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-lib-modules\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-sysctl-conf\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65d5d995-c4da-40af-963e-34a6cd9621e2-iptables-alerter-script\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428803 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-lib-modules\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428805 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428849 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnf9z\" (UniqueName: \"kubernetes.io/projected/540eaf34-22e0-4f32-a52f-0cf6b2361c73-kube-api-access-cnf9z\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-sys\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-host\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6200ac9-5b53-40f4-b520-972e06e7a6ee-tmp\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-var-lib-kubelet\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.428661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-systemd\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.429052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-host\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.429066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-sys\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.429093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/527fedf5-6673-4879-a512-7096aa7e7df6-konnectivity-ca\") pod \"konnectivity-agent-8cbh7\" (UID: \"527fedf5-6673-4879-a512-7096aa7e7df6\") " pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.429100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6200ac9-5b53-40f4-b520-972e06e7a6ee-var-lib-kubelet\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.429593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.429282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/65d5d995-c4da-40af-963e-34a6cd9621e2-iptables-alerter-script\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.430965 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.430936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/527fedf5-6673-4879-a512-7096aa7e7df6-agent-certs\") pod \"konnectivity-agent-8cbh7\" (UID: \"527fedf5-6673-4879-a512-7096aa7e7df6\") " pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.431067 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.430982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6200ac9-5b53-40f4-b520-972e06e7a6ee-etc-tuned\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.431133 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.431114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6200ac9-5b53-40f4-b520-972e06e7a6ee-tmp\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.439703 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.439654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcnwj\" (UniqueName: \"kubernetes.io/projected/db9c66fc-6c07-474e-8242-e2e673c7d7f3-kube-api-access-jcnwj\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.443689 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.443668 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:07.443793 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.443697 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:07.443793 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.443712 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:07.443877 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.443794 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:07.943776142 +0000 UTC m=+3.135214354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:07.444624 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.444606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdv8h\" (UniqueName: \"kubernetes.io/projected/65d5d995-c4da-40af-963e-34a6cd9621e2-kube-api-access-hdv8h\") pod \"iptables-alerter-gvph6\" (UID: \"65d5d995-c4da-40af-963e-34a6cd9621e2\") " pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.445227 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.445208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnf9z\" (UniqueName: \"kubernetes.io/projected/540eaf34-22e0-4f32-a52f-0cf6b2361c73-kube-api-access-cnf9z\") pod \"aws-ebs-csi-driver-node-g44qg\" (UID: \"540eaf34-22e0-4f32-a52f-0cf6b2361c73\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.445634 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.445614 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg726\" (UniqueName: \"kubernetes.io/projected/a6200ac9-5b53-40f4-b520-972e06e7a6ee-kube-api-access-fg726\") pod \"tuned-wgn8w\" (UID: \"a6200ac9-5b53-40f4-b520-972e06e7a6ee\") " pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.514095 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.514057 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wnvzr" Jun 10 13:01:07.521568 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.521547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:07.531485 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.531464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wk7wq" Jun 10 13:01:07.537116 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.537098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" Jun 10 13:01:07.545248 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.545230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nwbv8" Jun 10 13:01:07.552499 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.552483 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" Jun 10 13:01:07.559455 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.559429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" Jun 10 13:01:07.567130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.567109 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:07.573868 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.573850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gvph6" Jun 10 13:01:07.831050 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.830969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:07.831193 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.831121 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:07.831193 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.831187 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:08.831170994 +0000 UTC m=+4.022609185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:07.932238 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:07.932193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:07.932396 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.932370 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:07.932462 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:07.932449 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:08.932427982 +0000 UTC m=+4.123866193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:08.032961 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.032925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:08.033136 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.033114 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:08.033181 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.033137 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:08.033181 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.033152 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:08.033276 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.033217 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:09.033202371 +0000 UTC m=+4.224640562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:08.096407 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.096193 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80b95e2_38a2_4e04_bfa2_eca88efdf974.slice/crio-b1850a99729304ac6099018c9a26ae287c1cce58d9547534b88ece38bc42a1f8 WatchSource:0}: Error finding container b1850a99729304ac6099018c9a26ae287c1cce58d9547534b88ece38bc42a1f8: Status 404 returned error can't find the container with id b1850a99729304ac6099018c9a26ae287c1cce58d9547534b88ece38bc42a1f8 Jun 10 13:01:08.097888 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.097793 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527fedf5_6673_4879_a512_7096aa7e7df6.slice/crio-f6f83676525a1ac2d3d279677e963fdbb6c227b7e8862124e86f25fee0ccf886 WatchSource:0}: Error finding container f6f83676525a1ac2d3d279677e963fdbb6c227b7e8862124e86f25fee0ccf886: Status 404 returned error can't find the container with id f6f83676525a1ac2d3d279677e963fdbb6c227b7e8862124e86f25fee0ccf886 Jun 10 13:01:08.098547 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.098333 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d5d995_c4da_40af_963e_34a6cd9621e2.slice/crio-9ebc81e98af3b4420db736d4eb05b8d570e0f086f9542ff52ac169d89396411e WatchSource:0}: Error finding container 9ebc81e98af3b4420db736d4eb05b8d570e0f086f9542ff52ac169d89396411e: Status 404 returned error can't find the container with id 9ebc81e98af3b4420db736d4eb05b8d570e0f086f9542ff52ac169d89396411e Jun 10 13:01:08.102494 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.102470 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6200ac9_5b53_40f4_b520_972e06e7a6ee.slice/crio-f40f2f79617e53e04327111ba49f55028a4064926b62a39da51240851e46ef8b WatchSource:0}: Error finding container f40f2f79617e53e04327111ba49f55028a4064926b62a39da51240851e46ef8b: Status 404 returned error can't find the container with id f40f2f79617e53e04327111ba49f55028a4064926b62a39da51240851e46ef8b Jun 10 13:01:08.103870 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.103845 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540eaf34_22e0_4f32_a52f_0cf6b2361c73.slice/crio-6b7990bba0250ae6251ffb8adc79a126c2ea03f42723242bf7656d523ceb5eda WatchSource:0}: Error finding container 6b7990bba0250ae6251ffb8adc79a126c2ea03f42723242bf7656d523ceb5eda: Status 404 returned error can't find the container with id 6b7990bba0250ae6251ffb8adc79a126c2ea03f42723242bf7656d523ceb5eda Jun 10 13:01:08.105313 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.105095 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770a343a_ee40_4b93_a3a1_5a3edbf45796.slice/crio-cb1aa8df14bd7f8dd254f41befc63a64c78c4cae587797798df83e79dd5a005f WatchSource:0}: Error finding container cb1aa8df14bd7f8dd254f41befc63a64c78c4cae587797798df83e79dd5a005f: Status 404 returned error can't find the container with id cb1aa8df14bd7f8dd254f41befc63a64c78c4cae587797798df83e79dd5a005f Jun 10 13:01:08.106146 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.106122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0ab38f_b7a5_4b26_bd3b_6c004e68645a.slice/crio-4b46b08d63b222a05f45c762e4987d92cba46310970d32457c8bfea16caca2af WatchSource:0}: Error finding container 4b46b08d63b222a05f45c762e4987d92cba46310970d32457c8bfea16caca2af: Status 404 returned error can't find the container with id 4b46b08d63b222a05f45c762e4987d92cba46310970d32457c8bfea16caca2af Jun 10 13:01:08.107699 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.107670 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45496b73_c90f_4194_ae2f_7ac3b364163c.slice/crio-a3c46cbe5a3862a649b838a762341705d26213a539fb4fd1ca90979ca80c38a1 WatchSource:0}: Error finding container a3c46cbe5a3862a649b838a762341705d26213a539fb4fd1ca90979ca80c38a1: Status 404 returned error can't find the container with id a3c46cbe5a3862a649b838a762341705d26213a539fb4fd1ca90979ca80c38a1 Jun 10 13:01:08.108967 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:08.108584 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59501f36_8370_4b9c_8666_f699e7e965d4.slice/crio-cd8b8a56f1bc4c2111f650861b338f3cff82a065e07fcc17b198677d466004ae WatchSource:0}: Error finding container cd8b8a56f1bc4c2111f650861b338f3cff82a065e07fcc17b198677d466004ae: Status 404 returned error can't find the container with id cd8b8a56f1bc4c2111f650861b338f3cff82a065e07fcc17b198677d466004ae Jun 10 13:01:08.267717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.267647 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:56:07 +0000 UTC" deadline="2028-01-08 03:50:01.696763994 +0000 UTC" Jun 10 13:01:08.267717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.267710 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13838h48m53.429056514s" Jun 10 13:01:08.281745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.281711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" event={"ID":"25a22677b12f5f144809b9c72db24d69","Type":"ContainerStarted","Data":"4a953255037b90fb623cf0d35e4729d00247eacb7404a7be3feb1648a047349b"} Jun 10 13:01:08.282820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.282794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wnvzr" event={"ID":"59501f36-8370-4b9c-8666-f699e7e965d4","Type":"ContainerStarted","Data":"cd8b8a56f1bc4c2111f650861b338f3cff82a065e07fcc17b198677d466004ae"} Jun 10 13:01:08.283976 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.283946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wk7wq" event={"ID":"770a343a-ee40-4b93-a3a1-5a3edbf45796","Type":"ContainerStarted","Data":"cb1aa8df14bd7f8dd254f41befc63a64c78c4cae587797798df83e79dd5a005f"} Jun 10 13:01:08.285210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.285179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" event={"ID":"a6200ac9-5b53-40f4-b520-972e06e7a6ee","Type":"ContainerStarted","Data":"f40f2f79617e53e04327111ba49f55028a4064926b62a39da51240851e46ef8b"} Jun 10 13:01:08.286215 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.286196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8cbh7" event={"ID":"527fedf5-6673-4879-a512-7096aa7e7df6","Type":"ContainerStarted","Data":"f6f83676525a1ac2d3d279677e963fdbb6c227b7e8862124e86f25fee0ccf886"} Jun 10 13:01:08.287215 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.287187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerStarted","Data":"a3c46cbe5a3862a649b838a762341705d26213a539fb4fd1ca90979ca80c38a1"} Jun 10 13:01:08.288848 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.288823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nwbv8" event={"ID":"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a","Type":"ContainerStarted","Data":"4b46b08d63b222a05f45c762e4987d92cba46310970d32457c8bfea16caca2af"} Jun 10 13:01:08.289836 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.289817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" event={"ID":"540eaf34-22e0-4f32-a52f-0cf6b2361c73","Type":"ContainerStarted","Data":"6b7990bba0250ae6251ffb8adc79a126c2ea03f42723242bf7656d523ceb5eda"} Jun 10 13:01:08.290918 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.290897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvph6" event={"ID":"65d5d995-c4da-40af-963e-34a6cd9621e2","Type":"ContainerStarted","Data":"9ebc81e98af3b4420db736d4eb05b8d570e0f086f9542ff52ac169d89396411e"} Jun 10 13:01:08.293130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.293113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"b1850a99729304ac6099018c9a26ae287c1cce58d9547534b88ece38bc42a1f8"} Jun 10 13:01:08.297284 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.297245 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-45.ec2.internal" podStartSLOduration=2.297233701 podStartE2EDuration="2.297233701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:08.296909446 +0000 UTC m=+3.488347674" watchObservedRunningTime="2026-06-10 13:01:08.297233701 +0000 UTC m=+3.488671914" Jun 10 13:01:08.457982 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.457907 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:01:08.840446 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.840408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:08.840648 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.840562 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:08.840648 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.840626 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:10.840608517 +0000 UTC m=+6.032046723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:08.940920 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:08.940881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:08.941101 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.941040 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:08.941101 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:08.941102 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:10.941083573 +0000 UTC m=+6.132521768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:09.042402 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.042219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:09.042598 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.042403 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:09.042598 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.042428 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:09.042598 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.042440 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:09.042598 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.042496 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:11.042479078 +0000 UTC m=+6.233917271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:09.268795 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.268748 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:56:07 +0000 UTC" deadline="2028-01-14 15:01:56.739041363 +0000 UTC" Jun 10 13:01:09.268795 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.268787 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13994h0m47.470259465s" Jun 10 13:01:09.274600 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.274578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:09.274738 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.274703 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:09.275128 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.275107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:09.275244 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.275223 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:09.275302 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.275295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:09.275379 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:09.275361 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:09.329222 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.328557 2562 generic.go:356] "Generic (PLEG): container finished" podID="3f3f2f03d1cd0ad8031b48f05cfc19dd" containerID="bc4b6387e561f3704dc7dbf2c75bf18eab84841331f92ef9327cfcb0e7827a69" exitCode=0 Jun 10 13:01:09.329222 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:09.329143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" event={"ID":"3f3f2f03d1cd0ad8031b48f05cfc19dd","Type":"ContainerDied","Data":"bc4b6387e561f3704dc7dbf2c75bf18eab84841331f92ef9327cfcb0e7827a69"} Jun 10 13:01:10.342427 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:10.342350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" event={"ID":"3f3f2f03d1cd0ad8031b48f05cfc19dd","Type":"ContainerStarted","Data":"64acd54f1fdd4369b49c8e0d7f795cbf28480e5db37dcdfd9a0c992e7f3baa02"} Jun 10 13:01:10.359267 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:10.359021 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-45.ec2.internal" podStartSLOduration=4.35899834 podStartE2EDuration="4.35899834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:10.357921935 +0000 UTC m=+5.549360151" watchObservedRunningTime="2026-06-10 13:01:10.35899834 +0000 UTC m=+5.550436565" Jun 10 13:01:10.857642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:10.857599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:10.857810 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:10.857765 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:10.857869 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:10.857827 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:14.8578097 +0000 UTC m=+10.049247899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:10.959483 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:10.958903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:10.959483 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:10.959101 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:10.959483 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:10.959164 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:14.959144594 +0000 UTC m=+10.150582788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:11.060118 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:11.060018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:11.060297 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.060222 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:11.060297 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.060248 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:11.060297 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.060262 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:11.060504 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.060323 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:15.060303557 +0000 UTC m=+10.251741767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:11.272209 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:11.272178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:11.272389 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.272302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:11.272389 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:11.272321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:11.272506 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.272442 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:11.272506 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:11.272477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:11.272629 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:11.272580 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:13.271990 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:13.271931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:13.271990 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:13.271954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:13.272495 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:13.272063 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:13.272495 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:13.272077 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:13.272495 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:13.272167 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:13.272495 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:13.272253 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:14.894022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:14.893980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:14.894503 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:14.894143 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:14.894503 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:14.894210 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:22.8941914 +0000 UTC m=+18.085629618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:14.994932 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:14.994873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:14.995114 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:14.995090 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:14.995187 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:14.995174 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:22.995154613 +0000 UTC m=+18.186592817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:15.095594 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:15.095542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:15.095818 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.095699 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:15.095818 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.095716 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:15.095818 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.095726 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:15.095818 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.095791 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:23.095770786 +0000 UTC m=+18.287208978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:15.273757 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:15.273722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:15.273943 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.273867 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:15.274988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:15.274301 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:15.274988 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.274443 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:15.274988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:15.274495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:15.280714 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:15.275616 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:17.271886 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:17.271822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:17.271886 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:17.271859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:17.272354 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:17.271822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:17.272354 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:17.271956 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:17.272354 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:17.272052 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:17.272354 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:17.272130 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:19.271507 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:19.271475 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:19.271507 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:19.271490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:19.272030 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:19.271626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:19.272030 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:19.271723 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:19.272030 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:19.271761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:19.272030 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:19.271823 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:21.271861 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:21.271824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:21.272311 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:21.271824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:21.272311 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:21.271953 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:21.272311 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:21.271824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:21.272311 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:21.272028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:21.272311 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:21.272112 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:22.956590 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:22.956561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:22.957071 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:22.956725 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:22.957071 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:22.956802 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:38.956780656 +0000 UTC m=+34.148218852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:23.057294 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:23.057256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:23.057454 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.057389 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:23.057454 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.057447 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:01:39.057430049 +0000 UTC m=+34.248868248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:23.157866 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:23.157832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:23.158048 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.157972 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:23.158048 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.157997 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:23.158048 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.158012 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:23.158185 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.158075 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:39.158055852 +0000 UTC m=+34.349494043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:23.271897 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:23.271826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:23.272052 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:23.271827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:23.272052 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.271951 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:23.272052 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:23.271830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:23.272208 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.272045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:23.272208 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:23.272103 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:25.272445 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:25.272400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:25.272938 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:25.272508 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:25.272938 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:25.272547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:25.272938 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:25.272619 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:25.272938 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:25.272670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:25.273136 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:25.272787 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:27.272536 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.272214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:27.273211 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:27.272624 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:27.273211 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.272292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:27.273211 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:27.272710 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:27.273211 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.272243 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:27.273211 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:27.272777 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:27.376473 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.376445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"8c66fc1451cda64b659af86de63b2a9aea5811e0d087e77843ece59cf2a8cc8c"} Jun 10 13:01:27.376608 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.376552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"35d88ee1548450770c265ed3029e6a04ca7da94cb7bebcce705348c74b0a8fdb"} Jun 10 13:01:27.376608 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.376605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"6cc885dae428e96fac595a53ffdc447ff4013ed6d7f5f9a11a1292303ca67374"} Jun 10 13:01:27.376719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.376653 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"4bd2db34dc55122089db78d91e9a8cfcf4d0017bb52296dccf4a58971db0d63a"} Jun 10 13:01:27.376719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.376703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"8d3636b332a91743aa3dde7b402f1945837eb12dfc1fe4b0d4e0e206450f2703"} Jun 10 13:01:27.378031 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.378001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wnvzr" event={"ID":"59501f36-8370-4b9c-8666-f699e7e965d4","Type":"ContainerStarted","Data":"fdf75e8d0bb3ffd3fe422b20cecf617f8b575d6f466903377183c6701a881ca6"} Jun 10 13:01:27.379601 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.379575 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wk7wq" event={"ID":"770a343a-ee40-4b93-a3a1-5a3edbf45796","Type":"ContainerStarted","Data":"2623701beec7bb43dc08bf7b96b29e8c12c70fec06997126524e16378c3db275"} Jun 10 13:01:27.381121 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.381066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" event={"ID":"a6200ac9-5b53-40f4-b520-972e06e7a6ee","Type":"ContainerStarted","Data":"3360cf66ff3f3b9f05156ccd1baf0dcf19801042d1c8144d2e4777f5f238d01c"} Jun 10 13:01:27.382807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.382781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8cbh7" event={"ID":"527fedf5-6673-4879-a512-7096aa7e7df6","Type":"ContainerStarted","Data":"67e883cbc8a77efd1c6f57fa3cde7016bdc882ddcf5105a98ce6daef0470ba24"} Jun 10 13:01:27.384379 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.384360 2562 generic.go:356] "Generic (PLEG): container finished" podID="45496b73-c90f-4194-ae2f-7ac3b364163c" containerID="427124c9d772819477157a321b052fe0a7f792fb94260393d7be3eb4c8b3202b" exitCode=0 Jun 10 13:01:27.384492 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.384426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerDied","Data":"427124c9d772819477157a321b052fe0a7f792fb94260393d7be3eb4c8b3202b"} Jun 10 13:01:27.386102 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.386077 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nwbv8" event={"ID":"5f0ab38f-b7a5-4b26-bd3b-6c004e68645a","Type":"ContainerStarted","Data":"c20fa416b1fd2ee5fa71e3590e08b66cac7fc54b758ccb6a0b72b2eaeeac45bf"} Jun 10 13:01:27.387767 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.387748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" event={"ID":"540eaf34-22e0-4f32-a52f-0cf6b2361c73","Type":"ContainerStarted","Data":"c873f81acf863f45d6f13f901e65e8669a9453fa4a4ab13ff338b02f69e14ccc"} Jun 10 13:01:27.395022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.394981 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wnvzr" podStartSLOduration=3.833529953 podStartE2EDuration="22.394969631s" totalImagesPullingTime="18.561439678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:27.394469431 +0000 UTC m=+22.585907645" watchObservedRunningTime="2026-06-10 13:01:27.394969631 +0000 UTC m=+22.586407845" Jun 10 13:01:27.440653 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.440567 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8cbh7" podStartSLOduration=8.000486347 podStartE2EDuration="22.440555304s" totalImagesPullingTime="14.440068957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:27.415373111 +0000 UTC m=+22.606811326" watchObservedRunningTime="2026-06-10 13:01:27.440555304 +0000 UTC m=+22.631993518" Jun 10 13:01:27.459066 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.459024 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgn8w" podStartSLOduration=3.891333341 podStartE2EDuration="22.459007189s" totalImagesPullingTime="18.567673848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:27.458631214 +0000 UTC m=+22.650069427" watchObservedRunningTime="2026-06-10 13:01:27.459007189 +0000 UTC m=+22.650445401" Jun 10 13:01:27.474742 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.474704 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wk7wq" podStartSLOduration=3.910910652 podStartE2EDuration="22.47469164s" totalImagesPullingTime="18.563780988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:27.474145471 +0000 UTC m=+22.665583697" watchObservedRunningTime="2026-06-10 13:01:27.47469164 +0000 UTC m=+22.666129854" Jun 10 13:01:27.493755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.493722 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nwbv8" podStartSLOduration=3.881634974 podStartE2EDuration="22.493710229s" totalImagesPullingTime="18.612075255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:27.492793915 +0000 UTC m=+22.684232129" watchObservedRunningTime="2026-06-10 13:01:27.493710229 +0000 UTC m=+22.685148442" Jun 10 13:01:27.642319 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.642275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:27.719707 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:27.719645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:28.043640 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.043603 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 13:01:28.150333 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.150298 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:28.212882 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.212850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:28.282210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.282071 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T13:01:28.0436224Z","UUID":"8ad8e77b-d653-41e7-ba9d-973096c4e512","Handler":null,"Name":"","Endpoint":""} Jun 10 13:01:28.283756 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.283731 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 13:01:28.283885 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.283770 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 13:01:28.326692 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.326666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:28.388277 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.388067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:28.394772 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.394745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"24fc620b7ed1f542a335f726c3c577e9d5eaa0e8e11c6803236e0e7caa7df3a1"} Jun 10 13:01:28.396743 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.396723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" event={"ID":"540eaf34-22e0-4f32-a52f-0cf6b2361c73","Type":"ContainerStarted","Data":"52bafef38e4f1e919b426928682734c40faf313f3aed6e087d21000e84b7bb06"} Jun 10 13:01:28.398195 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.398174 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gvph6" event={"ID":"65d5d995-c4da-40af-963e-34a6cd9621e2","Type":"ContainerStarted","Data":"f052f41c437d838b51504574e8b4448a50694968912ed7a4d80e35e541d276b1"} Jun 10 13:01:28.414937 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.414892 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gvph6" podStartSLOduration=4.84476691 podStartE2EDuration="23.414867526s" totalImagesPullingTime="18.570100616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:28.414291664 +0000 UTC m=+23.605729879" watchObservedRunningTime="2026-06-10 13:01:28.414867526 +0000 UTC m=+23.606305743" Jun 10 13:01:28.534316 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.534226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:28.637557 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:28.637492 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:29.243861 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.243833 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:29.244426 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.244409 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:29.271757 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.271732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:29.271856 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.271744 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:29.271856 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.271849 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:29.271959 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:29.271849 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:29.271959 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:29.271924 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:29.272072 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:29.271996 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:29.403236 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.403149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" event={"ID":"540eaf34-22e0-4f32-a52f-0cf6b2361c73","Type":"ContainerStarted","Data":"36df8af2ad930b4576351d765dcc162aecc87a90324789a3056ae2cbb5e53a20"} Jun 10 13:01:29.403721 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.403615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:29.404137 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.404113 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8cbh7" Jun 10 13:01:29.423791 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.423741 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g44qg" podStartSLOduration=3.773500617 podStartE2EDuration="24.42372813s" totalImagesPullingTime="20.650227513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:29.422974816 +0000 UTC m=+24.614413030" watchObservedRunningTime="2026-06-10 13:01:29.42372813 +0000 UTC m=+24.615166344" Jun 10 13:01:29.492575 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.492548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:29.788142 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.788100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:29.885687 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.885656 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:29.985295 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:29.985262 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:30.043409 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:30.043379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:30.168407 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:30.168348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:30.230973 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:30.230938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:30.400393 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:30.400298 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:30.409584 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:30.409551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"b28fc0aa6309b04cd9460a1f80bed7431d9bc6bddb7ceee2b6c13139fda12591"} Jun 10 13:01:30.459154 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:30.459121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:31.271720 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:31.271647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:31.271889 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:31.271647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:31.271889 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:31.271775 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:31.271889 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:31.271657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:31.271889 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:31.271862 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:31.272109 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:31.271910 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:32.416246 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.416066 2562 generic.go:356] "Generic (PLEG): container finished" podID="45496b73-c90f-4194-ae2f-7ac3b364163c" containerID="11a7990d9ca20e58b5f2d88589a966c8466c5d10b078bd37b5830437bc8b84da" exitCode=0 Jun 10 13:01:32.416995 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.416159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerDied","Data":"11a7990d9ca20e58b5f2d88589a966c8466c5d10b078bd37b5830437bc8b84da"} Jun 10 13:01:32.420222 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.420204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" event={"ID":"d80b95e2-38a2-4e04-bfa2-eca88efdf974","Type":"ContainerStarted","Data":"ae401be1b7978759e878524652ca84f4e1eb3f8e90834cbc02a1336b0f1d2a51"} Jun 10 13:01:32.420398 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.420384 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:32.420453 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.420443 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:32.435573 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.435553 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:32.468314 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:32.468278 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" podStartSLOduration=8.823346655 podStartE2EDuration="27.4682657s" totalImagesPullingTime="18.644919045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:32.468161069 +0000 UTC m=+27.659599283" watchObservedRunningTime="2026-06-10 13:01:32.4682657 +0000 UTC m=+27.659703913" Jun 10 13:01:33.268446 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.268406 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:33.272447 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.272419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:33.272589 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.272419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:33.272589 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:33.272534 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:33.272589 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.272545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:33.272706 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:33.272625 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:33.272706 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:33.272682 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:33.339235 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.339206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:33.423759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.423371 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:33.438570 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.438546 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:01:33.882054 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.881776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2xdlv"] Jun 10 13:01:33.882243 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.882172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:33.882320 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:33.882295 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:33.884158 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.884125 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mr4rw"] Jun 10 13:01:33.884264 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.884228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:33.884338 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:33.884316 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:33.884884 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.884861 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vzpr"] Jun 10 13:01:33.884964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:33.884949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:33.885047 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:33.885026 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:34.426437 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:34.426398 2562 generic.go:356] "Generic (PLEG): container finished" podID="45496b73-c90f-4194-ae2f-7ac3b364163c" containerID="d08cc622b35ebc894dbc40e654cdfd7b87ff518dfae319f06f3fec22620da3f9" exitCode=0 Jun 10 13:01:34.426809 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:34.426486 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerDied","Data":"d08cc622b35ebc894dbc40e654cdfd7b87ff518dfae319f06f3fec22620da3f9"} Jun 10 13:01:34.778337 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:34.778267 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:35.272419 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:35.272390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:35.272575 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:35.272480 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:35.272575 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:35.272555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:35.272672 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:35.272646 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:36.271782 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:36.271746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:36.272429 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:36.271853 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:36.434127 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:36.434092 2562 generic.go:356] "Generic (PLEG): container finished" podID="45496b73-c90f-4194-ae2f-7ac3b364163c" containerID="76c45c95ded697b465d995f65a8342e9d88ef2fd3cea1e4413edc96357b5e930" exitCode=0 Jun 10 13:01:36.434305 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:36.434136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerDied","Data":"76c45c95ded697b465d995f65a8342e9d88ef2fd3cea1e4413edc96357b5e930"} Jun 10 13:01:37.272582 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:37.272544 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:37.273107 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:37.272592 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:37.273107 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:37.272690 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:37.273107 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:37.272831 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:37.684766 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:37.684726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:37.756111 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:37.756079 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:37.820745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:37.820668 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:38.272170 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:38.272134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:38.272362 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:38.272264 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:38.980917 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:38.980880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:38.981372 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:38.981008 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:38.981372 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:38.981081 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret podName:ccf1f044-8924-435a-8dc6-bd2f3e816436 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:10.981059837 +0000 UTC m=+66.172498035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret") pod "global-pull-secret-syncer-4vzpr" (UID: "ccf1f044-8924-435a-8dc6-bd2f3e816436") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:01:39.081745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:39.081649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:39.081944 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.081807 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:39.081944 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.081873 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs podName:db9c66fc-6c07-474e-8242-e2e673c7d7f3 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:11.081854174 +0000 UTC m=+66.273292371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs") pod "network-metrics-daemon-2xdlv" (UID: "db9c66fc-6c07-474e-8242-e2e673c7d7f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:01:39.182792 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:39.182762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:39.182946 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.182901 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:01:39.182946 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.182919 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:01:39.182946 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.182931 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g9btk for pod openshift-network-diagnostics/network-check-target-mr4rw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:39.183096 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.182990 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk podName:1b105f4b-1739-45f9-9596-5843259afd7f nodeName:}" failed. No retries permitted until 2026-06-10 13:02:11.182971572 +0000 UTC m=+66.374409764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g9btk" (UniqueName: "kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk") pod "network-check-target-mr4rw" (UID: "1b105f4b-1739-45f9-9596-5843259afd7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:01:39.272365 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:39.272282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:39.272547 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.272421 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vzpr" podUID="ccf1f044-8924-435a-8dc6-bd2f3e816436" Jun 10 13:01:39.272547 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:39.272467 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:39.272663 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:39.272579 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mr4rw" podUID="1b105f4b-1739-45f9-9596-5843259afd7f" Jun 10 13:01:40.272136 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.271949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:40.272535 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:40.272239 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xdlv" podUID="db9c66fc-6c07-474e-8242-e2e673c7d7f3" Jun 10 13:01:40.593646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.593627 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-45.ec2.internal" event="NodeReady" Jun 10 13:01:40.593754 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.593747 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 13:01:40.643191 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.643167 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cmkvp"] Jun 10 13:01:40.643301 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.643275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:40.644984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.644967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.645068 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.645012 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xm8m6"] Jun 10 13:01:40.646540 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.646508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.648169 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.648150 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 13:01:40.648253 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.648229 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pxsg\"" Jun 10 13:01:40.648455 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.648441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 13:01:40.649235 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.649218 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vr97x\"" Jun 10 13:01:40.649384 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.649368 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 13:01:40.649451 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.649440 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 13:01:40.650210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.650194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 13:01:40.662828 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.662808 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmkvp"] Jun 10 13:01:40.663481 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.663460 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm8m6"] Jun 10 13:01:40.756070 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.755921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:40.792853 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.792834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-tmp-dir\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.792931 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.792859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b3f55d7-cb29-495c-806e-c70b17518661-cert\") pod \"ingress-canary-xm8m6\" (UID: \"0b3f55d7-cb29-495c-806e-c70b17518661\") " pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.792931 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.792880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shjhm\" (UniqueName: \"kubernetes.io/projected/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-kube-api-access-shjhm\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.793009 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.792971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zbk\" (UniqueName: \"kubernetes.io/projected/0b3f55d7-cb29-495c-806e-c70b17518661-kube-api-access-g5zbk\") pod \"ingress-canary-xm8m6\" (UID: \"0b3f55d7-cb29-495c-806e-c70b17518661\") " pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.793043 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.793009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-config-volume\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.793043 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.793023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.854710 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.854681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:40.894225 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zbk\" (UniqueName: \"kubernetes.io/projected/0b3f55d7-cb29-495c-806e-c70b17518661-kube-api-access-g5zbk\") pod \"ingress-canary-xm8m6\" (UID: \"0b3f55d7-cb29-495c-806e-c70b17518661\") " pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.894374 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-config-volume\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.894374 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.894374 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-tmp-dir\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.894374 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:40.894341 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:40.894374 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b3f55d7-cb29-495c-806e-c70b17518661-cert\") pod \"ingress-canary-xm8m6\" (UID: \"0b3f55d7-cb29-495c-806e-c70b17518661\") " pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.894631 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shjhm\" (UniqueName: \"kubernetes.io/projected/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-kube-api-access-shjhm\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.894631 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:40.894406 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls podName:1a032599-5bb8-4ea9-b725-23e5f6f1af3f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:41.394392431 +0000 UTC m=+36.585830623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls") pod "dns-default-cmkvp" (UID: "1a032599-5bb8-4ea9-b725-23e5f6f1af3f") : secret "dns-default-metrics-tls" not found Jun 10 13:01:40.894719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-tmp-dir\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.894914 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.894899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-config-volume\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.898469 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.898453 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b3f55d7-cb29-495c-806e-c70b17518661-cert\") pod \"ingress-canary-xm8m6\" (UID: \"0b3f55d7-cb29-495c-806e-c70b17518661\") " pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.905250 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.904338 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shjhm\" (UniqueName: \"kubernetes.io/projected/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-kube-api-access-shjhm\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:40.905250 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.904675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zbk\" (UniqueName: \"kubernetes.io/projected/0b3f55d7-cb29-495c-806e-c70b17518661-kube-api-access-g5zbk\") pod \"ingress-canary-xm8m6\" (UID: \"0b3f55d7-cb29-495c-806e-c70b17518661\") " pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:40.957415 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.957377 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:40.959218 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:40.959201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xm8m6" Jun 10 13:01:41.084981 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.084949 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xm8m6"] Jun 10 13:01:41.088888 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:41.088863 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3f55d7_cb29_495c_806e_c70b17518661.slice/crio-852c81a80f337e4cae7f2598831b348abe75c29cc6a25efb4c613836220f4212 WatchSource:0}: Error finding container 852c81a80f337e4cae7f2598831b348abe75c29cc6a25efb4c613836220f4212: Status 404 returned error can't find the container with id 852c81a80f337e4cae7f2598831b348abe75c29cc6a25efb4c613836220f4212 Jun 10 13:01:41.271992 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.271917 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:01:41.272145 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.271918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:01:41.274410 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.274387 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:01:41.274410 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.274404 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:01:41.274822 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.274411 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:01:41.274822 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.274466 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhtjq\"" Jun 10 13:01:41.398586 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.398561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:41.398739 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:41.398720 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:41.398806 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:41.398795 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls podName:1a032599-5bb8-4ea9-b725-23e5f6f1af3f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:42.398773415 +0000 UTC m=+37.590211624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls") pod "dns-default-cmkvp" (UID: "1a032599-5bb8-4ea9-b725-23e5f6f1af3f") : secret "dns-default-metrics-tls" not found Jun 10 13:01:41.447116 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.447087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm8m6" event={"ID":"0b3f55d7-cb29-495c-806e-c70b17518661","Type":"ContainerStarted","Data":"852c81a80f337e4cae7f2598831b348abe75c29cc6a25efb4c613836220f4212"} Jun 10 13:01:41.449947 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.449925 2562 generic.go:356] "Generic (PLEG): container finished" podID="45496b73-c90f-4194-ae2f-7ac3b364163c" containerID="df84ce4108d89c0117b87d90693d6ddd321ad49e32c518cfc9162eb2112f81a2" exitCode=0 Jun 10 13:01:41.450019 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.449982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerDied","Data":"df84ce4108d89c0117b87d90693d6ddd321ad49e32c518cfc9162eb2112f81a2"} Jun 10 13:01:41.565181 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.564950 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:41.665972 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:41.665934 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:42.271533 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:42.271492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:01:42.274250 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:42.274228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:01:42.274368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:42.274261 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mssf9\"" Jun 10 13:01:42.406138 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:42.406107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:42.406616 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:42.406256 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:42.406616 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:42.406328 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls podName:1a032599-5bb8-4ea9-b725-23e5f6f1af3f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:44.406308614 +0000 UTC m=+39.597746809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls") pod "dns-default-cmkvp" (UID: "1a032599-5bb8-4ea9-b725-23e5f6f1af3f") : secret "dns-default-metrics-tls" not found Jun 10 13:01:42.456427 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:42.456389 2562 generic.go:356] "Generic (PLEG): container finished" podID="45496b73-c90f-4194-ae2f-7ac3b364163c" containerID="5fbf9f7e95e68233941aa3c952c22b773af2567b708387b100d4ce82e4ba4319" exitCode=0 Jun 10 13:01:42.456618 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:42.456448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerDied","Data":"5fbf9f7e95e68233941aa3c952c22b773af2567b708387b100d4ce82e4ba4319"} Jun 10 13:01:43.197894 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.197861 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-thk25"] Jun 10 13:01:43.219849 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.219824 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-thk25"] Jun 10 13:01:43.219993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.219906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.222617 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.222591 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 13:01:43.222744 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.222600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 13:01:43.222744 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.222603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 13:01:43.223773 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.223754 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vfrlw\"" Jun 10 13:01:43.223855 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.223779 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 13:01:43.237085 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.237063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:43.294540 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.294504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:43.413183 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.413163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/571854b5-3897-4b3b-85fd-39e32f9a8fa0-signing-key\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.413640 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.413191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqlrc\" (UniqueName: \"kubernetes.io/projected/571854b5-3897-4b3b-85fd-39e32f9a8fa0-kube-api-access-qqlrc\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.413640 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.413229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/571854b5-3897-4b3b-85fd-39e32f9a8fa0-signing-cabundle\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.460070 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.460010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xm8m6" event={"ID":"0b3f55d7-cb29-495c-806e-c70b17518661","Type":"ContainerStarted","Data":"bb1fff8987df54a5290626e7685b03d795e9ded63eb6f17744309aaf40a2ba5a"} Jun 10 13:01:43.463211 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.463192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" event={"ID":"45496b73-c90f-4194-ae2f-7ac3b364163c","Type":"ContainerStarted","Data":"ac8d0edbe05a87fa5b7a7137ee813f2f728b9373f02a4ab96c9786d7c47ae0bf"} Jun 10 13:01:43.478951 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.478912 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xm8m6" podStartSLOduration=1.733437861 podStartE2EDuration="3.47889951s" totalImagesPullingTime="1.745461649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:43.478220178 +0000 UTC m=+38.669658405" watchObservedRunningTime="2026-06-10 13:01:43.47889951 +0000 UTC m=+38.670337701" Jun 10 13:01:43.505739 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.505701 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4fp8j" podStartSLOduration=9.732366723 podStartE2EDuration="38.505692041s" totalImagesPullingTime="28.773325318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:43.504250846 +0000 UTC m=+38.695689099" watchObservedRunningTime="2026-06-10 13:01:43.505692041 +0000 UTC m=+38.697130254" Jun 10 13:01:43.514490 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.514466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlrc\" (UniqueName: \"kubernetes.io/projected/571854b5-3897-4b3b-85fd-39e32f9a8fa0-kube-api-access-qqlrc\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.514690 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.514540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/571854b5-3897-4b3b-85fd-39e32f9a8fa0-signing-cabundle\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.514690 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.514609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/571854b5-3897-4b3b-85fd-39e32f9a8fa0-signing-key\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.515337 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.515316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/571854b5-3897-4b3b-85fd-39e32f9a8fa0-signing-cabundle\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.517933 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.517915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/571854b5-3897-4b3b-85fd-39e32f9a8fa0-signing-key\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.523305 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.523255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqlrc\" (UniqueName: \"kubernetes.io/projected/571854b5-3897-4b3b-85fd-39e32f9a8fa0-kube-api-access-qqlrc\") pod \"service-ca-7d74d578b8-thk25\" (UID: \"571854b5-3897-4b3b-85fd-39e32f9a8fa0\") " pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.527922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.527907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-thk25" Jun 10 13:01:43.573984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.573965 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wnvzr_59501f36-8370-4b9c-8666-f699e7e965d4/dns-node-resolver/0.log" Jun 10 13:01:43.630095 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.629942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:43.667048 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.667019 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-thk25"] Jun 10 13:01:43.670660 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:43.670635 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571854b5_3897_4b3b_85fd_39e32f9a8fa0.slice/crio-522c90fc1209f5feb471716638bc09abc15c2a67d64616f242524301b44609a3 WatchSource:0}: Error finding container 522c90fc1209f5feb471716638bc09abc15c2a67d64616f242524301b44609a3: Status 404 returned error can't find the container with id 522c90fc1209f5feb471716638bc09abc15c2a67d64616f242524301b44609a3 Jun 10 13:01:43.729405 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:43.729349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:44.239503 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:44.239466 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:44.421477 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:44.421432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:44.421993 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:44.421596 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:44.421993 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:44.421672 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls podName:1a032599-5bb8-4ea9-b725-23e5f6f1af3f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:48.42164964 +0000 UTC m=+43.613087835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls") pod "dns-default-cmkvp" (UID: "1a032599-5bb8-4ea9-b725-23e5f6f1af3f") : secret "dns-default-metrics-tls" not found Jun 10 13:01:44.467302 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:44.467261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-thk25" event={"ID":"571854b5-3897-4b3b-85fd-39e32f9a8fa0","Type":"ContainerStarted","Data":"522c90fc1209f5feb471716638bc09abc15c2a67d64616f242524301b44609a3"} Jun 10 13:01:44.575300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:44.575216 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wk7wq_770a343a-ee40-4b93-a3a1-5a3edbf45796/node-ca/0.log" Jun 10 13:01:44.918885 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:44.918840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:44.997552 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:44.997498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:45.373138 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:45.373044 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm8m6_0b3f55d7-cb29-495c-806e-c70b17518661/serve-healthcheck-canary/0.log" Jun 10 13:01:46.473242 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:46.473209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-thk25" event={"ID":"571854b5-3897-4b3b-85fd-39e32f9a8fa0","Type":"ContainerStarted","Data":"b3d05ed2157218c1dbb51afc11d311e5227d35fdd41dd53b10474a2b21b31500"} Jun 10 13:01:46.493581 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:46.493502 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-thk25" podStartSLOduration=1.045850289 podStartE2EDuration="3.493484794s" totalImagesPullingTime="2.447634505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:46.492974195 +0000 UTC m=+41.684412437" watchObservedRunningTime="2026-06-10 13:01:46.493484794 +0000 UTC m=+41.684923009" Jun 10 13:01:47.424783 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:47.424744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:47.527113 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:47.527083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:47.628688 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:47.628636 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:47.730073 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:47.729987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:47.837230 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:47.837198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:48.447194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:48.447160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:48.447369 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:48.447273 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:01:48.447369 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:01:48.447332 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls podName:1a032599-5bb8-4ea9-b725-23e5f6f1af3f nodeName:}" failed. No retries permitted until 2026-06-10 13:01:56.447315973 +0000 UTC m=+51.638754166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls") pod "dns-default-cmkvp" (UID: "1a032599-5bb8-4ea9-b725-23e5f6f1af3f") : secret "dns-default-metrics-tls" not found Jun 10 13:01:48.459400 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:48.459367 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:48.859179 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:48.859093 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:49.320764 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:49.320733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:49.463651 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:49.463617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:49.858644 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:49.858608 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:50.453599 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:50.453563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:50.927579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:50.927546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:51.047201 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:51.047173 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:51.366246 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:51.366177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:51.467141 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:51.467106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:51.943593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:51.943549 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:52.049185 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:52.049144 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:52.108264 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:52.108232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:52.671665 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:52.671618 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:52.861044 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:52.861009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:53.254197 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:53.254163 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:53.450408 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:53.450376 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:53.564039 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:53.563958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:53.852984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:53.852892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:54.458191 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:54.458153 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:55.054744 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:55.054706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:55.186018 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:55.185982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:55.289561 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:55.289529 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:55.534345 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:55.534313 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:55.852214 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:55.852132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:56.506556 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:56.506503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:56.509478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:56.509454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a032599-5bb8-4ea9-b725-23e5f6f1af3f-metrics-tls\") pod \"dns-default-cmkvp\" (UID: \"1a032599-5bb8-4ea9-b725-23e5f6f1af3f\") " pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:56.555407 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:56.555373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:56.641369 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:56.641337 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:56.701406 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:56.701378 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmkvp"] Jun 10 13:01:56.705206 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:01:56.705179 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a032599_5bb8_4ea9_b725_23e5f6f1af3f.slice/crio-fc401fb8744c7403e1832208031a2f19fa4d39b085e9e0cec99faa0cf04602a0 WatchSource:0}: Error finding container fc401fb8744c7403e1832208031a2f19fa4d39b085e9e0cec99faa0cf04602a0: Status 404 returned error can't find the container with id fc401fb8744c7403e1832208031a2f19fa4d39b085e9e0cec99faa0cf04602a0 Jun 10 13:01:56.711585 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:56.711557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.065014 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.064980 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.159258 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.159221 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.318621 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.318540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.440944 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.440914 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.501604 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.501570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmkvp" event={"ID":"1a032599-5bb8-4ea9-b725-23e5f6f1af3f","Type":"ContainerStarted","Data":"fc401fb8744c7403e1832208031a2f19fa4d39b085e9e0cec99faa0cf04602a0"} Jun 10 13:01:57.511922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.511894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.583821 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.583727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.771341 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.771308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.844635 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.844547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:57.939779 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:57.939733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:58.053804 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:58.053757 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:58.169270 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:58.169240 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:58.270421 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:58.270390 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:58.783818 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:58.783789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:58.998368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:58.998333 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:59.397529 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:59.397425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:59.455665 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:59.455637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:59.507644 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:59.507615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmkvp" event={"ID":"1a032599-5bb8-4ea9-b725-23e5f6f1af3f","Type":"ContainerStarted","Data":"aea36fe1373833e1bf8ac1a430a51019d67b6c0bef6855e597d47802eec0805c"} Jun 10 13:01:59.507749 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:59.507656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmkvp" event={"ID":"1a032599-5bb8-4ea9-b725-23e5f6f1af3f","Type":"ContainerStarted","Data":"f8daf3fdb2c71c8163e5ffa0aff7066ef37f17991d7889e23c2e7715f7e2c642"} Jun 10 13:01:59.507812 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:59.507755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cmkvp" Jun 10 13:01:59.528909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:01:59.528872 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cmkvp" podStartSLOduration=17.661527006 podStartE2EDuration="19.528856146s" totalImagesPullingTime="1.86732914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:59.528174086 +0000 UTC m=+54.719612313" watchObservedRunningTime="2026-06-10 13:01:59.528856146 +0000 UTC m=+54.720294360" Jun 10 13:02:00.138696 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:00.138663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:02.971977 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.971945 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v"] Jun 10 13:02:02.974183 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.974167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:02.984454 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.984433 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 13:02:02.984584 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.984496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 13:02:02.985528 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.985490 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 13:02:02.985528 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.985502 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 13:02:02.985681 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.985535 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 13:02:02.985681 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.985581 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 13:02:02.985681 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.985589 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 13:02:02.996799 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:02.996778 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v"] Jun 10 13:02:03.019477 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.019451 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-62lhk"] Jun 10 13:02:03.021095 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.021081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.024935 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.024914 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 13:02:03.025285 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.025264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 13:02:03.025549 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.025525 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c57wb\"" Jun 10 13:02:03.025644 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.025616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 13:02:03.026324 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.026299 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 13:02:03.038669 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.038647 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-62lhk"] Jun 10 13:02:03.055173 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.055270 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7857c752-235b-48b8-81e8-84b746e573ac-crio-socket\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.055270 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7857c752-235b-48b8-81e8-84b746e573ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.055270 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-ca\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.055270 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-hub\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.055444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.055444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf65f\" (UniqueName: \"kubernetes.io/projected/7857c752-235b-48b8-81e8-84b746e573ac-kube-api-access-qf65f\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.055444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce18723e-4293-4fbb-aba2-4a121ee648be-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.055444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7857c752-235b-48b8-81e8-84b746e573ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.055444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsk4w\" (UniqueName: \"kubernetes.io/projected/ce18723e-4293-4fbb-aba2-4a121ee648be-kube-api-access-dsk4w\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.055629 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.055459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7857c752-235b-48b8-81e8-84b746e573ac-data-volume\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.142059 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.142025 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:03.156155 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7857c752-235b-48b8-81e8-84b746e573ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.156263 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-ca\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.156263 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-hub\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.156263 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.156392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf65f\" (UniqueName: \"kubernetes.io/projected/7857c752-235b-48b8-81e8-84b746e573ac-kube-api-access-qf65f\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.156392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce18723e-4293-4fbb-aba2-4a121ee648be-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.156392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7857c752-235b-48b8-81e8-84b746e573ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.156392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsk4w\" (UniqueName: \"kubernetes.io/projected/ce18723e-4293-4fbb-aba2-4a121ee648be-kube-api-access-dsk4w\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.156737 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7857c752-235b-48b8-81e8-84b746e573ac-data-volume\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.156860 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.156860 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.156800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7857c752-235b-48b8-81e8-84b746e573ac-crio-socket\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.157041 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.157021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7857c752-235b-48b8-81e8-84b746e573ac-crio-socket\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.157125 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.157103 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7857c752-235b-48b8-81e8-84b746e573ac-data-volume\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.157188 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.157123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce18723e-4293-4fbb-aba2-4a121ee648be-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.157601 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.157580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7857c752-235b-48b8-81e8-84b746e573ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.158926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.158881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-ca\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.159034 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.158959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.159127 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.159103 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-hub\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.159326 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.159308 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7857c752-235b-48b8-81e8-84b746e573ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.159725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.159709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce18723e-4293-4fbb-aba2-4a121ee648be-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.165909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.165889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsk4w\" (UniqueName: \"kubernetes.io/projected/ce18723e-4293-4fbb-aba2-4a121ee648be-kube-api-access-dsk4w\") pod \"cluster-proxy-proxy-agent-7799f59587-8wv5v\" (UID: \"ce18723e-4293-4fbb-aba2-4a121ee648be\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.166475 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.166456 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf65f\" (UniqueName: \"kubernetes.io/projected/7857c752-235b-48b8-81e8-84b746e573ac-kube-api-access-qf65f\") pod \"insights-runtime-extractor-62lhk\" (UID: \"7857c752-235b-48b8-81e8-84b746e573ac\") " pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.298244 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.298173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" Jun 10 13:02:03.329978 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.329938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-62lhk" Jun 10 13:02:03.337709 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.337676 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:03.422027 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.421991 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:03.447883 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.447855 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v"] Jun 10 13:02:03.451436 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:03.451405 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce18723e_4293_4fbb_aba2_4a121ee648be.slice/crio-923ff8ba7b1ffb1acd6c5bbcdadfd34e2853bdda8bb10ec34e679c82cc007fa8 WatchSource:0}: Error finding container 923ff8ba7b1ffb1acd6c5bbcdadfd34e2853bdda8bb10ec34e679c82cc007fa8: Status 404 returned error can't find the container with id 923ff8ba7b1ffb1acd6c5bbcdadfd34e2853bdda8bb10ec34e679c82cc007fa8 Jun 10 13:02:03.465678 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.465655 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-62lhk"] Jun 10 13:02:03.471126 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:03.471090 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7857c752_235b_48b8_81e8_84b746e573ac.slice/crio-570dd58ce6daa4f99e1b429bab832be32180590723cf7431924b9cb3503484d3 WatchSource:0}: Error finding container 570dd58ce6daa4f99e1b429bab832be32180590723cf7431924b9cb3503484d3: Status 404 returned error can't find the container with id 570dd58ce6daa4f99e1b429bab832be32180590723cf7431924b9cb3503484d3 Jun 10 13:02:03.517083 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.517053 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" event={"ID":"ce18723e-4293-4fbb-aba2-4a121ee648be","Type":"ContainerStarted","Data":"923ff8ba7b1ffb1acd6c5bbcdadfd34e2853bdda8bb10ec34e679c82cc007fa8"} Jun 10 13:02:03.518451 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:03.518421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62lhk" event={"ID":"7857c752-235b-48b8-81e8-84b746e573ac","Type":"ContainerStarted","Data":"570dd58ce6daa4f99e1b429bab832be32180590723cf7431924b9cb3503484d3"} Jun 10 13:02:04.527690 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:04.527660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62lhk" event={"ID":"7857c752-235b-48b8-81e8-84b746e573ac","Type":"ContainerStarted","Data":"4d323a98d0e035ec24d43d71fe4bfbe79f508ab66258d0f98fb168ed20bcc8aa"} Jun 10 13:02:04.528050 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:04.527733 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62lhk" event={"ID":"7857c752-235b-48b8-81e8-84b746e573ac","Type":"ContainerStarted","Data":"15b6f336c7011fb9c8c993f273ee754e21f6856ab232240a821d91c137032c2c"} Jun 10 13:02:05.451121 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:05.451093 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vxq8s" Jun 10 13:02:05.590083 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:05.590045 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:05.653694 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:05.653647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:06.046477 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:06.046438 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:06.200954 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:06.200929 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:06.301929 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:06.301862 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:06.539506 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:06.539477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-62lhk" event={"ID":"7857c752-235b-48b8-81e8-84b746e573ac","Type":"ContainerStarted","Data":"f7c973fb948b0d58ba26921b4e0271767f1be30becb5c8751eee415b5c2c7d16"} Jun 10 13:02:06.558733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:06.558647 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-62lhk" podStartSLOduration=2.064389802 podStartE2EDuration="4.558632346s" totalImagesPullingTime="2.494242544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:02:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:06.55714921 +0000 UTC m=+61.748587424" watchObservedRunningTime="2026-06-10 13:02:06.558632346 +0000 UTC m=+61.750070559" Jun 10 13:02:07.014056 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.014024 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:07.020613 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.020593 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76d94f9946-7nrvj"] Jun 10 13:02:07.022352 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.022337 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.024810 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.024789 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xk8jz\"" Jun 10 13:02:07.024965 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.024790 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 13:02:07.024965 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.024840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 13:02:07.024965 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.024840 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 13:02:07.025795 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.025779 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 13:02:07.025866 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.025855 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 13:02:07.025923 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.025881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 13:02:07.025923 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.025917 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 13:02:07.035323 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.035301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d94f9946-7nrvj"] Jun 10 13:02:07.082045 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.082008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:07.085891 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.085875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-oauth-serving-cert\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.085973 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.085925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-oauth-config\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.085973 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.085945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-serving-cert\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.086051 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.086027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-service-ca\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.086084 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.086068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-config\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.086116 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.086089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2fs\" (UniqueName: \"kubernetes.io/projected/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-kube-api-access-pq2fs\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.186368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.186338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-oauth-serving-cert\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.186550 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.186525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-oauth-config\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.186606 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.186580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-serving-cert\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.186643 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.186617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-service-ca\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.186681 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.186669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-config\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.186725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.186696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2fs\" (UniqueName: \"kubernetes.io/projected/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-kube-api-access-pq2fs\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.187176 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.187153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-oauth-serving-cert\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.187304 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.187285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-config\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.187440 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.187419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-service-ca\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.189076 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.189055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-oauth-config\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.189177 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.189069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-serving-cert\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.195562 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.195542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2fs\" (UniqueName: \"kubernetes.io/projected/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-kube-api-access-pq2fs\") pod \"console-76d94f9946-7nrvj\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.331751 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.331692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:07.451684 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.451643 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76d94f9946-7nrvj"] Jun 10 13:02:07.455139 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:07.455110 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2a8e4a_bac3_4474_bc84_6c5c0af99a25.slice/crio-5fddee4f9dcf0850761d399a3e292acadf96eeebfa975c70e97472c47e9d119a WatchSource:0}: Error finding container 5fddee4f9dcf0850761d399a3e292acadf96eeebfa975c70e97472c47e9d119a: Status 404 returned error can't find the container with id 5fddee4f9dcf0850761d399a3e292acadf96eeebfa975c70e97472c47e9d119a Jun 10 13:02:07.544184 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:07.544149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d94f9946-7nrvj" event={"ID":"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25","Type":"ContainerStarted","Data":"5fddee4f9dcf0850761d399a3e292acadf96eeebfa975c70e97472c47e9d119a"} Jun 10 13:02:08.478984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:08.478949 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:08.553039 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:08.553007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:09.218684 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:09.218646 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:09.511924 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:09.511849 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cmkvp" Jun 10 13:02:11.017820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.017776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:02:11.020290 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.020264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:02:11.030937 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.030874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccf1f044-8924-435a-8dc6-bd2f3e816436-original-pull-secret\") pod \"global-pull-secret-syncer-4vzpr\" (UID: \"ccf1f044-8924-435a-8dc6-bd2f3e816436\") " pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:02:11.118352 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.118317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:02:11.120983 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.120959 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:02:11.131328 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.131304 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9c66fc-6c07-474e-8242-e2e673c7d7f3-metrics-certs\") pod \"network-metrics-daemon-2xdlv\" (UID: \"db9c66fc-6c07-474e-8242-e2e673c7d7f3\") " pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:02:11.219162 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.219130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:02:11.221706 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.221683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:02:11.231803 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.231781 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:02:11.242408 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.242362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9btk\" (UniqueName: \"kubernetes.io/projected/1b105f4b-1739-45f9-9596-5843259afd7f-kube-api-access-g9btk\") pod \"network-check-target-mr4rw\" (UID: \"1b105f4b-1739-45f9-9596-5843259afd7f\") " pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:02:11.273719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.273655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:11.284863 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.284844 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dhtjq\"" Jun 10 13:02:11.286934 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.286912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vzpr" Jun 10 13:02:11.293385 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.293367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:02:11.383265 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.383230 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mssf9\"" Jun 10 13:02:11.391778 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.391732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xdlv" Jun 10 13:02:11.431829 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.431798 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:11.810736 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:11.810703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:13.308562 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.308531 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2xdlv"] Jun 10 13:02:13.312804 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:13.312495 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9c66fc_6c07_474e_8242_e2e673c7d7f3.slice/crio-4171b0390dba677a9d7293666b2f750cf98459066f8e9beb5cd94d9a0fa16700 WatchSource:0}: Error finding container 4171b0390dba677a9d7293666b2f750cf98459066f8e9beb5cd94d9a0fa16700: Status 404 returned error can't find the container with id 4171b0390dba677a9d7293666b2f750cf98459066f8e9beb5cd94d9a0fa16700 Jun 10 13:02:13.530750 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.530724 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vzpr"] Jun 10 13:02:13.534008 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.533987 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mr4rw"] Jun 10 13:02:13.535660 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:13.535632 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf1f044_8924_435a_8dc6_bd2f3e816436.slice/crio-9311d707dc6cbf3416da512d530615d04fa6a98293724e00cbacbaaa87f36c75 WatchSource:0}: Error finding container 9311d707dc6cbf3416da512d530615d04fa6a98293724e00cbacbaaa87f36c75: Status 404 returned error can't find the container with id 9311d707dc6cbf3416da512d530615d04fa6a98293724e00cbacbaaa87f36c75 Jun 10 13:02:13.568472 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.568437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2xdlv" event={"ID":"db9c66fc-6c07-474e-8242-e2e673c7d7f3","Type":"ContainerStarted","Data":"4171b0390dba677a9d7293666b2f750cf98459066f8e9beb5cd94d9a0fa16700"} Jun 10 13:02:13.569341 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.569318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vzpr" event={"ID":"ccf1f044-8924-435a-8dc6-bd2f3e816436","Type":"ContainerStarted","Data":"9311d707dc6cbf3416da512d530615d04fa6a98293724e00cbacbaaa87f36c75"} Jun 10 13:02:13.570683 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.570657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d94f9946-7nrvj" event={"ID":"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25","Type":"ContainerStarted","Data":"a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f"} Jun 10 13:02:13.571757 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.571737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mr4rw" event={"ID":"1b105f4b-1739-45f9-9596-5843259afd7f","Type":"ContainerStarted","Data":"5c137dd6f8ec8c26c24fa2913c22c93c891650505dd3d0c4f3acaf4759ef3b4b"} Jun 10 13:02:13.588841 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:13.588784 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76d94f9946-7nrvj" podStartSLOduration=0.875759495 podStartE2EDuration="6.588767006s" totalImagesPullingTime="5.713007511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:13.588457237 +0000 UTC m=+68.779895450" watchObservedRunningTime="2026-06-10 13:02:13.588767006 +0000 UTC m=+68.780205220" Jun 10 13:02:14.123997 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.123897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:14.184993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.184937 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:14.580887 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.580855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" event={"ID":"ce18723e-4293-4fbb-aba2-4a121ee648be","Type":"ContainerStarted","Data":"d21ff42a74004fc94a27e9b5bea1f8dc77237c4a5057a2811c5311106e360d25"} Jun 10 13:02:14.581280 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.580907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" event={"ID":"ce18723e-4293-4fbb-aba2-4a121ee648be","Type":"ContainerStarted","Data":"84dd6520ae9e95ba0d95b8151f962852708da639e3b9b72119cbc2109a35dd04"} Jun 10 13:02:14.581280 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.580927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" event={"ID":"ce18723e-4293-4fbb-aba2-4a121ee648be","Type":"ContainerStarted","Data":"be2f5be067dc5f877e97ca2fd72c2e206935a1d311e9c717cbddc2208100dc79"} Jun 10 13:02:14.583632 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.583603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2xdlv" event={"ID":"db9c66fc-6c07-474e-8242-e2e673c7d7f3","Type":"ContainerStarted","Data":"599216bbc3c7e00d9876e4cb1e39a554a525ebdf5275773864ba3671da78b301"} Jun 10 13:02:14.602920 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:14.602250 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7799f59587-8wv5v" podStartSLOduration=2.551014087 podStartE2EDuration="12.602229171s" totalImagesPullingTime="10.051215084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:14.60059547 +0000 UTC m=+69.792033687" watchObservedRunningTime="2026-06-10 13:02:14.602229171 +0000 UTC m=+69.793667386" Jun 10 13:02:15.461209 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:15.461164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:15.543236 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:15.543202 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:15.589451 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:15.589390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2xdlv" event={"ID":"db9c66fc-6c07-474e-8242-e2e673c7d7f3","Type":"ContainerStarted","Data":"f9e97043d53663938756f53a676f6280e5e54883e25f25b20e50211dba815890"} Jun 10 13:02:15.608267 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:15.608218 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2xdlv" podStartSLOduration=69.486002963 podStartE2EDuration="1m10.608200224s" totalImagesPullingTime="1.122197261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:15.607856556 +0000 UTC m=+70.799294771" watchObservedRunningTime="2026-06-10 13:02:15.608200224 +0000 UTC m=+70.799638439" Jun 10 13:02:15.702998 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:15.702969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:15.759746 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:15.759663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:16.419392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:16.419355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:16.487755 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:16.487720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:17.332810 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:17.332781 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:17.333251 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:17.332840 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:17.338273 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:17.338248 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:17.464173 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:17.464140 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:17.603421 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:17.603341 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:18.111907 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:18.111868 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:18.218321 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:18.218269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:18.671678 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:18.671638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:18.776767 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:18.776736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:18.875011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:18.874953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:19.603746 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.603714 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:19.606404 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.606376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vzpr" event={"ID":"ccf1f044-8924-435a-8dc6-bd2f3e816436","Type":"ContainerStarted","Data":"b1f01973452e62a1dffe45e6a5a629f3ae020d6c712aa1fa59b7f3f9b85052eb"} Jun 10 13:02:19.607835 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.607804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mr4rw" event={"ID":"1b105f4b-1739-45f9-9596-5843259afd7f","Type":"ContainerStarted","Data":"4a5f167b5bca1997cbdfc8955173a5d351a6110a9780d8a965bd6b26a4dabf72"} Jun 10 13:02:19.607954 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.607938 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:02:19.630120 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.630078 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4vzpr" podStartSLOduration=69.456146495 podStartE2EDuration="1m14.630062866s" totalImagesPullingTime="5.173916371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:19.629297976 +0000 UTC m=+74.820736190" watchObservedRunningTime="2026-06-10 13:02:19.630062866 +0000 UTC m=+74.821501078" Jun 10 13:02:19.646098 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.646052 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mr4rw" podStartSLOduration=69.47604194 podStartE2EDuration="1m14.646034801s" totalImagesPullingTime="5.169992861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:19.645431223 +0000 UTC m=+74.836869436" watchObservedRunningTime="2026-06-10 13:02:19.646034801 +0000 UTC m=+74.837473016" Jun 10 13:02:19.815589 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.815546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:19.872202 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.872111 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92"] Jun 10 13:02:19.878186 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.878156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:19.878537 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.878061 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2d4xw"] Jun 10 13:02:19.881082 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.881057 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 13:02:19.881416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.881396 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 13:02:19.881525 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.881459 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 13:02:19.881648 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.881633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 13:02:19.882565 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.882256 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 13:02:19.882565 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.882377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c889k\"" Jun 10 13:02:19.882941 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.882785 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 13:02:19.883359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.883342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.887361 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.887230 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 13:02:19.887361 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.887252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 13:02:19.887361 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.887348 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 13:02:19.888311 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.887911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w77rr\"" Jun 10 13:02:19.890444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.890423 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92"] Jun 10 13:02:19.922815 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.922780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:19.989478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5a3702-157a-410c-b600-13b6a684a137-metrics-client-ca\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-sys\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klljg\" (UniqueName: \"kubernetes.io/projected/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-api-access-klljg\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-wtmp\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-tls\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-root\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-textfile\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.989748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f8cae9f-bfcd-4344-a947-42192b937c27-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:19.990132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:19.990132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtr5\" (UniqueName: \"kubernetes.io/projected/2f5a3702-157a-410c-b600-13b6a684a137-kube-api-access-mgtr5\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.990132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989899 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-accelerators-collector-config\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:19.990132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f8cae9f-bfcd-4344-a947-42192b937c27-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:19.990132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:19.989951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.055619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.055576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.071452 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.071423 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d94f9946-7nrvj"] Jun 10 13:02:20.091073 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klljg\" (UniqueName: \"kubernetes.io/projected/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-api-access-klljg\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.091255 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.091321 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-wtmp\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091321 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-tls\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091321 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-root\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091482 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-textfile\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091482 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f8cae9f-bfcd-4344-a947-42192b937c27-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.091482 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.091482 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtr5\" (UniqueName: \"kubernetes.io/projected/2f5a3702-157a-410c-b600-13b6a684a137-kube-api-access-mgtr5\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091482 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091423 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-wtmp\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091482 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-accelerators-collector-config\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f8cae9f-bfcd-4344-a947-42192b937c27-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.091807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091488 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-root\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.091807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5a3702-157a-410c-b600-13b6a684a137-metrics-client-ca\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-sys\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.091807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.091672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.092113 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f5a3702-157a-410c-b600-13b6a684a137-sys\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.092611 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092196 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f8cae9f-bfcd-4344-a947-42192b937c27-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.092611 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092348 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f5a3702-157a-410c-b600-13b6a684a137-metrics-client-ca\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.092611 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:02:20.092455 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 13:02:20.092611 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:02:20.092526 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-tls podName:1f8cae9f-bfcd-4344-a947-42192b937c27 nodeName:}" failed. No retries permitted until 2026-06-10 13:02:20.592492919 +0000 UTC m=+75.783931120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-d5w92" (UID: "1f8cae9f-bfcd-4344-a947-42192b937c27") : secret "kube-state-metrics-tls" not found Jun 10 13:02:20.092611 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f8cae9f-bfcd-4344-a947-42192b937c27-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.092922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-textfile\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.092922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092744 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.092922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.092906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-accelerators-collector-config\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.093885 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.093863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.094047 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.094029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-tls\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.094616 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.094599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f5a3702-157a-410c-b600-13b6a684a137-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.103314 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.103287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtr5\" (UniqueName: \"kubernetes.io/projected/2f5a3702-157a-410c-b600-13b6a684a137-kube-api-access-mgtr5\") pod \"node-exporter-2d4xw\" (UID: \"2f5a3702-157a-410c-b600-13b6a684a137\") " pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.104120 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.104098 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klljg\" (UniqueName: \"kubernetes.io/projected/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-api-access-klljg\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.154345 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.154192 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.199579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.199544 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2d4xw" Jun 10 13:02:20.210156 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:20.210127 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5a3702_157a_410c_b600_13b6a684a137.slice/crio-4ef7d1441f34dfaab88d711156cc23d279d277812d2a909f22ea3c8fa5afddb3 WatchSource:0}: Error finding container 4ef7d1441f34dfaab88d711156cc23d279d277812d2a909f22ea3c8fa5afddb3: Status 404 returned error can't find the container with id 4ef7d1441f34dfaab88d711156cc23d279d277812d2a909f22ea3c8fa5afddb3 Jun 10 13:02:20.253723 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.253673 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.351339 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.351304 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.452198 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.452147 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.556405 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.556366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.595490 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.595455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.597764 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.597746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f8cae9f-bfcd-4344-a947-42192b937c27-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-d5w92\" (UID: \"1f8cae9f-bfcd-4344-a947-42192b937c27\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.614016 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.613977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2d4xw" event={"ID":"2f5a3702-157a-410c-b600-13b6a684a137","Type":"ContainerStarted","Data":"4ef7d1441f34dfaab88d711156cc23d279d277812d2a909f22ea3c8fa5afddb3"} Jun 10 13:02:20.791960 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.791873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" Jun 10 13:02:20.857913 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.857876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.941963 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.941930 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92"] Jun 10 13:02:20.945109 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.945082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:20.959162 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.959130 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 13:02:20.962669 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.962647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:20.965290 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965154 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 13:02:20.965290 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 13:02:20.965290 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965200 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 13:02:20.965290 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965206 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 13:02:20.965922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 13:02:20.965922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965804 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 13:02:20.965922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 13:02:20.965922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 13:02:20.965922 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.965806 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nh2r6\"" Jun 10 13:02:20.966224 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.966028 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 13:02:20.982239 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:20.979877 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 13:02:21.086020 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:21.085944 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8cae9f_bfcd_4344_a947_42192b937c27.slice/crio-c4b6e7299fb73455d3fb7d43e987dee1c7d8ed2a7068ae2e1cba9d018b0fded6 WatchSource:0}: Error finding container c4b6e7299fb73455d3fb7d43e987dee1c7d8ed2a7068ae2e1cba9d018b0fded6: Status 404 returned error can't find the container with id c4b6e7299fb73455d3fb7d43e987dee1c7d8ed2a7068ae2e1cba9d018b0fded6 Jun 10 13:02:21.099748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.099864 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d257b0b2-91c1-42ff-b3e9-e0675c7730da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.099864 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-config-volume\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.099864 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d257b0b2-91c1-42ff-b3e9-e0675c7730da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.099864 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-web-config\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ksfj\" (UniqueName: \"kubernetes.io/projected/d257b0b2-91c1-42ff-b3e9-e0675c7730da-kube-api-access-2ksfj\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.099988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.100014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d257b0b2-91c1-42ff-b3e9-e0675c7730da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.100038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d257b0b2-91c1-42ff-b3e9-e0675c7730da-config-out\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.100071 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d257b0b2-91c1-42ff-b3e9-e0675c7730da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100317 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.100112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100317 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.100138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.100317 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.100192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200647 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-config-volume\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d257b0b2-91c1-42ff-b3e9-e0675c7730da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-web-config\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ksfj\" (UniqueName: \"kubernetes.io/projected/d257b0b2-91c1-42ff-b3e9-e0675c7730da-kube-api-access-2ksfj\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d257b0b2-91c1-42ff-b3e9-e0675c7730da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.200820 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d257b0b2-91c1-42ff-b3e9-e0675c7730da-config-out\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201075 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d257b0b2-91c1-42ff-b3e9-e0675c7730da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201075 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201075 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201075 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201075 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.200972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201075 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.201001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d257b0b2-91c1-42ff-b3e9-e0675c7730da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201549 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.201481 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d257b0b2-91c1-42ff-b3e9-e0675c7730da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.201908 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:02:21.201885 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 13:02:21.201990 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:02:21.201971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-main-tls podName:d257b0b2-91c1-42ff-b3e9-e0675c7730da nodeName:}" failed. No retries permitted until 2026-06-10 13:02:21.701937883 +0000 UTC m=+76.893376075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d257b0b2-91c1-42ff-b3e9-e0675c7730da") : secret "alertmanager-main-tls" not found Jun 10 13:02:21.201990 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.201968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d257b0b2-91c1-42ff-b3e9-e0675c7730da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.202367 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.202341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d257b0b2-91c1-42ff-b3e9-e0675c7730da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.203560 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.203530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d257b0b2-91c1-42ff-b3e9-e0675c7730da-config-out\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.204304 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.204278 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-config-volume\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.204752 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.204708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d257b0b2-91c1-42ff-b3e9-e0675c7730da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.205352 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.205309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.205790 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.205761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.206350 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.206321 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-web-config\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.207319 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.207293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.207413 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.207352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.211299 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.211279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ksfj\" (UniqueName: \"kubernetes.io/projected/d257b0b2-91c1-42ff-b3e9-e0675c7730da-kube-api-access-2ksfj\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.380812 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.380650 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:21.618996 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.618962 2562 generic.go:356] "Generic (PLEG): container finished" podID="2f5a3702-157a-410c-b600-13b6a684a137" containerID="f914d6634fcd668cef4721ddfb200961789879cbeeb31c45afcf6fca8b2d02c3" exitCode=0 Jun 10 13:02:21.619189 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.619046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2d4xw" event={"ID":"2f5a3702-157a-410c-b600-13b6a684a137","Type":"ContainerDied","Data":"f914d6634fcd668cef4721ddfb200961789879cbeeb31c45afcf6fca8b2d02c3"} Jun 10 13:02:21.620417 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.620358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" event={"ID":"1f8cae9f-bfcd-4344-a947-42192b937c27","Type":"ContainerStarted","Data":"c4b6e7299fb73455d3fb7d43e987dee1c7d8ed2a7068ae2e1cba9d018b0fded6"} Jun 10 13:02:21.620417 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.620401 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:21.705322 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.705296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.707555 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.707534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d257b0b2-91c1-42ff-b3e9-e0675c7730da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d257b0b2-91c1-42ff-b3e9-e0675c7730da\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.725063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.725034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:21.874741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.874705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 13:02:21.956843 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.956808 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7767868645-r8bv7"] Jun 10 13:02:21.960340 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.960317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:21.963074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.963047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 13:02:21.963258 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.963196 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 13:02:21.963258 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.963218 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 13:02:21.963258 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.963235 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f92lj\"" Jun 10 13:02:21.963591 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.963570 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-485kka99ufmup\"" Jun 10 13:02:21.963691 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.963570 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 13:02:21.964259 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.964242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 13:02:21.975649 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:21.975612 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7767868645-r8bv7"] Jun 10 13:02:22.008827 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.008794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf476013-ecb6-430d-99bc-c530390e8cbc-metrics-client-ca\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.008827 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.008828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh287\" (UniqueName: \"kubernetes.io/projected/bf476013-ecb6-430d-99bc-c530390e8cbc-kube-api-access-vh287\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.009079 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.008851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-tls\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.009079 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.008869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.009079 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.008892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.009079 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.008970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.009079 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.009060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.009259 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.009089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-grpc-tls\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.074669 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.074605 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 13:02:22.076782 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:22.076755 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd257b0b2_91c1_42ff_b3e9_e0675c7730da.slice/crio-df39eeffb8a12509277e0260315e1d6afc7bdeaf71c59833a3499ff0e7eba31b WatchSource:0}: Error finding container df39eeffb8a12509277e0260315e1d6afc7bdeaf71c59833a3499ff0e7eba31b: Status 404 returned error can't find the container with id df39eeffb8a12509277e0260315e1d6afc7bdeaf71c59833a3499ff0e7eba31b Jun 10 13:02:22.110293 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110293 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-grpc-tls\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110319 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf476013-ecb6-430d-99bc-c530390e8cbc-metrics-client-ca\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh287\" (UniqueName: \"kubernetes.io/projected/bf476013-ecb6-430d-99bc-c530390e8cbc-kube-api-access-vh287\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-tls\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.110579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.110508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.111425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.111363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf476013-ecb6-430d-99bc-c530390e8cbc-metrics-client-ca\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.113340 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.113314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-tls\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.113430 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.113336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-grpc-tls\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.113430 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.113346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.113713 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.113698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.113907 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.113887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.113944 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.113886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf476013-ecb6-430d-99bc-c530390e8cbc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.118739 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.118724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh287\" (UniqueName: \"kubernetes.io/projected/bf476013-ecb6-430d-99bc-c530390e8cbc-kube-api-access-vh287\") pod \"thanos-querier-7767868645-r8bv7\" (UID: \"bf476013-ecb6-430d-99bc-c530390e8cbc\") " pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.271034 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.270947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:22.406286 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.406246 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7767868645-r8bv7"] Jun 10 13:02:22.408759 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:22.408733 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf476013_ecb6_430d_99bc_c530390e8cbc.slice/crio-827ce529f47f4cf5758d87121f8d6a89a70e2a99e36b3ca585bc6ae87a93ae7b WatchSource:0}: Error finding container 827ce529f47f4cf5758d87121f8d6a89a70e2a99e36b3ca585bc6ae87a93ae7b: Status 404 returned error can't find the container with id 827ce529f47f4cf5758d87121f8d6a89a70e2a99e36b3ca585bc6ae87a93ae7b Jun 10 13:02:22.625208 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.625126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"827ce529f47f4cf5758d87121f8d6a89a70e2a99e36b3ca585bc6ae87a93ae7b"} Jun 10 13:02:22.627261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.627228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2d4xw" event={"ID":"2f5a3702-157a-410c-b600-13b6a684a137","Type":"ContainerStarted","Data":"bbd01d94664f564e50c15be14a0b725215e76a24fd905104241765cd98c1686d"} Jun 10 13:02:22.627390 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.627272 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2d4xw" event={"ID":"2f5a3702-157a-410c-b600-13b6a684a137","Type":"ContainerStarted","Data":"6938a23ed5ace614348dbb83b5df2a7233be4db6ec73015dfc69b1a00bd958e2"} Jun 10 13:02:22.628412 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.628392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"df39eeffb8a12509277e0260315e1d6afc7bdeaf71c59833a3499ff0e7eba31b"} Jun 10 13:02:22.659047 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.658994 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2d4xw" podStartSLOduration=2.695784745 podStartE2EDuration="3.65897945s" totalImagesPullingTime="897.01826ms" totalInitContainerRuntime="66.176445ms" isStatefulPod=true podCreationTimestamp="2026-06-10 13:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:22.658563046 +0000 UTC m=+77.850001261" watchObservedRunningTime="2026-06-10 13:02:22.65897945 +0000 UTC m=+77.850417664" Jun 10 13:02:22.817985 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.817878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:22.890876 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.890788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:22.951830 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:22.951791 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:23.209105 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:23.209068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:23.311491 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:23.311440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:23.372664 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:23.372629 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:23.635749 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:23.635717 2562 generic.go:356] "Generic (PLEG): container finished" podID="d257b0b2-91c1-42ff-b3e9-e0675c7730da" containerID="2ecad3fd1d2e0bbbbe4d6f0c207a0d9d2cff53791797b990216c6c55ee78f5cf" exitCode=0 Jun 10 13:02:23.635913 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:23.635797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerDied","Data":"2ecad3fd1d2e0bbbbe4d6f0c207a0d9d2cff53791797b990216c6c55ee78f5cf"} Jun 10 13:02:23.637718 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:23.637684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" event={"ID":"1f8cae9f-bfcd-4344-a947-42192b937c27","Type":"ContainerStarted","Data":"137fb85da9acbed68cc4de282f9f6ead5825767d9515b2b2d9100a19ec11dc09"} Jun 10 13:02:24.221031 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.220999 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5966647c74-4z5nb"] Jun 10 13:02:24.223789 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.223766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.227425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.227227 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9qatsaqd0aj6n\"" Jun 10 13:02:24.227425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.227237 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 13:02:24.227425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.227251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 13:02:24.227425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.227274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 13:02:24.227425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.227257 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6kqf8\"" Jun 10 13:02:24.227425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.227354 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 13:02:24.235496 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.235472 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5966647c74-4z5nb"] Jun 10 13:02:24.334021 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.333992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-client-ca-bundle\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.334130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.334033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vbss\" (UniqueName: \"kubernetes.io/projected/5f4268a2-d176-45ae-b733-bd20da9a395e-kube-api-access-8vbss\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.334130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.334070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-secret-metrics-server-client-certs\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.334130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.334101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4268a2-d176-45ae-b733-bd20da9a395e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.334271 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.334133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4268a2-d176-45ae-b733-bd20da9a395e-metrics-server-audit-profiles\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.334271 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.334161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4268a2-d176-45ae-b733-bd20da9a395e-audit-log\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.334339 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.334269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-secret-metrics-server-tls\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435085 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-secret-metrics-server-tls\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435205 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-client-ca-bundle\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435205 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vbss\" (UniqueName: \"kubernetes.io/projected/5f4268a2-d176-45ae-b733-bd20da9a395e-kube-api-access-8vbss\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435205 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-secret-metrics-server-client-certs\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4268a2-d176-45ae-b733-bd20da9a395e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4268a2-d176-45ae-b733-bd20da9a395e-metrics-server-audit-profiles\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4268a2-d176-45ae-b733-bd20da9a395e-audit-log\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435712 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f4268a2-d176-45ae-b733-bd20da9a395e-audit-log\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.435912 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.435891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f4268a2-d176-45ae-b733-bd20da9a395e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.436355 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.436331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f4268a2-d176-45ae-b733-bd20da9a395e-metrics-server-audit-profiles\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.437662 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.437619 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-secret-metrics-server-client-certs\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.437931 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.437910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-secret-metrics-server-tls\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.437997 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.437966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f4268a2-d176-45ae-b733-bd20da9a395e-client-ca-bundle\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.443436 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.443413 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vbss\" (UniqueName: \"kubernetes.io/projected/5f4268a2-d176-45ae-b733-bd20da9a395e-kube-api-access-8vbss\") pod \"metrics-server-5966647c74-4z5nb\" (UID: \"5f4268a2-d176-45ae-b733-bd20da9a395e\") " pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.535038 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.535009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:24.643612 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.643485 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:24.647747 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.647637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" event={"ID":"1f8cae9f-bfcd-4344-a947-42192b937c27","Type":"ContainerStarted","Data":"6df6b45c1385e32c174e801ef2839dafb3d76784540352a110e595df5d4f57bf"} Jun 10 13:02:24.647747 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.647708 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" event={"ID":"1f8cae9f-bfcd-4344-a947-42192b937c27","Type":"ContainerStarted","Data":"19f21833a7bb2139d38e7ba5b7366e5460f5f6b30d44b57b94af9518ec1591d0"} Jun 10 13:02:24.650825 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.650734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"d6f414b46a02b7104a69101390fd1be81908ed15013eae1fbcd598cf75c338d8"} Jun 10 13:02:24.650825 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.650811 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"3e6ddd010ba247b0439e8ed813cebf08ebd59366d3d30b5add3059ec70c7fca6"} Jun 10 13:02:24.651019 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.650852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"7e413c50e1e41a29dcd449311d06c58a6e64101a6171272d900bc9ed3b9d8b7a"} Jun 10 13:02:24.675142 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.675082 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-d5w92" podStartSLOduration=3.29143138 podStartE2EDuration="5.675061161s" totalImagesPullingTime="2.383629781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:24.67458658 +0000 UTC m=+79.866024795" watchObservedRunningTime="2026-06-10 13:02:24.675061161 +0000 UTC m=+79.866499378" Jun 10 13:02:24.696606 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.692676 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5966647c74-4z5nb"] Jun 10 13:02:24.737659 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:24.737584 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:25.050268 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:25.050233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:25.148698 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:25.148635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:25.380579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:25.380471 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:25.657586 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:25.657544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"0b7edbf1a985532d91f35fb8adabd9dade49537f7f0356ce568e544ed414441b"} Jun 10 13:02:25.658978 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:25.658955 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" event={"ID":"5f4268a2-d176-45ae-b733-bd20da9a395e","Type":"ContainerStarted","Data":"bf75d879ddc15748f9d9dcc6af135109014a19a2aa9bf37227905122f00863eb"} Jun 10 13:02:26.138401 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.138369 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:02:26.141002 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.140971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.143749 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.143623 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 13:02:26.143749 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.143716 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 13:02:26.143919 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.143796 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 13:02:26.143980 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.143969 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 13:02:26.144338 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.144036 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 13:02:26.144338 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.144172 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:26.144564 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.144493 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 13:02:26.144871 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.144848 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 13:02:26.144968 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.144883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 13:02:26.145076 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.145037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9jqmw\"" Jun 10 13:02:26.145388 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.145372 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 13:02:26.145660 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.145622 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 13:02:26.145808 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.145790 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 13:02:26.145879 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.145861 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 13:02:26.147506 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.147474 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 13:02:26.147777 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.147759 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fhfhnis72pgh3\"" Jun 10 13:02:26.151659 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.151640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 13:02:26.168431 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.166042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:02:26.250035 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250154 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250154 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-config\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250154 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250154 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-config-out\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250358 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250358 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250358 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250358 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.250619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-web-config\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.251002 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.251002 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.251002 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvccg\" (UniqueName: \"kubernetes.io/projected/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-kube-api-access-kvccg\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.251002 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.250770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351606 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351691 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351691 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-web-config\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351691 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351819 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351819 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvccg\" (UniqueName: \"kubernetes.io/projected/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-kube-api-access-kvccg\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351819 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351962 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.351962 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352060 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-config\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352060 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.351995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352060 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-config-out\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352500 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352500 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352500 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.352672 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.352634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.353131 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.353107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.354269 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.353974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.355365 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.354893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.355365 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.354911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.355365 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.355024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.355365 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.355144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.355598 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.355580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.357051 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.356159 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-config\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.357051 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.356550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.357051 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.356884 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-web-config\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.357051 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.356922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.357051 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.357025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-config-out\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.357966 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.357896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.358961 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.358587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.359156 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.359136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.359321 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.359301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.360159 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.360131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.370096 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.370074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvccg\" (UniqueName: \"kubernetes.io/projected/40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f-kube-api-access-kvccg\") pod \"prometheus-k8s-0\" (UID: \"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.453829 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.453735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:26.594904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.594810 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:02:26.598407 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:02:26.598383 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ee1c3c_d46b_4f85_87ca_eabaf0dfc81f.slice/crio-67188da253cea66c172682723a502d34bb0b6ff0ee80a3cfdc64418b945f4bb0 WatchSource:0}: Error finding container 67188da253cea66c172682723a502d34bb0b6ff0ee80a3cfdc64418b945f4bb0: Status 404 returned error can't find the container with id 67188da253cea66c172682723a502d34bb0b6ff0ee80a3cfdc64418b945f4bb0 Jun 10 13:02:26.667994 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.667958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"281bda2f3065ba6283ec328802468323caacec70a12d5c56c928ce7069dff63e"} Jun 10 13:02:26.668092 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.668030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"40a2469b29d32cf77fb1f63fc8eafa4e38ae43a5df1b128bb713619d190c468c"} Jun 10 13:02:26.668092 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.668071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"0ab0819b7768419e2dbc3ac36a302f9080cd42191eab15aecd6d9f3a88f4f834"} Jun 10 13:02:26.668392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.668115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"7e4759c37a7627759b83c0698b1184971d1f254f7cae39060bcd8edc945545f1"} Jun 10 13:02:26.668392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.668158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d257b0b2-91c1-42ff-b3e9-e0675c7730da","Type":"ContainerStarted","Data":"043a0299a83b8e116915cc95a608f9b292971a3a427af8f5fe654c97d4cf4e59"} Jun 10 13:02:26.672746 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.672633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"ea60375eea63f1698dc5f1bb44b84eabefe6774b76e0bb5afff57511f6dbd4e2"} Jun 10 13:02:26.672746 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.672719 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:26.672961 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.672763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"20c3e908b2bac65f50648318d0e5a37ff0394bb498932b64488e3e6fcd05f9a7"} Jun 10 13:02:26.672961 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.672807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" event={"ID":"bf476013-ecb6-430d-99bc-c530390e8cbc","Type":"ContainerStarted","Data":"56b735286dc3c0a4d3a1c60dc37cd14be55101d82e2a8fa216edfc2d40c17388"} Jun 10 13:02:26.674664 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.674636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"67188da253cea66c172682723a502d34bb0b6ff0ee80a3cfdc64418b945f4bb0"} Jun 10 13:02:26.676508 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.676485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" event={"ID":"5f4268a2-d176-45ae-b733-bd20da9a395e","Type":"ContainerStarted","Data":"d8de7cc223a7c14eadcd236074ad8455b99f9a851007246ff57224ef89af9ac6"} Jun 10 13:02:26.703969 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.703895 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.408039595 podStartE2EDuration="6.703873332s" totalImagesPullingTime="3.27372304s" totalInitContainerRuntime="22.110697ms" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:26.70177882 +0000 UTC m=+81.893217061" watchObservedRunningTime="2026-06-10 13:02:26.703873332 +0000 UTC m=+81.895311547" Jun 10 13:02:26.734192 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.734112 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" podStartSLOduration=2.083519064 podStartE2EDuration="5.734089041s" totalImagesPullingTime="3.650569977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:26.732303973 +0000 UTC m=+81.923742186" watchObservedRunningTime="2026-06-10 13:02:26.734089041 +0000 UTC m=+81.925527256" Jun 10 13:02:26.759139 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:26.759078 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" podStartSLOduration=1.213784942 podStartE2EDuration="2.759058742s" totalImagesPullingTime="1.5452738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:26.756860985 +0000 UTC m=+81.948305036" watchObservedRunningTime="2026-06-10 13:02:26.759058742 +0000 UTC m=+81.950496956" Jun 10 13:02:27.239357 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:27.239323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:27.339080 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:27.339034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:27.681945 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:27.681916 2562 generic.go:356] "Generic (PLEG): container finished" podID="40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f" containerID="4f77733713ad76c36801530e6ab457825de80039e63837009ab95aa56f20bc7a" exitCode=0 Jun 10 13:02:27.682298 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:27.682009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerDied","Data":"4f77733713ad76c36801530e6ab457825de80039e63837009ab95aa56f20bc7a"} Jun 10 13:02:27.740429 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:27.740403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:27.843239 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:27.843209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:28.222726 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:28.222692 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:28.284435 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:28.284407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:30.130179 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:30.130138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:30.231664 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:30.231626 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:30.330950 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:30.330907 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:31.704240 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.704206 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"f400825a3c45c84365ebae1ad5b6c27849788dbb7d459206396e35d48fba7488"} Jun 10 13:02:31.704717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.704281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"02e210aee522ae57d47a9ed3b2984f7c923de8f4e0afa7100ba98ef05f2dc39c"} Jun 10 13:02:31.704717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.704321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"93817da55fb3bb035c541b1145584c464ceb28a57c6ae57e4d61fb0c4954a434"} Jun 10 13:02:31.704717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.704364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"b2eca34ce38591539bda05575a93e145e702153654f1e50267c0b430220da483"} Jun 10 13:02:31.704717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.704403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"9206442d1cf6fd7e8748d2d283e4a629770ea5c067725ea39ec886d0089edb9b"} Jun 10 13:02:31.704717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.704440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f","Type":"ContainerStarted","Data":"9ab97e14dceee14211f38c8f0109df357a5647b0d74476b2498552b824a26911"} Jun 10 13:02:31.736090 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:31.736035 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.603057359 podStartE2EDuration="5.736015615s" totalImagesPullingTime="3.107531151s" totalInitContainerRuntime="25.427105ms" isStatefulPod=false podCreationTimestamp="2026-06-10 13:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:02:31.734457738 +0000 UTC m=+86.925895985" watchObservedRunningTime="2026-06-10 13:02:31.736015615 +0000 UTC m=+86.927453831" Jun 10 13:02:32.689536 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:32.689497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7767868645-r8bv7" Jun 10 13:02:35.284252 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:35.284213 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:35.384654 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:35.384616 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:35.439943 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:35.439905 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:36.453962 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:36.453927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:02:37.140050 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:37.140015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:37.206578 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:37.206545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:38.478132 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:38.478084 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:38.535804 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:38.535767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:44.535139 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:44.535104 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:44.535538 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:44.535183 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:02:45.091696 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.091627 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76d94f9946-7nrvj" podUID="ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" containerName="console" containerID="cri-o://a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f" gracePeriod=15 Jun 10 13:02:45.368903 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.368824 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:45.511399 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511368 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq2fs\" (UniqueName: \"kubernetes.io/projected/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-kube-api-access-pq2fs\") pod \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " Jun 10 13:02:45.511607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511405 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-oauth-serving-cert\") pod \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " Jun 10 13:02:45.511607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511429 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-service-ca\") pod \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " Jun 10 13:02:45.511607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511455 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-config\") pod \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " Jun 10 13:02:45.511607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511507 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-serving-cert\") pod \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " Jun 10 13:02:45.511607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511572 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-oauth-config\") pod \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\" (UID: \"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25\") " Jun 10 13:02:45.511863 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511816 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-service-ca" (OuterVolumeSpecName: "service-ca") pod "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" (UID: "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:02:45.511955 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.511909 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-config" (OuterVolumeSpecName: "console-config") pod "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" (UID: "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:02:45.512020 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.512003 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" (UID: "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:02:45.513846 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.513815 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-kube-api-access-pq2fs" (OuterVolumeSpecName: "kube-api-access-pq2fs") pod "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" (UID: "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25"). InnerVolumeSpecName "kube-api-access-pq2fs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:02:45.513846 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.513829 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" (UID: "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:02:45.514001 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.513880 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" (UID: "ee2a8e4a-bac3-4474-bc84-6c5c0af99a25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:02:45.612363 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.612330 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-config\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:02:45.612363 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.612357 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-serving-cert\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:02:45.612363 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.612368 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-console-oauth-config\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:02:45.612774 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.612376 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq2fs\" (UniqueName: \"kubernetes.io/projected/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-kube-api-access-pq2fs\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:02:45.612774 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.612385 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-oauth-serving-cert\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:02:45.612774 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.612393 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25-service-ca\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:02:45.765324 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.765289 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" containerID="a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f" exitCode=0 Jun 10 13:02:45.765492 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.765337 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76d94f9946-7nrvj" Jun 10 13:02:45.765492 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.765382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d94f9946-7nrvj" event={"ID":"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25","Type":"ContainerDied","Data":"a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f"} Jun 10 13:02:45.765492 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.765442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76d94f9946-7nrvj" event={"ID":"ee2a8e4a-bac3-4474-bc84-6c5c0af99a25","Type":"ContainerDied","Data":"5fddee4f9dcf0850761d399a3e292acadf96eeebfa975c70e97472c47e9d119a"} Jun 10 13:02:45.765492 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.765484 2562 scope.go:117] "RemoveContainer" containerID="a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f" Jun 10 13:02:45.776125 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.776105 2562 scope.go:117] "RemoveContainer" containerID="a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f" Jun 10 13:02:45.776401 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:02:45.776382 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f\": container with ID starting with a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f not found: ID does not exist" containerID="a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f" Jun 10 13:02:45.776447 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.776411 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f"} err="failed to get container status \"a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f\": rpc error: code = NotFound desc = could not find container \"a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f\": container with ID starting with a852998e6e82553854dd643848b83e425e3614591dc7e99ca1fd87f059ea197f not found: ID does not exist" Jun 10 13:02:45.803410 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.803381 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76d94f9946-7nrvj"] Jun 10 13:02:45.814356 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:45.814329 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76d94f9946-7nrvj"] Jun 10 13:02:47.277898 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:47.277859 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" path="/var/lib/kubelet/pods/ee2a8e4a-bac3-4474-bc84-6c5c0af99a25/volumes" Jun 10 13:02:50.616856 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:50.616826 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mr4rw" Jun 10 13:02:53.494261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:53.494229 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:53.587988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:02:53.587958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:04.540971 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:04.540945 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:03:04.544921 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:04.544895 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5966647c74-4z5nb" Jun 10 13:03:07.176722 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:07.176674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:07.246142 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:07.246106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:26.454709 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:26.454671 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:03:26.474437 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:26.474405 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:03:26.935863 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:26.935838 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:03:39.104838 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:39.104796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:39.318731 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:39.318697 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:49.061662 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:49.061630 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:49.124976 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:49.124950 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:54.363121 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:54.363088 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:54.421904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:54.421873 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:57.528849 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:57.528755 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:57.600528 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:57.600485 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:58.127865 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:58.127835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:58.201034 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:03:58.200995 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:05.752057 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:05.752022 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:06.192473 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:06.192426 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:06.259399 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:06.259365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:08.650660 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:08.650625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:08.759800 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:08.759768 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:08.861200 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:08.861169 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:23.492630 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:23.492585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:23.599564 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:23.599531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:31.114087 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:31.114047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:31.174734 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:31.174699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:51.593446 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:04:51.593412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:06.231185 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:06.231142 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:06.318759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:06.318720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:32.970304 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:32.970223 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:34.391474 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:34.391430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:36.638503 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:36.638462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:36.742203 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:36.742172 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:37.779449 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:37.779414 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:37.890424 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:37.890394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:38.015470 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:38.015442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:41.088593 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:41.088558 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:41.671369 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:41.671332 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:43.377053 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:43.377012 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:43.438261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:43.438230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:48.047815 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:48.047778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:48.111390 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:48.111356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:49.481557 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:49.481497 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:54.397275 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:54.397239 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:54.510003 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:05:54.509969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:01.303400 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:01.303371 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:02.469734 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:02.469703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:03.568810 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:03.568775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:05.235073 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:05.235047 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 13:06:15.020391 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.020339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:15.128849 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.128817 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:15.601698 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.601655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:15.743601 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.743566 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:15.853418 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.853318 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:15.992163 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.992134 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c"] Jun 10 13:06:15.992475 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.992461 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" containerName="console" Jun 10 13:06:15.992529 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.992477 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" containerName="console" Jun 10 13:06:15.992579 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.992570 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee2a8e4a-bac3-4474-bc84-6c5c0af99a25" containerName="console" Jun 10 13:06:15.994444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:15.994430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.000036 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.000014 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 13:06:16.000036 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.000038 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 13:06:16.000036 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.000047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 13:06:16.000280 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.000053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 13:06:16.000478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.000462 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vjxjr\"" Jun 10 13:06:16.025207 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.025180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c"] Jun 10 13:06:16.091440 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.091402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.091646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.091452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25bbl\" (UniqueName: \"kubernetes.io/projected/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-kube-api-access-25bbl\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.091646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.091572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-manifests\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.091646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.091615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.091765 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.091664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-tmp\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.112731 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.112657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:16.192709 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.192682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25bbl\" (UniqueName: \"kubernetes.io/projected/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-kube-api-access-25bbl\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.192825 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.192728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-manifests\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.192825 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.192770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.192825 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.192788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-tmp\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.192968 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.192826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.193197 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.193178 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-manifests\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.195146 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.195122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-tmp\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.195255 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.195225 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.195399 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.195380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.201964 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.201941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25bbl\" (UniqueName: \"kubernetes.io/projected/dca72a6a-2488-4c0d-8e23-27f5d0ee334d-kube-api-access-25bbl\") pod \"opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c\" (UID: \"dca72a6a-2488-4c0d-8e23-27f5d0ee334d\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.213677 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.213647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:16.304189 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.304168 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:16.318717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.318686 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:16.397924 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.397842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:16.441279 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.441256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c"] Jun 10 13:06:16.443070 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:06:16.443043 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca72a6a_2488_4c0d_8e23_27f5d0ee334d.slice/crio-1a5164915baca8b27ce046a5e6f7e0226f704a26679aecdcea12c8c73615c2f5 WatchSource:0}: Error finding container 1a5164915baca8b27ce046a5e6f7e0226f704a26679aecdcea12c8c73615c2f5: Status 404 returned error can't find the container with id 1a5164915baca8b27ce046a5e6f7e0226f704a26679aecdcea12c8c73615c2f5 Jun 10 13:06:16.444890 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.444870 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:06:16.473415 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.473389 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:16.550024 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.549995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" event={"ID":"dca72a6a-2488-4c0d-8e23-27f5d0ee334d","Type":"ContainerStarted","Data":"1a5164915baca8b27ce046a5e6f7e0226f704a26679aecdcea12c8c73615c2f5"} Jun 10 13:06:16.573761 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.573734 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:16.674276 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:16.674253 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:20.577629 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:20.577588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" event={"ID":"dca72a6a-2488-4c0d-8e23-27f5d0ee334d","Type":"ContainerStarted","Data":"79793e1139d74ca508975752f78a2d9a96a15b247b6e955c652da5962db4e66a"} Jun 10 13:06:21.583027 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:21.582990 2562 generic.go:356] "Generic (PLEG): container finished" podID="dca72a6a-2488-4c0d-8e23-27f5d0ee334d" containerID="79793e1139d74ca508975752f78a2d9a96a15b247b6e955c652da5962db4e66a" exitCode=0 Jun 10 13:06:21.583413 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:21.583031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" event={"ID":"dca72a6a-2488-4c0d-8e23-27f5d0ee334d","Type":"ContainerDied","Data":"79793e1139d74ca508975752f78a2d9a96a15b247b6e955c652da5962db4e66a"} Jun 10 13:06:22.589350 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:22.589316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" event={"ID":"dca72a6a-2488-4c0d-8e23-27f5d0ee334d","Type":"ContainerStarted","Data":"a50e743cd57fcb4dfd5af8efb6fd7c6d6531bd9c541727be8c5ae57a55711cf9"} Jun 10 13:06:22.589834 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:22.589432 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:22.614815 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:22.614767 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" podStartSLOduration=3.157320354 podStartE2EDuration="7.614754476s" totalImagesPullingTime="3.422735557s" totalInitContainerRuntime="1.034698565s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:22.61369274 +0000 UTC m=+317.805130949" watchObservedRunningTime="2026-06-10 13:06:22.614754476 +0000 UTC m=+317.806192690" Jun 10 13:06:30.552766 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:30.552725 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:30.672738 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:30.672702 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:30.776563 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:30.776503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:33.595383 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:33.595354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c" Jun 10 13:06:35.963600 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:35.963568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:36.263536 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:36.263409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:36.832531 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:36.832478 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:37.208388 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.208345 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q"] Jun 10 13:06:37.217610 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.217588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.251638 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.251606 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:06:37.251768 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.251678 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 13:06:37.262327 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.262308 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 13:06:37.265664 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.265646 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 13:06:37.265891 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.265877 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 13:06:37.266713 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.266698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h2blq\"" Jun 10 13:06:37.273549 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.273527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/824e982c-4a69-4328-90f9-0679d2bc9b5a-cert\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.273620 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.273605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/824e982c-4a69-4328-90f9-0679d2bc9b5a-manager-config\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.273661 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.273631 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hss4\" (UniqueName: \"kubernetes.io/projected/824e982c-4a69-4328-90f9-0679d2bc9b5a-kube-api-access-6hss4\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.273711 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.273698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/824e982c-4a69-4328-90f9-0679d2bc9b5a-metrics-cert\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.340633 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.340603 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q"] Jun 10 13:06:37.374301 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.374273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/824e982c-4a69-4328-90f9-0679d2bc9b5a-cert\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.374486 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.374313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/824e982c-4a69-4328-90f9-0679d2bc9b5a-manager-config\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.374486 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.374332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hss4\" (UniqueName: \"kubernetes.io/projected/824e982c-4a69-4328-90f9-0679d2bc9b5a-kube-api-access-6hss4\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.374486 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.374366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/824e982c-4a69-4328-90f9-0679d2bc9b5a-metrics-cert\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.374970 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.374942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/824e982c-4a69-4328-90f9-0679d2bc9b5a-manager-config\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.376806 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.376785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/824e982c-4a69-4328-90f9-0679d2bc9b5a-cert\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.376893 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.376832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/824e982c-4a69-4328-90f9-0679d2bc9b5a-metrics-cert\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.458135 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.458110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hss4\" (UniqueName: \"kubernetes.io/projected/824e982c-4a69-4328-90f9-0679d2bc9b5a-kube-api-access-6hss4\") pod \"lws-controller-manager-78489dbf64-cgb4q\" (UID: \"824e982c-4a69-4328-90f9-0679d2bc9b5a\") " pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.526358 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.526286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:37.721260 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:37.721219 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q"] Jun 10 13:06:37.724973 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:06:37.724948 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824e982c_4a69_4328_90f9_0679d2bc9b5a.slice/crio-2b2b24e05f910483ca3d2f505eff3701ebb81ede9d3c1de431c99b571c37f74d WatchSource:0}: Error finding container 2b2b24e05f910483ca3d2f505eff3701ebb81ede9d3c1de431c99b571c37f74d: Status 404 returned error can't find the container with id 2b2b24e05f910483ca3d2f505eff3701ebb81ede9d3c1de431c99b571c37f74d Jun 10 13:06:38.060932 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:38.060900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:38.255429 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:38.255394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:38.474580 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:38.474544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:38.652133 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:38.652102 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" event={"ID":"824e982c-4a69-4328-90f9-0679d2bc9b5a","Type":"ContainerStarted","Data":"2b2b24e05f910483ca3d2f505eff3701ebb81ede9d3c1de431c99b571c37f74d"} Jun 10 13:06:39.673528 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:39.673477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:39.973778 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:39.973695 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:40.662233 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:40.662204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" event={"ID":"824e982c-4a69-4328-90f9-0679d2bc9b5a","Type":"ContainerStarted","Data":"8cc5f6d553f07457f84483dc62e7ff337faad9dab7bc4c5cfa1af21c178e2e32"} Jun 10 13:06:40.662386 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:40.662295 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:40.732459 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:40.732404 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" podStartSLOduration=0.88326142 podStartE2EDuration="3.732387498s" totalImagesPullingTime="2.849126078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:40.730821792 +0000 UTC m=+335.922260007" watchObservedRunningTime="2026-06-10 13:06:40.732387498 +0000 UTC m=+335.923825712" Jun 10 13:06:43.591110 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:43.591077 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:43.718738 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:43.718655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:43.887305 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:43.887275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:48.543703 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:48.543655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:48.688648 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:48.688610 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:48.805991 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:48.805906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:48.916880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:48.916835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:50.044000 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:50.043965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:50.301129 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:50.301043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:50.577620 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:50.577540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:50.728595 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:50.728556 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:51.668697 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:51.668669 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78489dbf64-cgb4q" Jun 10 13:06:53.170627 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:53.170589 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:53.302655 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:53.302619 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:56.099744 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:56.099660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:56.192936 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:56.192908 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:56.869452 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:56.869410 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:57.020594 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:57.020560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:58.238635 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:58.238603 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:58.407802 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:58.407769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:58.966841 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:58.966800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:59.433134 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:59.433097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:59.605979 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:06:59.605942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:00.502468 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.502433 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f476bfb57-25dkt"] Jun 10 13:07:00.504766 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.504749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.511606 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.511270 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 13:07:00.511788 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.511771 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mt96n\"" Jun 10 13:07:00.525982 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.525954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f476bfb57-25dkt"] Jun 10 13:07:00.531115 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.531091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:00.580295 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.580268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7726e73b-7d18-49b3-a869-2e8a90aac508-redirect-config\") pod \"dashboard-redirect-f476bfb57-25dkt\" (UID: \"7726e73b-7d18-49b3-a869-2e8a90aac508\") " pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.580463 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.580310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwfm\" (UniqueName: \"kubernetes.io/projected/7726e73b-7d18-49b3-a869-2e8a90aac508-kube-api-access-sxwfm\") pod \"dashboard-redirect-f476bfb57-25dkt\" (UID: \"7726e73b-7d18-49b3-a869-2e8a90aac508\") " pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.681869 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.681832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7726e73b-7d18-49b3-a869-2e8a90aac508-redirect-config\") pod \"dashboard-redirect-f476bfb57-25dkt\" (UID: \"7726e73b-7d18-49b3-a869-2e8a90aac508\") " pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.682041 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.681874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwfm\" (UniqueName: \"kubernetes.io/projected/7726e73b-7d18-49b3-a869-2e8a90aac508-kube-api-access-sxwfm\") pod \"dashboard-redirect-f476bfb57-25dkt\" (UID: \"7726e73b-7d18-49b3-a869-2e8a90aac508\") " pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.682555 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.682533 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7726e73b-7d18-49b3-a869-2e8a90aac508-redirect-config\") pod \"dashboard-redirect-f476bfb57-25dkt\" (UID: \"7726e73b-7d18-49b3-a869-2e8a90aac508\") " pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.691906 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.691885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwfm\" (UniqueName: \"kubernetes.io/projected/7726e73b-7d18-49b3-a869-2e8a90aac508-kube-api-access-sxwfm\") pod \"dashboard-redirect-f476bfb57-25dkt\" (UID: \"7726e73b-7d18-49b3-a869-2e8a90aac508\") " pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.815532 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.815425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" Jun 10 13:07:00.940435 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:00.940404 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f476bfb57-25dkt"] Jun 10 13:07:00.943307 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:07:00.943286 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7726e73b_7d18_49b3_a869_2e8a90aac508.slice/crio-f00f7070c75e00e432a70c74c57235045fa2b4d8c47f00d4a8653d3716dc79ba WatchSource:0}: Error finding container f00f7070c75e00e432a70c74c57235045fa2b4d8c47f00d4a8653d3716dc79ba: Status 404 returned error can't find the container with id f00f7070c75e00e432a70c74c57235045fa2b4d8c47f00d4a8653d3716dc79ba Jun 10 13:07:01.750095 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:01.750059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" event={"ID":"7726e73b-7d18-49b3-a869-2e8a90aac508","Type":"ContainerStarted","Data":"f00f7070c75e00e432a70c74c57235045fa2b4d8c47f00d4a8653d3716dc79ba"} Jun 10 13:07:06.775695 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:06.775663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" event={"ID":"7726e73b-7d18-49b3-a869-2e8a90aac508","Type":"ContainerStarted","Data":"69ada23fcb37898c1e9f6ae49e8ecd4414954e66462b3c650903aa937b26309c"} Jun 10 13:07:06.795178 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:06.795134 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f476bfb57-25dkt" podStartSLOduration=1.532493964 podStartE2EDuration="6.795118794s" totalImagesPullingTime="5.26262483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:06.794449977 +0000 UTC m=+361.985888193" watchObservedRunningTime="2026-06-10 13:07:06.795118794 +0000 UTC m=+361.986557008" Jun 10 13:07:08.488201 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:08.488165 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:08.564590 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:08.564557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:09.343503 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:09.343469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:09.445433 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:09.445396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:12.050531 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:12.050489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:12.135188 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:12.135138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:12.781379 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:12.781341 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:16.223940 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.223893 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:16.380832 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.380800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:16.695688 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.695656 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv"] Jun 10 13:07:16.703597 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.703576 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.706203 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.706175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wkxzd\"" Jun 10 13:07:16.706334 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.706203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 13:07:16.706441 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.706429 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 13:07:16.706722 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.706704 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 13:07:16.717623 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k4vf\" (UniqueName: \"kubernetes.io/projected/5218ddd4-1081-4207-a1f5-2026ebe27808-kube-api-access-9k4vf\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717725 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717843 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717843 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717843 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717987 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717987 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.717987 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.717978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5218ddd4-1081-4207-a1f5-2026ebe27808-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.730123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.730102 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv"] Jun 10 13:07:16.733978 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.733950 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:16.818673 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.818644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.818673 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.818674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.818927 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.818694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.818927 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.818717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.818927 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.818862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5218ddd4-1081-4207-a1f5-2026ebe27808-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819083 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.818954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k4vf\" (UniqueName: \"kubernetes.io/projected/5218ddd4-1081-4207-a1f5-2026ebe27808-kube-api-access-9k4vf\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819083 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819456 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819540 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.819607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.819586 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5218ddd4-1081-4207-a1f5-2026ebe27808-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.821049 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.821017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.821318 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.821298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.831379 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.831357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5218ddd4-1081-4207-a1f5-2026ebe27808-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.831477 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.831438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k4vf\" (UniqueName: \"kubernetes.io/projected/5218ddd4-1081-4207-a1f5-2026ebe27808-kube-api-access-9k4vf\") pod \"data-science-gateway-data-science-gateway-class-74759f97958x6tv\" (UID: \"5218ddd4-1081-4207-a1f5-2026ebe27808\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:16.996539 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:16.996433 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:17.015895 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:17.015875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:17.164721 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:17.164658 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv"] Jun 10 13:07:17.167455 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:07:17.167429 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5218ddd4_1081_4207_a1f5_2026ebe27808.slice/crio-55325d97dd1bf59d28ced9cea7aff32e90dd9daa25ffd00050e9ac7e42777eaf WatchSource:0}: Error finding container 55325d97dd1bf59d28ced9cea7aff32e90dd9daa25ffd00050e9ac7e42777eaf: Status 404 returned error can't find the container with id 55325d97dd1bf59d28ced9cea7aff32e90dd9daa25ffd00050e9ac7e42777eaf Jun 10 13:07:17.401869 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:17.401789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:17.820626 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:17.820592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" event={"ID":"5218ddd4-1081-4207-a1f5-2026ebe27808","Type":"ContainerStarted","Data":"55325d97dd1bf59d28ced9cea7aff32e90dd9daa25ffd00050e9ac7e42777eaf"} Jun 10 13:07:20.273631 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:20.273580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:21.029835 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:21.029793 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:07:21.029933 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:21.029869 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:07:21.029933 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:21.029899 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:07:21.840220 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:21.840191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" event={"ID":"5218ddd4-1081-4207-a1f5-2026ebe27808","Type":"ContainerStarted","Data":"69f4b23816e30f64823946eec14082f3dcda258d1135bc40d16d9fccf4fadd7b"} Jun 10 13:07:21.870130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:21.870077 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" podStartSLOduration=2.010240846 podStartE2EDuration="5.870060687s" totalImagesPullingTime="3.859819841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:21.867979995 +0000 UTC m=+377.059418209" watchObservedRunningTime="2026-06-10 13:07:21.870060687 +0000 UTC m=+377.061498902" Jun 10 13:07:22.016194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:22.016168 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:22.020377 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:22.020355 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:22.845091 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:22.845054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:22.846157 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:22.846139 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958x6tv" Jun 10 13:07:37.433267 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.433220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:37.513191 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.513163 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b5wh8"] Jun 10 13:07:37.517143 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.517119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:37.526141 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.526117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:37.527674 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.527560 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b5wh8"] Jun 10 13:07:37.529257 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.529151 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:07:37.529257 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.529203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:07:37.530160 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.530138 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4vhz9\"" Jun 10 13:07:37.599941 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.599914 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6dz\" (UniqueName: \"kubernetes.io/projected/f38fdf4b-a023-4d0b-951b-d88719fbddf4-kube-api-access-jq6dz\") pod \"kuadrant-operator-catalog-b5wh8\" (UID: \"f38fdf4b-a023-4d0b-951b-d88719fbddf4\") " pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:37.606625 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.606596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:37.700595 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.700531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6dz\" (UniqueName: \"kubernetes.io/projected/f38fdf4b-a023-4d0b-951b-d88719fbddf4-kube-api-access-jq6dz\") pod \"kuadrant-operator-catalog-b5wh8\" (UID: \"f38fdf4b-a023-4d0b-951b-d88719fbddf4\") " pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:37.712656 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.712627 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6dz\" (UniqueName: \"kubernetes.io/projected/f38fdf4b-a023-4d0b-951b-d88719fbddf4-kube-api-access-jq6dz\") pod \"kuadrant-operator-catalog-b5wh8\" (UID: \"f38fdf4b-a023-4d0b-951b-d88719fbddf4\") " pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:37.836565 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.836508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:37.892713 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.892680 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b5wh8"] Jun 10 13:07:37.967760 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:37.967739 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b5wh8"] Jun 10 13:07:37.969989 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:07:37.969954 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38fdf4b_a023_4d0b_951b_d88719fbddf4.slice/crio-22cc50f036c673b70abb81c816b4802ee4b5a8b57eedf39a2c28144bff6b8af1 WatchSource:0}: Error finding container 22cc50f036c673b70abb81c816b4802ee4b5a8b57eedf39a2c28144bff6b8af1: Status 404 returned error can't find the container with id 22cc50f036c673b70abb81c816b4802ee4b5a8b57eedf39a2c28144bff6b8af1 Jun 10 13:07:38.103752 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.103718 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zc9vg"] Jun 10 13:07:38.106176 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.106155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:38.121443 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.121420 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zc9vg"] Jun 10 13:07:38.204763 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.204729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjs6\" (UniqueName: \"kubernetes.io/projected/1292bd94-db0c-4b7c-acf3-49e7fa1ebd21-kube-api-access-wvjs6\") pod \"kuadrant-operator-catalog-zc9vg\" (UID: \"1292bd94-db0c-4b7c-acf3-49e7fa1ebd21\") " pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:38.306195 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.306105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjs6\" (UniqueName: \"kubernetes.io/projected/1292bd94-db0c-4b7c-acf3-49e7fa1ebd21-kube-api-access-wvjs6\") pod \"kuadrant-operator-catalog-zc9vg\" (UID: \"1292bd94-db0c-4b7c-acf3-49e7fa1ebd21\") " pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:38.318364 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.318336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjs6\" (UniqueName: \"kubernetes.io/projected/1292bd94-db0c-4b7c-acf3-49e7fa1ebd21-kube-api-access-wvjs6\") pod \"kuadrant-operator-catalog-zc9vg\" (UID: \"1292bd94-db0c-4b7c-acf3-49e7fa1ebd21\") " pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:38.415098 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.415077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:38.543274 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.543250 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zc9vg"] Jun 10 13:07:38.545686 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:07:38.545654 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1292bd94_db0c_4b7c_acf3_49e7fa1ebd21.slice/crio-a2a4da69b6233a154eff0477b23d4a9def5a41c8ffa552d7cd33b4368f792149 WatchSource:0}: Error finding container a2a4da69b6233a154eff0477b23d4a9def5a41c8ffa552d7cd33b4368f792149: Status 404 returned error can't find the container with id a2a4da69b6233a154eff0477b23d4a9def5a41c8ffa552d7cd33b4368f792149 Jun 10 13:07:38.914488 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.914447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" event={"ID":"f38fdf4b-a023-4d0b-951b-d88719fbddf4","Type":"ContainerStarted","Data":"22cc50f036c673b70abb81c816b4802ee4b5a8b57eedf39a2c28144bff6b8af1"} Jun 10 13:07:38.915645 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:38.915614 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" event={"ID":"1292bd94-db0c-4b7c-acf3-49e7fa1ebd21","Type":"ContainerStarted","Data":"a2a4da69b6233a154eff0477b23d4a9def5a41c8ffa552d7cd33b4368f792149"} Jun 10 13:07:40.927162 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:40.927099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" event={"ID":"1292bd94-db0c-4b7c-acf3-49e7fa1ebd21","Type":"ContainerStarted","Data":"22456520c53f7b534e67fc20ce508dd9eeeeffa8b16f449ae2dbabf575b98893"} Jun 10 13:07:40.928713 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:40.928683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" event={"ID":"f38fdf4b-a023-4d0b-951b-d88719fbddf4","Type":"ContainerStarted","Data":"fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b"} Jun 10 13:07:40.928841 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:40.928781 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" podUID="f38fdf4b-a023-4d0b-951b-d88719fbddf4" containerName="registry-server" containerID="cri-o://fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b" gracePeriod=2 Jun 10 13:07:40.945399 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:40.945360 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" podStartSLOduration=1.090656778 podStartE2EDuration="2.945343382s" totalImagesPullingTime="1.854686604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:40.943730827 +0000 UTC m=+396.135169041" watchObservedRunningTime="2026-06-10 13:07:40.945343382 +0000 UTC m=+396.136781596" Jun 10 13:07:40.961281 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:40.961242 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" podStartSLOduration=1.527686783 podStartE2EDuration="3.961228348s" totalImagesPullingTime="2.433541565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:40.95970263 +0000 UTC m=+396.151140898" watchObservedRunningTime="2026-06-10 13:07:40.961228348 +0000 UTC m=+396.152666562" Jun 10 13:07:41.180218 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.180149 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:41.333346 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.333316 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq6dz\" (UniqueName: \"kubernetes.io/projected/f38fdf4b-a023-4d0b-951b-d88719fbddf4-kube-api-access-jq6dz\") pod \"f38fdf4b-a023-4d0b-951b-d88719fbddf4\" (UID: \"f38fdf4b-a023-4d0b-951b-d88719fbddf4\") " Jun 10 13:07:41.335544 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.335505 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f38fdf4b-a023-4d0b-951b-d88719fbddf4-kube-api-access-jq6dz" (OuterVolumeSpecName: "kube-api-access-jq6dz") pod "f38fdf4b-a023-4d0b-951b-d88719fbddf4" (UID: "f38fdf4b-a023-4d0b-951b-d88719fbddf4"). InnerVolumeSpecName "kube-api-access-jq6dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:41.434538 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.434454 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq6dz\" (UniqueName: \"kubernetes.io/projected/f38fdf4b-a023-4d0b-951b-d88719fbddf4-kube-api-access-jq6dz\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:07:41.934308 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.934276 2562 generic.go:356] "Generic (PLEG): container finished" podID="f38fdf4b-a023-4d0b-951b-d88719fbddf4" containerID="fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b" exitCode=0 Jun 10 13:07:41.934781 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.934326 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" Jun 10 13:07:41.934781 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.934362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" event={"ID":"f38fdf4b-a023-4d0b-951b-d88719fbddf4","Type":"ContainerDied","Data":"fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b"} Jun 10 13:07:41.934781 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.934412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b5wh8" event={"ID":"f38fdf4b-a023-4d0b-951b-d88719fbddf4","Type":"ContainerDied","Data":"22cc50f036c673b70abb81c816b4802ee4b5a8b57eedf39a2c28144bff6b8af1"} Jun 10 13:07:41.934781 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.934437 2562 scope.go:117] "RemoveContainer" containerID="fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b" Jun 10 13:07:41.943280 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.943260 2562 scope.go:117] "RemoveContainer" containerID="fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b" Jun 10 13:07:41.943545 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:07:41.943506 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b\": container with ID starting with fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b not found: ID does not exist" containerID="fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b" Jun 10 13:07:41.943613 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.943555 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b"} err="failed to get container status \"fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b\": rpc error: code = NotFound desc = could not find container \"fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b\": container with ID starting with fdb12a02ed11e61412b1215ec074d7d662fd505f735c6c1deee19503a92e544b not found: ID does not exist" Jun 10 13:07:41.956788 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.956767 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b5wh8"] Jun 10 13:07:41.961492 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:41.961474 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b5wh8"] Jun 10 13:07:43.276939 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:43.276908 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f38fdf4b-a023-4d0b-951b-d88719fbddf4" path="/var/lib/kubelet/pods/f38fdf4b-a023-4d0b-951b-d88719fbddf4/volumes" Jun 10 13:07:48.415586 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:48.415556 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:48.415988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:48.415645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:48.438252 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:48.438227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:07:48.987849 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:07:48.987823 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zc9vg" Jun 10 13:08:06.810123 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:06.810088 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:07.596056 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:07.596021 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:07.834486 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:07.834450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:10.695173 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.695140 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf"] Jun 10 13:08:10.695661 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.695492 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f38fdf4b-a023-4d0b-951b-d88719fbddf4" containerName="registry-server" Jun 10 13:08:10.695661 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.695503 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f38fdf4b-a023-4d0b-951b-d88719fbddf4" containerName="registry-server" Jun 10 13:08:10.695661 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.695572 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f38fdf4b-a023-4d0b-951b-d88719fbddf4" containerName="registry-server" Jun 10 13:08:10.698173 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.698152 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:10.700770 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.700751 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dwzz6\"" Jun 10 13:08:10.716191 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.716172 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf"] Jun 10 13:08:10.784244 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.784207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjrz9\" (UniqueName: \"kubernetes.io/projected/47e9072f-3cd2-48a4-8cc2-3944f893a9c2-kube-api-access-rjrz9\") pod \"authorino-operator-75cc8d5cb7-vr7cf\" (UID: \"47e9072f-3cd2-48a4-8cc2-3944f893a9c2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:10.885167 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.885130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjrz9\" (UniqueName: \"kubernetes.io/projected/47e9072f-3cd2-48a4-8cc2-3944f893a9c2-kube-api-access-rjrz9\") pod \"authorino-operator-75cc8d5cb7-vr7cf\" (UID: \"47e9072f-3cd2-48a4-8cc2-3944f893a9c2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:10.897063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:10.897039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjrz9\" (UniqueName: \"kubernetes.io/projected/47e9072f-3cd2-48a4-8cc2-3944f893a9c2-kube-api-access-rjrz9\") pod \"authorino-operator-75cc8d5cb7-vr7cf\" (UID: \"47e9072f-3cd2-48a4-8cc2-3944f893a9c2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:11.008214 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:11.008136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:11.132379 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:11.132351 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf"] Jun 10 13:08:11.134964 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:08:11.134934 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e9072f_3cd2_48a4_8cc2_3944f893a9c2.slice/crio-6d9bea458f949a8c0ad996e32e3121fd36f81ee3539dcdb14ff5b0a0a5c04f19 WatchSource:0}: Error finding container 6d9bea458f949a8c0ad996e32e3121fd36f81ee3539dcdb14ff5b0a0a5c04f19: Status 404 returned error can't find the container with id 6d9bea458f949a8c0ad996e32e3121fd36f81ee3539dcdb14ff5b0a0a5c04f19 Jun 10 13:08:11.390144 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:11.390063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:12.066363 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:12.066332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" event={"ID":"47e9072f-3cd2-48a4-8cc2-3944f893a9c2","Type":"ContainerStarted","Data":"6d9bea458f949a8c0ad996e32e3121fd36f81ee3539dcdb14ff5b0a0a5c04f19"} Jun 10 13:08:14.076478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:14.076443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" event={"ID":"47e9072f-3cd2-48a4-8cc2-3944f893a9c2","Type":"ContainerStarted","Data":"34bbc98e73860691d749e440cfc99a72bb07203d4c86c04623a407fa2b711afe"} Jun 10 13:08:14.076864 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:14.076535 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:14.129621 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:14.129570 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" podStartSLOduration=1.826150245 podStartE2EDuration="4.129555046s" totalImagesPullingTime="2.303404801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:14.128480599 +0000 UTC m=+429.319918812" watchObservedRunningTime="2026-06-10 13:08:14.129555046 +0000 UTC m=+429.320993254" Jun 10 13:08:14.689001 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:14.688969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:15.002454 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.002373 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85"] Jun 10 13:08:15.005745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.005730 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.008423 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.008399 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ls6hb\"" Jun 10 13:08:15.019531 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.019486 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85"] Jun 10 13:08:15.125281 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.125249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw9cn\" (UniqueName: \"kubernetes.io/projected/aae45af5-3988-42cb-a243-063947405500-kube-api-access-sw9cn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.125670 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.125298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae45af5-3988-42cb-a243-063947405500-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.226585 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.226553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae45af5-3988-42cb-a243-063947405500-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.226731 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.226648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw9cn\" (UniqueName: \"kubernetes.io/projected/aae45af5-3988-42cb-a243-063947405500-kube-api-access-sw9cn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.227061 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.227044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae45af5-3988-42cb-a243-063947405500-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.243902 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.243883 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw9cn\" (UniqueName: \"kubernetes.io/projected/aae45af5-3988-42cb-a243-063947405500-kube-api-access-sw9cn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.317131 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.317070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:15.461088 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.461057 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85"] Jun 10 13:08:15.464102 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:08:15.464081 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae45af5_3988_42cb_a243_063947405500.slice/crio-279ac4ab052a3233764323a0e4116f30ba265259f0280c8760336f4f459807f6 WatchSource:0}: Error finding container 279ac4ab052a3233764323a0e4116f30ba265259f0280c8760336f4f459807f6: Status 404 returned error can't find the container with id 279ac4ab052a3233764323a0e4116f30ba265259f0280c8760336f4f459807f6 Jun 10 13:08:15.599160 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.599075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:15.845463 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:15.845407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:16.085714 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:16.085683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" event={"ID":"aae45af5-3988-42cb-a243-063947405500","Type":"ContainerStarted","Data":"279ac4ab052a3233764323a0e4116f30ba265259f0280c8760336f4f459807f6"} Jun 10 13:08:17.834390 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:17.834344 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:18.046359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:18.046305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:19.788158 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.788120 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h"] Jun 10 13:08:19.791947 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.791923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:19.800248 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.800228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q8hhj\"" Jun 10 13:08:19.811684 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.811654 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 13:08:19.816119 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.816094 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h"] Jun 10 13:08:19.863375 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.863336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4t8v\" (UniqueName: \"kubernetes.io/projected/acad81e9-dbe3-4f2a-b44e-d95d74f211c1-kube-api-access-k4t8v\") pod \"dns-operator-controller-manager-864dd78c4c-p5t7h\" (UID: \"acad81e9-dbe3-4f2a-b44e-d95d74f211c1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:19.964531 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.964474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4t8v\" (UniqueName: \"kubernetes.io/projected/acad81e9-dbe3-4f2a-b44e-d95d74f211c1-kube-api-access-k4t8v\") pod \"dns-operator-controller-manager-864dd78c4c-p5t7h\" (UID: \"acad81e9-dbe3-4f2a-b44e-d95d74f211c1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:19.978987 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:19.978949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4t8v\" (UniqueName: \"kubernetes.io/projected/acad81e9-dbe3-4f2a-b44e-d95d74f211c1-kube-api-access-k4t8v\") pod \"dns-operator-controller-manager-864dd78c4c-p5t7h\" (UID: \"acad81e9-dbe3-4f2a-b44e-d95d74f211c1\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:20.102833 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:20.102749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:20.261194 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:20.261163 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h"] Jun 10 13:08:20.264331 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:08:20.264302 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacad81e9_dbe3_4f2a_b44e_d95d74f211c1.slice/crio-bef4a030128322a5d21cf45f9d70cc4229ae13900416beafe1ca737e46c80a43 WatchSource:0}: Error finding container bef4a030128322a5d21cf45f9d70cc4229ae13900416beafe1ca737e46c80a43: Status 404 returned error can't find the container with id bef4a030128322a5d21cf45f9d70cc4229ae13900416beafe1ca737e46c80a43 Jun 10 13:08:20.992960 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:20.992915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:21.111550 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:21.111498 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" event={"ID":"acad81e9-dbe3-4f2a-b44e-d95d74f211c1","Type":"ContainerStarted","Data":"bef4a030128322a5d21cf45f9d70cc4229ae13900416beafe1ca737e46c80a43"} Jun 10 13:08:21.222954 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:21.222755 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:21.400423 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:21.400324 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:24.128798 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:24.128763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" event={"ID":"acad81e9-dbe3-4f2a-b44e-d95d74f211c1","Type":"ContainerStarted","Data":"a7810046964ecbb60d2d0f0185782748425c330613a5583e14bf3119a30c007c"} Jun 10 13:08:24.129301 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:24.128876 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:24.130375 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:24.130355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" event={"ID":"aae45af5-3988-42cb-a243-063947405500","Type":"ContainerStarted","Data":"ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a"} Jun 10 13:08:24.130490 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:24.130479 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:24.178565 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:24.178479 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" podStartSLOduration=2.250597022 podStartE2EDuration="5.178452022s" totalImagesPullingTime="2.927855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:24.153150746 +0000 UTC m=+439.344588960" watchObservedRunningTime="2026-06-10 13:08:24.178452022 +0000 UTC m=+439.369890237" Jun 10 13:08:25.082604 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:25.082507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vr7cf" Jun 10 13:08:25.128274 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:25.128221 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" podStartSLOduration=3.449847521 podStartE2EDuration="11.128202066s" totalImagesPullingTime="7.678354545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:24.182016202 +0000 UTC m=+439.373454417" watchObservedRunningTime="2026-06-10 13:08:25.128202066 +0000 UTC m=+440.319640286" Jun 10 13:08:25.398260 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:25.398173 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:25.515323 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:25.515289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:26.355004 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:26.354967 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:27.141750 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:27.141710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:33.217646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:33.217602 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:33.318383 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:33.318351 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:35.136214 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:35.136187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-p5t7h" Jun 10 13:08:35.136680 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:35.136262 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:35.865662 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:35.865627 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:35.994558 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:35.994502 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:36.412293 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.412261 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6"] Jun 10 13:08:36.415760 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.415740 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:36.441882 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.441857 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6"] Jun 10 13:08:36.519693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.519651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq5g\" (UniqueName: \"kubernetes.io/projected/baf5bb23-6129-45e8-9da0-d6b3f940227c-kube-api-access-dcq5g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:36.519693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.519699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baf5bb23-6129-45e8-9da0-d6b3f940227c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:36.536611 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.536584 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6"] Jun 10 13:08:36.536854 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:36.536834 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-dcq5g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" podUID="baf5bb23-6129-45e8-9da0-d6b3f940227c" Jun 10 13:08:36.620568 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.620538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq5g\" (UniqueName: \"kubernetes.io/projected/baf5bb23-6129-45e8-9da0-d6b3f940227c-kube-api-access-dcq5g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:36.620683 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.620573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baf5bb23-6129-45e8-9da0-d6b3f940227c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:36.620855 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.620840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baf5bb23-6129-45e8-9da0-d6b3f940227c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:36.631867 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:36.631845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq5g\" (UniqueName: \"kubernetes.io/projected/baf5bb23-6129-45e8-9da0-d6b3f940227c-kube-api-access-dcq5g\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:37.145825 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.145796 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6"] Jun 10 13:08:37.158915 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.158882 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6"] Jun 10 13:08:37.175460 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.175434 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85"] Jun 10 13:08:37.175668 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.175645 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" podUID="aae45af5-3988-42cb-a243-063947405500" containerName="manager" containerID="cri-o://ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a" gracePeriod=2 Jun 10 13:08:37.183644 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.183622 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85"] Jun 10 13:08:37.186901 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.186792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:37.189413 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:37.189376 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="baf5bb23-6129-45e8-9da0-d6b3f940227c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:37.191854 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:37.191827 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="aae45af5-3988-42cb-a243-063947405500" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:37.210293 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.210270 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l"] Jun 10 13:08:37.210693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.210671 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae45af5-3988-42cb-a243-063947405500" containerName="manager" Jun 10 13:08:37.210693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.210690 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae45af5-3988-42cb-a243-063947405500" containerName="manager" Jun 10 13:08:37.210847 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.210818 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae45af5-3988-42cb-a243-063947405500" containerName="manager" Jun 10 13:08:37.213619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.213599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.233300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.233273 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l"] Jun 10 13:08:37.255443 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:37.255409 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="baf5bb23-6129-45e8-9da0-d6b3f940227c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:37.257613 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:37.257582 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="aae45af5-3988-42cb-a243-063947405500" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:37.259639 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.259620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:37.261923 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:37.261889 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jqr85\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="aae45af5-3988-42cb-a243-063947405500" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:37.263930 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:37.263909 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="baf5bb23-6129-45e8-9da0-d6b3f940227c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:37.327977 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.327951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvxfs\" (UniqueName: \"kubernetes.io/projected/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-kube-api-access-cvxfs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkx9l\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.328114 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.328025 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkx9l\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.412804 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.412781 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:37.428986 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.428963 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baf5bb23-6129-45e8-9da0-d6b3f940227c-extensions-socket-volume\") pod \"baf5bb23-6129-45e8-9da0-d6b3f940227c\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " Jun 10 13:08:37.429089 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.429013 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcq5g\" (UniqueName: \"kubernetes.io/projected/baf5bb23-6129-45e8-9da0-d6b3f940227c-kube-api-access-dcq5g\") pod \"baf5bb23-6129-45e8-9da0-d6b3f940227c\" (UID: \"baf5bb23-6129-45e8-9da0-d6b3f940227c\") " Jun 10 13:08:37.429171 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.429154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvxfs\" (UniqueName: \"kubernetes.io/projected/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-kube-api-access-cvxfs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkx9l\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.429246 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.429229 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf5bb23-6129-45e8-9da0-d6b3f940227c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "baf5bb23-6129-45e8-9da0-d6b3f940227c" (UID: "baf5bb23-6129-45e8-9da0-d6b3f940227c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:37.429286 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.429264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkx9l\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.429342 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.429331 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/baf5bb23-6129-45e8-9da0-d6b3f940227c-extensions-socket-volume\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:08:37.429702 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.429683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkx9l\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.431008 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.430987 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf5bb23-6129-45e8-9da0-d6b3f940227c-kube-api-access-dcq5g" (OuterVolumeSpecName: "kube-api-access-dcq5g") pod "baf5bb23-6129-45e8-9da0-d6b3f940227c" (UID: "baf5bb23-6129-45e8-9da0-d6b3f940227c"). InnerVolumeSpecName "kube-api-access-dcq5g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:08:37.438036 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.438017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvxfs\" (UniqueName: \"kubernetes.io/projected/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-kube-api-access-cvxfs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkx9l\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.530509 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.530485 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw9cn\" (UniqueName: \"kubernetes.io/projected/aae45af5-3988-42cb-a243-063947405500-kube-api-access-sw9cn\") pod \"aae45af5-3988-42cb-a243-063947405500\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " Jun 10 13:08:37.530640 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.530599 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae45af5-3988-42cb-a243-063947405500-extensions-socket-volume\") pod \"aae45af5-3988-42cb-a243-063947405500\" (UID: \"aae45af5-3988-42cb-a243-063947405500\") " Jun 10 13:08:37.530814 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.530800 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcq5g\" (UniqueName: \"kubernetes.io/projected/baf5bb23-6129-45e8-9da0-d6b3f940227c-kube-api-access-dcq5g\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:08:37.531037 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.531016 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae45af5-3988-42cb-a243-063947405500-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aae45af5-3988-42cb-a243-063947405500" (UID: "aae45af5-3988-42cb-a243-063947405500"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:37.532210 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.532191 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae45af5-3988-42cb-a243-063947405500-kube-api-access-sw9cn" (OuterVolumeSpecName: "kube-api-access-sw9cn") pod "aae45af5-3988-42cb-a243-063947405500" (UID: "aae45af5-3988-42cb-a243-063947405500"). InnerVolumeSpecName "kube-api-access-sw9cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:08:37.567029 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.567003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:37.632037 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.632005 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aae45af5-3988-42cb-a243-063947405500-extensions-socket-volume\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:08:37.632037 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.632034 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw9cn\" (UniqueName: \"kubernetes.io/projected/aae45af5-3988-42cb-a243-063947405500-kube-api-access-sw9cn\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:08:37.707720 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:37.707690 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l"] Jun 10 13:08:37.708939 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:08:37.708905 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7323d3d_9fd9_469f_81d4_ea9b9d2fb2ce.slice/crio-70b0ab97e5af867e7812dab2708295f998e9e25b8fd0580e68cc5d63e68d99bb WatchSource:0}: Error finding container 70b0ab97e5af867e7812dab2708295f998e9e25b8fd0580e68cc5d63e68d99bb: Status 404 returned error can't find the container with id 70b0ab97e5af867e7812dab2708295f998e9e25b8fd0580e68cc5d63e68d99bb Jun 10 13:08:38.192413 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.192378 2562 generic.go:356] "Generic (PLEG): container finished" podID="aae45af5-3988-42cb-a243-063947405500" containerID="ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a" exitCode=0 Jun 10 13:08:38.192598 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.192425 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jqr85" Jun 10 13:08:38.192598 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.192477 2562 scope.go:117] "RemoveContainer" containerID="ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a" Jun 10 13:08:38.194288 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.194265 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:38.194400 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.194294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" event={"ID":"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce","Type":"ContainerStarted","Data":"2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae"} Jun 10 13:08:38.194400 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.194359 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:38.194400 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.194387 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" event={"ID":"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce","Type":"ContainerStarted","Data":"70b0ab97e5af867e7812dab2708295f998e9e25b8fd0580e68cc5d63e68d99bb"} Jun 10 13:08:38.202105 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.202087 2562 scope.go:117] "RemoveContainer" containerID="ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a" Jun 10 13:08:38.202493 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:38.202468 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a\": container with ID starting with ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a not found: ID does not exist" containerID="ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a" Jun 10 13:08:38.202611 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.202502 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a"} err="failed to get container status \"ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a\": rpc error: code = NotFound desc = could not find container \"ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a\": container with ID starting with ae3a6a5a1da234f200c6ae12042a029ac2371b11285f4ff6c4890df70af7735a not found: ID does not exist" Jun 10 13:08:38.221990 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:38.221947 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" podStartSLOduration=1.221932529 podStartE2EDuration="1.221932529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:38.219291589 +0000 UTC m=+453.410729803" watchObservedRunningTime="2026-06-10 13:08:38.221932529 +0000 UTC m=+453.413370809" Jun 10 13:08:38.226776 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:08:38.226752 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-2chb6\" is forbidden: User \"system:node:ip-10-0-128-45.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-45.ec2.internal' and this object" podUID="baf5bb23-6129-45e8-9da0-d6b3f940227c" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2chb6" Jun 10 13:08:39.276960 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:39.276925 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae45af5-3988-42cb-a243-063947405500" path="/var/lib/kubelet/pods/aae45af5-3988-42cb-a243-063947405500/volumes" Jun 10 13:08:39.277445 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:39.277415 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baf5bb23-6129-45e8-9da0-d6b3f940227c" path="/var/lib/kubelet/pods/baf5bb23-6129-45e8-9da0-d6b3f940227c/volumes" Jun 10 13:08:41.440364 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:41.440330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:41.541455 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:41.541394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:41.645666 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:41.645611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:41.707546 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:41.707432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:42.056612 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:42.056503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:42.128607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:42.128573 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:45.627643 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:45.627601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:45.695627 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:45.695590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:48.506209 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:48.506166 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:48.607866 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:48.607826 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:49.201896 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:49.201866 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:08:52.259928 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:52.259893 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:52.357912 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:52.357866 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:54.692487 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:54.692450 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:54.798723 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:54.798686 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:57.104098 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:08:57.104066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:08.486111 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.486075 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l"] Jun 10 13:09:08.486601 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.486297 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" podUID="a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" containerName="manager" containerID="cri-o://2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae" gracePeriod=10 Jun 10 13:09:08.741179 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.741119 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:09:08.781353 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.781319 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8"] Jun 10 13:09:08.781737 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.781716 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" containerName="manager" Jun 10 13:09:08.781737 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.781736 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" containerName="manager" Jun 10 13:09:08.781956 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.781865 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" containerName="manager" Jun 10 13:09:08.783851 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.783835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:08.790381 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.790348 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-extensions-socket-volume\") pod \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " Jun 10 13:09:08.790473 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.790404 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvxfs\" (UniqueName: \"kubernetes.io/projected/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-kube-api-access-cvxfs\") pod \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\" (UID: \"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce\") " Jun 10 13:09:08.791375 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.791352 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" (UID: "a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:08.792866 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.792841 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-kube-api-access-cvxfs" (OuterVolumeSpecName: "kube-api-access-cvxfs") pod "a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" (UID: "a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce"). InnerVolumeSpecName "kube-api-access-cvxfs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:08.800829 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.800807 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8"] Jun 10 13:09:08.891894 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.891859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8aa2d5-097e-4dc6-a85d-7d64c604575b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xqnf8\" (UID: \"0a8aa2d5-097e-4dc6-a85d-7d64c604575b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:08.892058 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.891927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2jnh\" (UniqueName: \"kubernetes.io/projected/0a8aa2d5-097e-4dc6-a85d-7d64c604575b-kube-api-access-w2jnh\") pod \"kuadrant-operator-controller-manager-86878c769f-xqnf8\" (UID: \"0a8aa2d5-097e-4dc6-a85d-7d64c604575b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:08.892058 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.892053 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-extensions-socket-volume\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:09:08.892151 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.892068 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvxfs\" (UniqueName: \"kubernetes.io/projected/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce-kube-api-access-cvxfs\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:09:08.993344 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.993270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2jnh\" (UniqueName: \"kubernetes.io/projected/0a8aa2d5-097e-4dc6-a85d-7d64c604575b-kube-api-access-w2jnh\") pod \"kuadrant-operator-controller-manager-86878c769f-xqnf8\" (UID: \"0a8aa2d5-097e-4dc6-a85d-7d64c604575b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:08.993474 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.993347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8aa2d5-097e-4dc6-a85d-7d64c604575b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xqnf8\" (UID: \"0a8aa2d5-097e-4dc6-a85d-7d64c604575b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:08.993740 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:08.993722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8aa2d5-097e-4dc6-a85d-7d64c604575b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xqnf8\" (UID: \"0a8aa2d5-097e-4dc6-a85d-7d64c604575b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:09.001686 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.001664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2jnh\" (UniqueName: \"kubernetes.io/projected/0a8aa2d5-097e-4dc6-a85d-7d64c604575b-kube-api-access-w2jnh\") pod \"kuadrant-operator-controller-manager-86878c769f-xqnf8\" (UID: \"0a8aa2d5-097e-4dc6-a85d-7d64c604575b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:09.093710 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.093678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:09.232364 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.232342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8"] Jun 10 13:09:09.234702 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:09:09.234671 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8aa2d5_097e_4dc6_a85d_7d64c604575b.slice/crio-8fa882c4508701c78a77bc7ae67c83042143d666f07a5d559ddf24200e59cf3b WatchSource:0}: Error finding container 8fa882c4508701c78a77bc7ae67c83042143d666f07a5d559ddf24200e59cf3b: Status 404 returned error can't find the container with id 8fa882c4508701c78a77bc7ae67c83042143d666f07a5d559ddf24200e59cf3b Jun 10 13:09:09.336992 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.336958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" event={"ID":"0a8aa2d5-097e-4dc6-a85d-7d64c604575b","Type":"ContainerStarted","Data":"bebcd3fb6cd5f81d8efffd9baaea8950659ed1ea29dd52945b63c8d91025b463"} Jun 10 13:09:09.337125 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.337023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" event={"ID":"0a8aa2d5-097e-4dc6-a85d-7d64c604575b","Type":"ContainerStarted","Data":"8fa882c4508701c78a77bc7ae67c83042143d666f07a5d559ddf24200e59cf3b"} Jun 10 13:09:09.337125 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.337058 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:09.338253 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.338230 2562 generic.go:356] "Generic (PLEG): container finished" podID="a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" containerID="2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae" exitCode=0 Jun 10 13:09:09.338338 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.338262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" event={"ID":"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce","Type":"ContainerDied","Data":"2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae"} Jun 10 13:09:09.338338 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.338267 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" Jun 10 13:09:09.338338 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.338300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l" event={"ID":"a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce","Type":"ContainerDied","Data":"70b0ab97e5af867e7812dab2708295f998e9e25b8fd0580e68cc5d63e68d99bb"} Jun 10 13:09:09.338338 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.338327 2562 scope.go:117] "RemoveContainer" containerID="2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae" Jun 10 13:09:09.346229 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.346209 2562 scope.go:117] "RemoveContainer" containerID="2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae" Jun 10 13:09:09.346485 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:09:09.346466 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae\": container with ID starting with 2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae not found: ID does not exist" containerID="2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae" Jun 10 13:09:09.346642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.346494 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae"} err="failed to get container status \"2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae\": rpc error: code = NotFound desc = could not find container \"2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae\": container with ID starting with 2d7593bcc7961f1d3704c4881c4d283dda5ec6de90edea738d02ab9954b989ae not found: ID does not exist" Jun 10 13:09:09.364629 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.364582 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" podStartSLOduration=1.364563153 podStartE2EDuration="1.364563153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:09.36312374 +0000 UTC m=+484.554561995" watchObservedRunningTime="2026-06-10 13:09:09.364563153 +0000 UTC m=+484.556001367" Jun 10 13:09:09.378707 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.378688 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l"] Jun 10 13:09:09.386039 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:09.386022 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkx9l"] Jun 10 13:09:11.277022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:11.276989 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce" path="/var/lib/kubelet/pods/a7323d3d-9fd9-469f-81d4-ea9b9d2fb2ce/volumes" Jun 10 13:09:20.346084 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:20.346054 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xqnf8" Jun 10 13:09:24.775259 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.775226 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb"] Jun 10 13:09:24.780261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.780238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.783376 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.783358 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-slbt7\"" Jun 10 13:09:24.793040 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.793022 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb"] Jun 10 13:09:24.806233 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.806208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:24.903069 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.903025 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:24.933636 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbpb\" (UniqueName: \"kubernetes.io/projected/cf9a7b2d-3f64-439f-b32d-966318b7a71f-kube-api-access-5sbpb\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933815 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933815 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933901 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933901 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:24.933988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:24.933931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.034798 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.034737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.034798 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.034792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.034966 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.034904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.034966 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.034934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035082 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.034968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035135 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035135 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035252 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbpb\" (UniqueName: \"kubernetes.io/projected/cf9a7b2d-3f64-439f-b32d-966318b7a71f-kube-api-access-5sbpb\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035252 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035564 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035674 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035578 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035674 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035850 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.035926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.035908 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.037100 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.037082 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.037339 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.037323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.044179 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.044157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf9a7b2d-3f64-439f-b32d-966318b7a71f-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.044364 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.044343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbpb\" (UniqueName: \"kubernetes.io/projected/cf9a7b2d-3f64-439f-b32d-966318b7a71f-kube-api-access-5sbpb\") pod \"maas-default-gateway-openshift-default-687ff6996-69lbb\" (UID: \"cf9a7b2d-3f64-439f-b32d-966318b7a71f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.090678 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.090643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:25.233586 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.233553 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb"] Jun 10 13:09:25.236842 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:09:25.236809 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9a7b2d_3f64_439f_b32d_966318b7a71f.slice/crio-8adee1a70acd9b89c5f9faf70f29803b6ed503035d3118a2911909e8d4020a5b WatchSource:0}: Error finding container 8adee1a70acd9b89c5f9faf70f29803b6ed503035d3118a2911909e8d4020a5b: Status 404 returned error can't find the container with id 8adee1a70acd9b89c5f9faf70f29803b6ed503035d3118a2911909e8d4020a5b Jun 10 13:09:25.238860 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.238826 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:09:25.238963 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.238899 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:09:25.238963 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.238939 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:09:25.411537 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.411492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" event={"ID":"cf9a7b2d-3f64-439f-b32d-966318b7a71f","Type":"ContainerStarted","Data":"d266a074000169df7acde2e34ef77e95b455d4158d90eaf891daf8692f536343"} Jun 10 13:09:25.411704 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.411553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" event={"ID":"cf9a7b2d-3f64-439f-b32d-966318b7a71f","Type":"ContainerStarted","Data":"8adee1a70acd9b89c5f9faf70f29803b6ed503035d3118a2911909e8d4020a5b"} Jun 10 13:09:25.434014 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:25.433968 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" podStartSLOduration=1.433952949 podStartE2EDuration="1.433952949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:25.431797451 +0000 UTC m=+500.623235666" watchObservedRunningTime="2026-06-10 13:09:25.433952949 +0000 UTC m=+500.625391238" Jun 10 13:09:26.091813 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:26.091779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:26.096442 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:26.096418 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:26.417295 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:26.417265 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:26.418479 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:26.418462 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:09:29.003663 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:29.003632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:29.476465 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:29.476428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:29.667561 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:29.667500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:30.373450 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.373415 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:30.440266 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.440232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:30.490432 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.490408 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgz7f"] Jun 10 13:09:30.493810 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.493785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:09:30.496267 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.496249 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bvgbt\"" Jun 10 13:09:30.501651 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.501630 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgz7f"] Jun 10 13:09:30.585841 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.585811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkhhx\" (UniqueName: \"kubernetes.io/projected/bec46e59-dacd-4d6b-80b7-b7a342a563aa-kube-api-access-gkhhx\") pod \"authorino-75d556bd77-cgz7f\" (UID: \"bec46e59-dacd-4d6b-80b7-b7a342a563aa\") " pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:09:30.686216 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.686189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkhhx\" (UniqueName: \"kubernetes.io/projected/bec46e59-dacd-4d6b-80b7-b7a342a563aa-kube-api-access-gkhhx\") pod \"authorino-75d556bd77-cgz7f\" (UID: \"bec46e59-dacd-4d6b-80b7-b7a342a563aa\") " pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:09:30.695592 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.695567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkhhx\" (UniqueName: \"kubernetes.io/projected/bec46e59-dacd-4d6b-80b7-b7a342a563aa-kube-api-access-gkhhx\") pod \"authorino-75d556bd77-cgz7f\" (UID: \"bec46e59-dacd-4d6b-80b7-b7a342a563aa\") " pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:09:30.804550 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.804506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:09:30.936973 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:30.936870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgz7f"] Jun 10 13:09:30.939321 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:09:30.939292 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbec46e59_dacd_4d6b_80b7_b7a342a563aa.slice/crio-728c1b3fee8dd84c541fbe304352c3e067ca6f3738172ef39a05075f1ffa8dcd WatchSource:0}: Error finding container 728c1b3fee8dd84c541fbe304352c3e067ca6f3738172ef39a05075f1ffa8dcd: Status 404 returned error can't find the container with id 728c1b3fee8dd84c541fbe304352c3e067ca6f3738172ef39a05075f1ffa8dcd Jun 10 13:09:31.441430 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:31.441396 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgz7f" event={"ID":"bec46e59-dacd-4d6b-80b7-b7a342a563aa","Type":"ContainerStarted","Data":"728c1b3fee8dd84c541fbe304352c3e067ca6f3738172ef39a05075f1ffa8dcd"} Jun 10 13:09:34.459481 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:34.459445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgz7f" event={"ID":"bec46e59-dacd-4d6b-80b7-b7a342a563aa","Type":"ContainerStarted","Data":"78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6"} Jun 10 13:09:34.477251 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:34.477206 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cgz7f" podStartSLOduration=1.263607554 podStartE2EDuration="4.477189072s" totalImagesPullingTime="3.213581518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:34.475708249 +0000 UTC m=+509.667146494" watchObservedRunningTime="2026-06-10 13:09:34.477189072 +0000 UTC m=+509.668627286" Jun 10 13:09:45.641321 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:45.641278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:58.042647 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:58.042559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:58.143356 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:58.143326 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:58.307886 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:09:58.307796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:22.610775 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.610735 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:22.791753 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.791715 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:22.940369 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.940335 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:10:22.945624 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.945603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:22.953115 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.953098 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:10:22.953115 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.953104 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:10:22.953354 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.953338 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p5p9z\"" Jun 10 13:10:22.953429 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.953376 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:10:22.975503 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:22.975478 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:10:23.047146 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.047115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hr68\" (UniqueName: \"kubernetes.io/projected/3dd597d4-c982-4910-ad1d-5af0a8d2646c-kube-api-access-2hr68\") pod \"maas-keycloak-0\" (UID: \"3dd597d4-c982-4910-ad1d-5af0a8d2646c\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:23.147991 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.147953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hr68\" (UniqueName: \"kubernetes.io/projected/3dd597d4-c982-4910-ad1d-5af0a8d2646c-kube-api-access-2hr68\") pod \"maas-keycloak-0\" (UID: \"3dd597d4-c982-4910-ad1d-5af0a8d2646c\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:23.159450 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.159422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hr68\" (UniqueName: \"kubernetes.io/projected/3dd597d4-c982-4910-ad1d-5af0a8d2646c-kube-api-access-2hr68\") pod \"maas-keycloak-0\" (UID: \"3dd597d4-c982-4910-ad1d-5af0a8d2646c\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:23.255570 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.255452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:23.407245 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.407222 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:10:23.409613 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:10:23.409584 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd597d4_c982_4910_ad1d_5af0a8d2646c.slice/crio-030409fd3db014b2f6733a0d3b61a5242b1c6a4af7a29cbdf3a365a2a022b4d0 WatchSource:0}: Error finding container 030409fd3db014b2f6733a0d3b61a5242b1c6a4af7a29cbdf3a365a2a022b4d0: Status 404 returned error can't find the container with id 030409fd3db014b2f6733a0d3b61a5242b1c6a4af7a29cbdf3a365a2a022b4d0 Jun 10 13:10:23.572131 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.572038 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:23.686205 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.686172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3dd597d4-c982-4910-ad1d-5af0a8d2646c","Type":"ContainerStarted","Data":"030409fd3db014b2f6733a0d3b61a5242b1c6a4af7a29cbdf3a365a2a022b4d0"} Jun 10 13:10:23.750793 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:23.750757 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:24.043562 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:24.043500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:29.716583 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:29.716555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3dd597d4-c982-4910-ad1d-5af0a8d2646c","Type":"ContainerStarted","Data":"a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca"} Jun 10 13:10:29.751065 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:29.751018 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.540519086 podStartE2EDuration="7.751002966s" totalImagesPullingTime="6.21048388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:29.747554788 +0000 UTC m=+564.938993002" watchObservedRunningTime="2026-06-10 13:10:29.751002966 +0000 UTC m=+564.942441181" Jun 10 13:10:30.255823 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:30.255782 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:30.257046 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:30.257005 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:31.256244 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:31.256192 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:32.256842 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:32.256788 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:33.256356 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:33.256306 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:33.256747 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:33.256710 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:34.256081 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:34.256036 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:35.257027 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:35.256981 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:36.088047 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:36.087987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:36.159594 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:36.159556 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:36.256416 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:36.256356 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:37.256783 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:37.256729 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:38.256322 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:38.256267 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:39.256300 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:39.256256 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:40.256497 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:40.256448 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:41.256145 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:41.256094 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:42.256262 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:42.256210 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 10 13:10:43.382559 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:43.382465 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:43.400218 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:43.400178 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:10:53.389411 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:53.389374 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:10:54.068481 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:54.068446 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:54.362211 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:54.362117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:56.018670 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.018634 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgz7f"] Jun 10 13:10:56.019059 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.018830 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cgz7f" podUID="bec46e59-dacd-4d6b-80b7-b7a342a563aa" containerName="authorino" containerID="cri-o://78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6" gracePeriod=30 Jun 10 13:10:56.269141 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.269073 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:10:56.382966 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.382927 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkhhx\" (UniqueName: \"kubernetes.io/projected/bec46e59-dacd-4d6b-80b7-b7a342a563aa-kube-api-access-gkhhx\") pod \"bec46e59-dacd-4d6b-80b7-b7a342a563aa\" (UID: \"bec46e59-dacd-4d6b-80b7-b7a342a563aa\") " Jun 10 13:10:56.384969 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.384937 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec46e59-dacd-4d6b-80b7-b7a342a563aa-kube-api-access-gkhhx" (OuterVolumeSpecName: "kube-api-access-gkhhx") pod "bec46e59-dacd-4d6b-80b7-b7a342a563aa" (UID: "bec46e59-dacd-4d6b-80b7-b7a342a563aa"). InnerVolumeSpecName "kube-api-access-gkhhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:10:56.484569 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.484540 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkhhx\" (UniqueName: \"kubernetes.io/projected/bec46e59-dacd-4d6b-80b7-b7a342a563aa-kube-api-access-gkhhx\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:10:56.882824 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.882784 2562 generic.go:356] "Generic (PLEG): container finished" podID="bec46e59-dacd-4d6b-80b7-b7a342a563aa" containerID="78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6" exitCode=0 Jun 10 13:10:56.883022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.882846 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cgz7f" Jun 10 13:10:56.883022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.882868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgz7f" event={"ID":"bec46e59-dacd-4d6b-80b7-b7a342a563aa","Type":"ContainerDied","Data":"78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6"} Jun 10 13:10:56.883022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.882913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cgz7f" event={"ID":"bec46e59-dacd-4d6b-80b7-b7a342a563aa","Type":"ContainerDied","Data":"728c1b3fee8dd84c541fbe304352c3e067ca6f3738172ef39a05075f1ffa8dcd"} Jun 10 13:10:56.883022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.882930 2562 scope.go:117] "RemoveContainer" containerID="78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6" Jun 10 13:10:56.891473 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.891457 2562 scope.go:117] "RemoveContainer" containerID="78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6" Jun 10 13:10:56.891761 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:10:56.891737 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6\": container with ID starting with 78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6 not found: ID does not exist" containerID="78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6" Jun 10 13:10:56.891817 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.891766 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6"} err="failed to get container status \"78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6\": rpc error: code = NotFound desc = could not find container \"78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6\": container with ID starting with 78e2db1be16cb80e193322bbddc43a3cdd7f6967fe55242f6a2636f0ededbbe6 not found: ID does not exist" Jun 10 13:10:56.905112 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.905090 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgz7f"] Jun 10 13:10:56.910443 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:56.910422 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cgz7f"] Jun 10 13:10:57.278006 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:57.277972 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec46e59-dacd-4d6b-80b7-b7a342a563aa" path="/var/lib/kubelet/pods/bec46e59-dacd-4d6b-80b7-b7a342a563aa/volumes" Jun 10 13:10:59.565709 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.565678 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c55dfb4bd-h78gg"] Jun 10 13:10:59.566069 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.566051 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec46e59-dacd-4d6b-80b7-b7a342a563aa" containerName="authorino" Jun 10 13:10:59.566069 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.566062 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec46e59-dacd-4d6b-80b7-b7a342a563aa" containerName="authorino" Jun 10 13:10:59.566159 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.566119 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec46e59-dacd-4d6b-80b7-b7a342a563aa" containerName="authorino" Jun 10 13:10:59.567546 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.567475 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:59.570566 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.570551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:10:59.573219 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.573199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:10:59.573388 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.573372 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:10:59.574279 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.574263 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jv2nn\"" Jun 10 13:10:59.589892 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.589865 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c55dfb4bd-h78gg"] Jun 10 13:10:59.673642 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.673599 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:59.713897 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.713869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9n7c\" (UniqueName: \"kubernetes.io/projected/6a23103b-2075-4d1f-86fd-d5cecac79d6c-kube-api-access-j9n7c\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:10:59.714090 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.714007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:10:59.764015 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.763975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:10:59.764987 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.764962 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7845675977-bl6jn"] Jun 10 13:10:59.768671 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.768651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:10:59.781939 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.781916 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7845675977-bl6jn"] Jun 10 13:10:59.814737 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.814697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9n7c\" (UniqueName: \"kubernetes.io/projected/6a23103b-2075-4d1f-86fd-d5cecac79d6c-kube-api-access-j9n7c\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:10:59.814915 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.814792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:10:59.814997 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:10:59.814964 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 13:10:59.815058 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:10:59.815040 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert podName:6a23103b-2075-4d1f-86fd-d5cecac79d6c nodeName:}" failed. No retries permitted until 2026-06-10 13:11:00.315014717 +0000 UTC m=+595.506452927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert") pod "maas-controller-5c55dfb4bd-h78gg" (UID: "6a23103b-2075-4d1f-86fd-d5cecac79d6c") : secret "maas-controller-webhook-cert" not found Jun 10 13:10:59.824400 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.824323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9n7c\" (UniqueName: \"kubernetes.io/projected/6a23103b-2075-4d1f-86fd-d5cecac79d6c-kube-api-access-j9n7c\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:10:59.915961 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.915932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg6f8\" (UniqueName: \"kubernetes.io/projected/d2f28c68-830a-44e2-9413-871a1a1b9bbf-kube-api-access-bg6f8\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:10:59.916116 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:10:59.916076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.016718 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.016684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.016871 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.016736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg6f8\" (UniqueName: \"kubernetes.io/projected/d2f28c68-830a-44e2-9413-871a1a1b9bbf-kube-api-access-bg6f8\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.016871 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:11:00.016824 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 13:11:00.016937 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:11:00.016894 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert podName:d2f28c68-830a-44e2-9413-871a1a1b9bbf nodeName:}" failed. No retries permitted until 2026-06-10 13:11:00.516878142 +0000 UTC m=+595.708316334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert") pod "maas-controller-7845675977-bl6jn" (UID: "d2f28c68-830a-44e2-9413-871a1a1b9bbf") : secret "maas-controller-webhook-cert" not found Jun 10 13:11:00.034099 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.027433 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg6f8\" (UniqueName: \"kubernetes.io/projected/d2f28c68-830a-44e2-9413-871a1a1b9bbf-kube-api-access-bg6f8\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.263984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.263946 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:00.318904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.318874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:00.321230 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.321212 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert\") pod \"maas-controller-5c55dfb4bd-h78gg\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:00.481751 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.481718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:00.521734 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.521661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.524102 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.524073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert\") pod \"maas-controller-7845675977-bl6jn\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.624088 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.624059 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c55dfb4bd-h78gg"] Jun 10 13:11:00.625826 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:11:00.625799 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a23103b_2075_4d1f_86fd_d5cecac79d6c.slice/crio-68bbdb6e6b929fd38bd1ce41f9ae92d6379a4e4640349e506f0fd1ad1b744745 WatchSource:0}: Error finding container 68bbdb6e6b929fd38bd1ce41f9ae92d6379a4e4640349e506f0fd1ad1b744745: Status 404 returned error can't find the container with id 68bbdb6e6b929fd38bd1ce41f9ae92d6379a4e4640349e506f0fd1ad1b744745 Jun 10 13:11:00.680509 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.680476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:00.815777 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.815750 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7845675977-bl6jn"] Jun 10 13:11:00.818118 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:11:00.818087 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f28c68_830a_44e2_9413_871a1a1b9bbf.slice/crio-edac3bed86a3ef459c8f561182d9918b4ff439e246b8762df2a1f0f29da5cdbc WatchSource:0}: Error finding container edac3bed86a3ef459c8f561182d9918b4ff439e246b8762df2a1f0f29da5cdbc: Status 404 returned error can't find the container with id edac3bed86a3ef459c8f561182d9918b4ff439e246b8762df2a1f0f29da5cdbc Jun 10 13:11:00.903708 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.903671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845675977-bl6jn" event={"ID":"d2f28c68-830a-44e2-9413-871a1a1b9bbf","Type":"ContainerStarted","Data":"edac3bed86a3ef459c8f561182d9918b4ff439e246b8762df2a1f0f29da5cdbc"} Jun 10 13:11:00.904708 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:00.904686 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" event={"ID":"6a23103b-2075-4d1f-86fd-d5cecac79d6c","Type":"ContainerStarted","Data":"68bbdb6e6b929fd38bd1ce41f9ae92d6379a4e4640349e506f0fd1ad1b744745"} Jun 10 13:11:03.720056 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:03.719965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:03.923873 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:03.923835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" event={"ID":"6a23103b-2075-4d1f-86fd-d5cecac79d6c","Type":"ContainerStarted","Data":"afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83"} Jun 10 13:11:03.924052 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:03.923900 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:03.925356 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:03.925333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845675977-bl6jn" event={"ID":"d2f28c68-830a-44e2-9413-871a1a1b9bbf","Type":"ContainerStarted","Data":"28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6"} Jun 10 13:11:03.925478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:03.925465 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:03.953899 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:03.953850 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" podStartSLOduration=2.145604121 podStartE2EDuration="4.953836649s" totalImagesPullingTime="2.808232528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:03.953347362 +0000 UTC m=+599.144785577" watchObservedRunningTime="2026-06-10 13:11:03.953836649 +0000 UTC m=+599.145274863" Jun 10 13:11:05.020547 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:05.020485 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:14.935388 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:14.935352 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:14.935870 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:14.935422 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:11:14.960834 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:14.960780 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7845675977-bl6jn" podStartSLOduration=13.355522726 podStartE2EDuration="15.960763347s" totalImagesPullingTime="2.605240621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:03.993573251 +0000 UTC m=+599.185011464" watchObservedRunningTime="2026-06-10 13:11:14.960763347 +0000 UTC m=+610.152201560" Jun 10 13:11:15.012322 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.012286 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c55dfb4bd-h78gg"] Jun 10 13:11:15.012557 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.012487 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" podUID="6a23103b-2075-4d1f-86fd-d5cecac79d6c" containerName="manager" containerID="cri-o://afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83" gracePeriod=30 Jun 10 13:11:15.258993 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.258969 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:15.358526 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.358495 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert\") pod \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " Jun 10 13:11:15.358680 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.358627 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9n7c\" (UniqueName: \"kubernetes.io/projected/6a23103b-2075-4d1f-86fd-d5cecac79d6c-kube-api-access-j9n7c\") pod \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\" (UID: \"6a23103b-2075-4d1f-86fd-d5cecac79d6c\") " Jun 10 13:11:15.360668 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.360644 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6a23103b-2075-4d1f-86fd-d5cecac79d6c" (UID: "6a23103b-2075-4d1f-86fd-d5cecac79d6c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:11:15.360770 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.360754 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a23103b-2075-4d1f-86fd-d5cecac79d6c-kube-api-access-j9n7c" (OuterVolumeSpecName: "kube-api-access-j9n7c") pod "6a23103b-2075-4d1f-86fd-d5cecac79d6c" (UID: "6a23103b-2075-4d1f-86fd-d5cecac79d6c"). InnerVolumeSpecName "kube-api-access-j9n7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:11:15.460050 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.460024 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9n7c\" (UniqueName: \"kubernetes.io/projected/6a23103b-2075-4d1f-86fd-d5cecac79d6c-kube-api-access-j9n7c\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:11:15.460050 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.460050 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a23103b-2075-4d1f-86fd-d5cecac79d6c-webhook-cert\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:11:15.982469 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.982438 2562 generic.go:356] "Generic (PLEG): container finished" podID="6a23103b-2075-4d1f-86fd-d5cecac79d6c" containerID="afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83" exitCode=0 Jun 10 13:11:15.982880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.982482 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" Jun 10 13:11:15.982880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.982540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" event={"ID":"6a23103b-2075-4d1f-86fd-d5cecac79d6c","Type":"ContainerDied","Data":"afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83"} Jun 10 13:11:15.982880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.982598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c55dfb4bd-h78gg" event={"ID":"6a23103b-2075-4d1f-86fd-d5cecac79d6c","Type":"ContainerDied","Data":"68bbdb6e6b929fd38bd1ce41f9ae92d6379a4e4640349e506f0fd1ad1b744745"} Jun 10 13:11:15.982880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.982622 2562 scope.go:117] "RemoveContainer" containerID="afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83" Jun 10 13:11:15.991684 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.991669 2562 scope.go:117] "RemoveContainer" containerID="afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83" Jun 10 13:11:15.991917 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:11:15.991902 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83\": container with ID starting with afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83 not found: ID does not exist" containerID="afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83" Jun 10 13:11:15.991966 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:15.991925 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83"} err="failed to get container status \"afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83\": rpc error: code = NotFound desc = could not find container \"afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83\": container with ID starting with afe8b2c8538aba1ad4350daa73fbeb2f07825bb3a1eb50b7ed5b5a4c6f6f3b83 not found: ID does not exist" Jun 10 13:11:16.005643 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:16.005616 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c55dfb4bd-h78gg"] Jun 10 13:11:16.009376 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:16.009352 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c55dfb4bd-h78gg"] Jun 10 13:11:17.277728 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:17.277693 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a23103b-2075-4d1f-86fd-d5cecac79d6c" path="/var/lib/kubelet/pods/6a23103b-2075-4d1f-86fd-d5cecac79d6c/volumes" Jun 10 13:11:35.018043 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.017954 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:35.195781 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.195748 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d96b7b6bc-lks8h"] Jun 10 13:11:35.196167 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.196155 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a23103b-2075-4d1f-86fd-d5cecac79d6c" containerName="manager" Jun 10 13:11:35.196209 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.196169 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a23103b-2075-4d1f-86fd-d5cecac79d6c" containerName="manager" Jun 10 13:11:35.196242 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.196237 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a23103b-2075-4d1f-86fd-d5cecac79d6c" containerName="manager" Jun 10 13:11:35.197707 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.197678 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:35.203037 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.203019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.207856 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.207833 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-248v2\"" Jun 10 13:11:35.207856 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.207832 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 13:11:35.224082 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.224054 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d96b7b6bc-lks8h"] Jun 10 13:11:35.337637 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.337554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ztc6\" (UniqueName: \"kubernetes.io/projected/765ed1fd-bbf4-4844-9118-b2d1e68258fd-kube-api-access-2ztc6\") pod \"maas-api-5d96b7b6bc-lks8h\" (UID: \"765ed1fd-bbf4-4844-9118-b2d1e68258fd\") " pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.337637 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.337595 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/765ed1fd-bbf4-4844-9118-b2d1e68258fd-maas-api-tls\") pod \"maas-api-5d96b7b6bc-lks8h\" (UID: \"765ed1fd-bbf4-4844-9118-b2d1e68258fd\") " pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.438205 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.438172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ztc6\" (UniqueName: \"kubernetes.io/projected/765ed1fd-bbf4-4844-9118-b2d1e68258fd-kube-api-access-2ztc6\") pod \"maas-api-5d96b7b6bc-lks8h\" (UID: \"765ed1fd-bbf4-4844-9118-b2d1e68258fd\") " pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.438205 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.438208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/765ed1fd-bbf4-4844-9118-b2d1e68258fd-maas-api-tls\") pod \"maas-api-5d96b7b6bc-lks8h\" (UID: \"765ed1fd-bbf4-4844-9118-b2d1e68258fd\") " pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.441099 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.441072 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/765ed1fd-bbf4-4844-9118-b2d1e68258fd-maas-api-tls\") pod \"maas-api-5d96b7b6bc-lks8h\" (UID: \"765ed1fd-bbf4-4844-9118-b2d1e68258fd\") " pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.454481 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.454449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ztc6\" (UniqueName: \"kubernetes.io/projected/765ed1fd-bbf4-4844-9118-b2d1e68258fd-kube-api-access-2ztc6\") pod \"maas-api-5d96b7b6bc-lks8h\" (UID: \"765ed1fd-bbf4-4844-9118-b2d1e68258fd\") " pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.513149 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.513119 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:35.648950 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.648922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:35.658489 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.658464 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d96b7b6bc-lks8h"] Jun 10 13:11:35.664004 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:11:35.663932 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765ed1fd_bbf4_4844_9118_b2d1e68258fd.slice/crio-0895f03bdf117167d04c3617c99d7767f8987f04587f601bbd2cea2e5949b1a1 WatchSource:0}: Error finding container 0895f03bdf117167d04c3617c99d7767f8987f04587f601bbd2cea2e5949b1a1: Status 404 returned error can't find the container with id 0895f03bdf117167d04c3617c99d7767f8987f04587f601bbd2cea2e5949b1a1 Jun 10 13:11:35.666219 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.666198 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:11:35.752349 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.752309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:35.781818 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.781785 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-mzddf"] Jun 10 13:11:35.786748 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.786724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:35.792454 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.792435 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 13:11:35.793456 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.793422 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-dnvf4"] Jun 10 13:11:35.798063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.798043 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:35.800637 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.800617 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c9mmw\"" Jun 10 13:11:35.801396 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.801373 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-mzddf"] Jun 10 13:11:35.814312 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.814290 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-dnvf4"] Jun 10 13:11:35.943414 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.943376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlwf7\" (UniqueName: \"kubernetes.io/projected/38d9591e-ca5d-4d88-ad21-de3406c02a1e-kube-api-access-wlwf7\") pod \"payload-processing-7c6c859784-dnvf4\" (UID: \"38d9591e-ca5d-4d88-ad21-de3406c02a1e\") " pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:35.943622 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:35.943434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfwd\" (UniqueName: \"kubernetes.io/projected/1ddca541-59b2-4302-a37d-cf678eb4757f-kube-api-access-fwfwd\") pod \"payload-pre-processing-67d7689b65-mzddf\" (UID: \"1ddca541-59b2-4302-a37d-cf678eb4757f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:36.044896 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.044861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwf7\" (UniqueName: \"kubernetes.io/projected/38d9591e-ca5d-4d88-ad21-de3406c02a1e-kube-api-access-wlwf7\") pod \"payload-processing-7c6c859784-dnvf4\" (UID: \"38d9591e-ca5d-4d88-ad21-de3406c02a1e\") " pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:36.045311 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.044930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfwd\" (UniqueName: \"kubernetes.io/projected/1ddca541-59b2-4302-a37d-cf678eb4757f-kube-api-access-fwfwd\") pod \"payload-pre-processing-67d7689b65-mzddf\" (UID: \"1ddca541-59b2-4302-a37d-cf678eb4757f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:36.054741 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.054714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfwd\" (UniqueName: \"kubernetes.io/projected/1ddca541-59b2-4302-a37d-cf678eb4757f-kube-api-access-fwfwd\") pod \"payload-pre-processing-67d7689b65-mzddf\" (UID: \"1ddca541-59b2-4302-a37d-cf678eb4757f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:36.055030 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.055010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwf7\" (UniqueName: \"kubernetes.io/projected/38d9591e-ca5d-4d88-ad21-de3406c02a1e-kube-api-access-wlwf7\") pod \"payload-processing-7c6c859784-dnvf4\" (UID: \"38d9591e-ca5d-4d88-ad21-de3406c02a1e\") " pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:36.077746 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.077716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" event={"ID":"765ed1fd-bbf4-4844-9118-b2d1e68258fd","Type":"ContainerStarted","Data":"0895f03bdf117167d04c3617c99d7767f8987f04587f601bbd2cea2e5949b1a1"} Jun 10 13:11:36.098101 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.098069 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:36.111422 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.111395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:36.265768 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.265744 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-mzddf"] Jun 10 13:11:36.268799 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:11:36.268770 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ddca541_59b2_4302_a37d_cf678eb4757f.slice/crio-6bf8a757c68a00d2355bb96911d616650847f5762b01950216305538cad9926b WatchSource:0}: Error finding container 6bf8a757c68a00d2355bb96911d616650847f5762b01950216305538cad9926b: Status 404 returned error can't find the container with id 6bf8a757c68a00d2355bb96911d616650847f5762b01950216305538cad9926b Jun 10 13:11:36.289910 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:36.289831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-dnvf4"] Jun 10 13:11:36.292086 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:11:36.292029 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d9591e_ca5d_4d88_ad21_de3406c02a1e.slice/crio-590801433ae12bc3b047a54349e77857f10f29745778061f942d55f7cf99da98 WatchSource:0}: Error finding container 590801433ae12bc3b047a54349e77857f10f29745778061f942d55f7cf99da98: Status 404 returned error can't find the container with id 590801433ae12bc3b047a54349e77857f10f29745778061f942d55f7cf99da98 Jun 10 13:11:37.096090 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:37.096015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerStarted","Data":"590801433ae12bc3b047a54349e77857f10f29745778061f942d55f7cf99da98"} Jun 10 13:11:37.098166 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:37.098098 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" event={"ID":"1ddca541-59b2-4302-a37d-cf678eb4757f","Type":"ContainerStarted","Data":"6bf8a757c68a00d2355bb96911d616650847f5762b01950216305538cad9926b"} Jun 10 13:11:39.119991 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.119953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" event={"ID":"1ddca541-59b2-4302-a37d-cf678eb4757f","Type":"ContainerStarted","Data":"5532c9c2e8b583b9c85bbf500818446630c5237706b663838496da66cbbd8a52"} Jun 10 13:11:39.120436 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.120083 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:39.121501 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.121477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" event={"ID":"765ed1fd-bbf4-4844-9118-b2d1e68258fd","Type":"ContainerStarted","Data":"d21f8fc4cafbf6748a2cc0b9ff5887b8b8f60ff5c03da955e61a113f1b702a33"} Jun 10 13:11:39.121633 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.121577 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:39.122952 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.122889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerStarted","Data":"8f6b30f0893cc929ecedc446ef22ed8504c81dec70fb387cb25c2a2ef5c3dbf8"} Jun 10 13:11:39.123099 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.123020 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:39.142536 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.142483 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" podStartSLOduration=2.3672284 podStartE2EDuration="4.1424704s" totalImagesPullingTime="1.775242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:39.141335404 +0000 UTC m=+634.332773656" watchObservedRunningTime="2026-06-10 13:11:39.1424704 +0000 UTC m=+634.333908608" Jun 10 13:11:39.169821 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.169768 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" podStartSLOduration=1.8466969149999999 podStartE2EDuration="4.169736406s" totalImagesPullingTime="2.323039491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:39.168303833 +0000 UTC m=+634.359742049" watchObservedRunningTime="2026-06-10 13:11:39.169736406 +0000 UTC m=+634.361174624" Jun 10 13:11:39.197071 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:39.197029 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podStartSLOduration=2.447157267 podStartE2EDuration="4.197011416s" totalImagesPullingTime="1.749854149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:39.196085645 +0000 UTC m=+634.387523859" watchObservedRunningTime="2026-06-10 13:11:39.197011416 +0000 UTC m=+634.388449629" Jun 10 13:11:42.458679 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:42.458639 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-69lbb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 10 13:11:42.459124 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:42.458691 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" podUID="cf9a7b2d-3f64-439f-b32d-966318b7a71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 10 13:11:44.149102 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:44.149066 2562 generic.go:356] "Generic (PLEG): container finished" podID="cf9a7b2d-3f64-439f-b32d-966318b7a71f" containerID="d266a074000169df7acde2e34ef77e95b455d4158d90eaf891daf8692f536343" exitCode=0 Jun 10 13:11:44.149501 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:44.149138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" event={"ID":"cf9a7b2d-3f64-439f-b32d-966318b7a71f","Type":"ContainerDied","Data":"d266a074000169df7acde2e34ef77e95b455d4158d90eaf891daf8692f536343"} Jun 10 13:11:44.149570 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:44.149542 2562 scope.go:117] "RemoveContainer" containerID="d266a074000169df7acde2e34ef77e95b455d4158d90eaf891daf8692f536343" Jun 10 13:11:44.152899 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:44.152863 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:11:44.153020 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:44.152948 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:11:44.153020 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:44.152999 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:11:45.134761 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:45.134731 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d96b7b6bc-lks8h" Jun 10 13:11:45.155797 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:45.155765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" event={"ID":"cf9a7b2d-3f64-439f-b32d-966318b7a71f","Type":"ContainerStarted","Data":"c74c53d830d397c6c7a66aa34c6eb369a4db519863e5ab3613d5ff604517d025"} Jun 10 13:11:46.091059 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:46.091024 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:11:46.091257 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:46.091236 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-69lbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 10 13:11:46.091305 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:46.091283 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" podUID="cf9a7b2d-3f64-439f-b32d-966318b7a71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 10 13:11:46.885799 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:46.885762 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:46.886186 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:46.885966 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" containerID="cri-o://a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca" gracePeriod=30 Jun 10 13:11:47.091684 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:47.091651 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-69lbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 10 13:11:47.091860 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:47.091707 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" podUID="cf9a7b2d-3f64-439f-b32d-966318b7a71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 10 13:11:48.091815 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:48.091778 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-69lbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 10 13:11:48.092188 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:48.091837 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" podUID="cf9a7b2d-3f64-439f-b32d-966318b7a71f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 10 13:11:48.549871 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:48.549845 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:48.584187 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:48.584149 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hr68\" (UniqueName: \"kubernetes.io/projected/3dd597d4-c982-4910-ad1d-5af0a8d2646c-kube-api-access-2hr68\") pod \"3dd597d4-c982-4910-ad1d-5af0a8d2646c\" (UID: \"3dd597d4-c982-4910-ad1d-5af0a8d2646c\") " Jun 10 13:11:48.586444 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:48.586410 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dd597d4-c982-4910-ad1d-5af0a8d2646c-kube-api-access-2hr68" (OuterVolumeSpecName: "kube-api-access-2hr68") pod "3dd597d4-c982-4910-ad1d-5af0a8d2646c" (UID: "3dd597d4-c982-4910-ad1d-5af0a8d2646c"). InnerVolumeSpecName "kube-api-access-2hr68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:11:48.685460 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:48.685427 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hr68\" (UniqueName: \"kubernetes.io/projected/3dd597d4-c982-4910-ad1d-5af0a8d2646c-kube-api-access-2hr68\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:11:49.094745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.094665 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:11:49.095138 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.095032 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:11:49.095829 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.095806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-69lbb" Jun 10 13:11:49.185733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.185702 2562 generic.go:356] "Generic (PLEG): container finished" podID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerID="a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca" exitCode=143 Jun 10 13:11:49.185904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.185762 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.185904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.185792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3dd597d4-c982-4910-ad1d-5af0a8d2646c","Type":"ContainerDied","Data":"a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca"} Jun 10 13:11:49.185904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.185857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3dd597d4-c982-4910-ad1d-5af0a8d2646c","Type":"ContainerDied","Data":"030409fd3db014b2f6733a0d3b61a5242b1c6a4af7a29cbdf3a365a2a022b4d0"} Jun 10 13:11:49.185904 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.185889 2562 scope.go:117] "RemoveContainer" containerID="a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca" Jun 10 13:11:49.196286 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.196268 2562 scope.go:117] "RemoveContainer" containerID="a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca" Jun 10 13:11:49.196640 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:11:49.196608 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca\": container with ID starting with a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca not found: ID does not exist" containerID="a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca" Jun 10 13:11:49.196745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.196652 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca"} err="failed to get container status \"a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca\": rpc error: code = NotFound desc = could not find container \"a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca\": container with ID starting with a943aa203b14b8c177c131d5758d1c02f823561384170d9e721bd31e8dd872ca not found: ID does not exist" Jun 10 13:11:49.210851 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.210827 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:49.213561 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.213487 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:49.241646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.241624 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:49.242081 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.242065 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" Jun 10 13:11:49.242158 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.242082 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" Jun 10 13:11:49.242201 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.242190 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" containerName="keycloak" Jun 10 13:11:49.244824 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.244809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.248486 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.248465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 13:11:49.248600 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.248509 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:11:49.248658 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.248624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:11:49.248710 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.248685 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-p5p9z\"" Jun 10 13:11:49.248957 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.248941 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:11:49.259540 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.259499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:49.278164 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.278140 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dd597d4-c982-4910-ad1d-5af0a8d2646c" path="/var/lib/kubelet/pods/3dd597d4-c982-4910-ad1d-5af0a8d2646c/volumes" Jun 10 13:11:49.289637 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.289613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj99m\" (UniqueName: \"kubernetes.io/projected/d14c639e-e83b-4f4f-ae91-c92c36542744-kube-api-access-rj99m\") pod \"maas-keycloak-0\" (UID: \"d14c639e-e83b-4f4f-ae91-c92c36542744\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.289728 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.289648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d14c639e-e83b-4f4f-ae91-c92c36542744-test-realms\") pod \"maas-keycloak-0\" (UID: \"d14c639e-e83b-4f4f-ae91-c92c36542744\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.390380 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.390316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj99m\" (UniqueName: \"kubernetes.io/projected/d14c639e-e83b-4f4f-ae91-c92c36542744-kube-api-access-rj99m\") pod \"maas-keycloak-0\" (UID: \"d14c639e-e83b-4f4f-ae91-c92c36542744\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.390380 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.390350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d14c639e-e83b-4f4f-ae91-c92c36542744-test-realms\") pod \"maas-keycloak-0\" (UID: \"d14c639e-e83b-4f4f-ae91-c92c36542744\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.391078 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.391060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d14c639e-e83b-4f4f-ae91-c92c36542744-test-realms\") pod \"maas-keycloak-0\" (UID: \"d14c639e-e83b-4f4f-ae91-c92c36542744\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.401548 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.401501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj99m\" (UniqueName: \"kubernetes.io/projected/d14c639e-e83b-4f4f-ae91-c92c36542744-kube-api-access-rj99m\") pod \"maas-keycloak-0\" (UID: \"d14c639e-e83b-4f4f-ae91-c92c36542744\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.555202 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.555172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:49.690260 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:49.690235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:49.692738 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:11:49.692710 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14c639e_e83b_4f4f_ae91_c92c36542744.slice/crio-8e066d8613bd6681e355f02d832fe1635b899ec48c6266e40ac350fb2a3e99ff WatchSource:0}: Error finding container 8e066d8613bd6681e355f02d832fe1635b899ec48c6266e40ac350fb2a3e99ff: Status 404 returned error can't find the container with id 8e066d8613bd6681e355f02d832fe1635b899ec48c6266e40ac350fb2a3e99ff Jun 10 13:11:50.130575 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:50.130474 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-mzddf" Jun 10 13:11:50.130909 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:50.130677 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:11:50.194574 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:50.194541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d14c639e-e83b-4f4f-ae91-c92c36542744","Type":"ContainerStarted","Data":"8e066d8613bd6681e355f02d832fe1635b899ec48c6266e40ac350fb2a3e99ff"} Jun 10 13:11:51.202005 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:51.201967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d14c639e-e83b-4f4f-ae91-c92c36542744","Type":"ContainerStarted","Data":"4189d886376914bc9d095761601fc456f044c4ea0b7fa55938fa303861d4845c"} Jun 10 13:11:51.223787 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:51.223710 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6773593839999998 podStartE2EDuration="2.223689245s" totalImagesPullingTime="546.329861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:51.22329592 +0000 UTC m=+646.414734134" watchObservedRunningTime="2026-06-10 13:11:51.223689245 +0000 UTC m=+646.415127461" Jun 10 13:11:51.556450 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:51.556355 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:51.558326 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:51.558288 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:52.555844 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:52.555800 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:52.893548 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:52.893432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:53.556264 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:53.556190 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:54.556559 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:54.556495 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:55.556406 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:55.556360 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:56.555907 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:56.555849 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:57.556903 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:57.556851 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:58.556432 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:58.556376 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:11:59.555709 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:59.555621 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:59.556125 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:11:59.556032 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:12:00.556084 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:00.556029 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:12:01.556062 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:01.556004 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:12:02.556414 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:02.556354 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 10 13:12:03.683629 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:03.683587 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:12:03.702722 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:03.702675 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d14c639e-e83b-4f4f-ae91-c92c36542744" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:12:13.690191 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:13.690159 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:12:26.921301 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:26.921266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:27.012066 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:27.012029 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:31.931632 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.931602 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2"] Jun 10 13:12:31.935268 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.935250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:31.943060 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.943043 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mp6t6\"" Jun 10 13:12:31.943143 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.943128 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:12:31.944116 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.944101 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 13:12:31.948745 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.948730 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:12:31.963170 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:31.963150 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2"] Jun 10 13:12:32.008603 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.008566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.008759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.008653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.008759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.008673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.008759 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.008696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1426a374-1690-4915-8459-50c49e601b39-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.008881 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.008811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.008925 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.008908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g58bj\" (UniqueName: \"kubernetes.io/projected/1426a374-1690-4915-8459-50c49e601b39-kube-api-access-g58bj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.071738 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.071705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:32.109695 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.109665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.109831 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.109731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.109831 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.109756 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.109831 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.109778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1426a374-1690-4915-8459-50c49e601b39-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.109967 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.109882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.110009 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.109963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g58bj\" (UniqueName: \"kubernetes.io/projected/1426a374-1690-4915-8459-50c49e601b39-kube-api-access-g58bj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.110129 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.110110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.110211 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.110158 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.110298 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.110270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.112000 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.111981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1426a374-1690-4915-8459-50c49e601b39-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.112257 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.112241 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1426a374-1690-4915-8459-50c49e601b39-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.128332 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.128301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g58bj\" (UniqueName: \"kubernetes.io/projected/1426a374-1690-4915-8459-50c49e601b39-kube-api-access-g58bj\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2\" (UID: \"1426a374-1690-4915-8459-50c49e601b39\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.245391 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.245314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:32.415594 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.415463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2"] Jun 10 13:12:32.417967 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:12:32.417943 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1426a374_1690_4915_8459_50c49e601b39.slice/crio-3c81581d7296f59978f10d5a45d31257a5e9c6c763270d6069c668657cde56f2 WatchSource:0}: Error finding container 3c81581d7296f59978f10d5a45d31257a5e9c6c763270d6069c668657cde56f2: Status 404 returned error can't find the container with id 3c81581d7296f59978f10d5a45d31257a5e9c6c763270d6069c668657cde56f2 Jun 10 13:12:32.443685 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:32.443638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" event={"ID":"1426a374-1690-4915-8459-50c49e601b39","Type":"ContainerStarted","Data":"3c81581d7296f59978f10d5a45d31257a5e9c6c763270d6069c668657cde56f2"} Jun 10 13:12:36.993236 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:36.993191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:37.477786 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:37.477735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" event={"ID":"1426a374-1690-4915-8459-50c49e601b39","Type":"ContainerStarted","Data":"7a730631d4a70fd7c5fc4f02d9ff27840cd08caeb04f881de3520237af4f7ba0"} Jun 10 13:12:39.491061 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:39.491027 2562 generic.go:356] "Generic (PLEG): container finished" podID="1426a374-1690-4915-8459-50c49e601b39" containerID="7a730631d4a70fd7c5fc4f02d9ff27840cd08caeb04f881de3520237af4f7ba0" exitCode=0 Jun 10 13:12:39.491442 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:39.491097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" event={"ID":"1426a374-1690-4915-8459-50c49e601b39","Type":"ContainerDied","Data":"7a730631d4a70fd7c5fc4f02d9ff27840cd08caeb04f881de3520237af4f7ba0"} Jun 10 13:12:41.211999 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:41.211957 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:41.504207 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:41.504124 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" event={"ID":"1426a374-1690-4915-8459-50c49e601b39","Type":"ContainerStarted","Data":"fb751daf2025f16e6cd31adfd897d7ca6e33624d6b1034a2c5f21673a8e8a36c"} Jun 10 13:12:41.574558 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:41.574480 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" podStartSLOduration=3.120817637 podStartE2EDuration="10.574464692s" totalImagesPullingTime="6.159596026s" totalInitContainerRuntime="1.294051029s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:41.573035063 +0000 UTC m=+696.764473278" watchObservedRunningTime="2026-06-10 13:12:41.574464692 +0000 UTC m=+696.765902952" Jun 10 13:12:42.246308 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:42.246275 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:42.246719 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:42.246330 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:42.258717 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:42.258693 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:42.520236 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:42.520158 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2" Jun 10 13:12:50.633949 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:50.633904 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:50.713384 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:50.713354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:57.737699 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.737610 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc"] Jun 10 13:12:57.741452 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.741431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.744435 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.744415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 13:12:57.764327 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.764302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc"] Jun 10 13:12:57.785330 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.785297 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:57.852348 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.852315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.852494 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.852370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.852494 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.852403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dc1c43-e589-42c6-98d4-a4f3754b68d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.852494 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.852435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.852646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.852498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.852646 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.852550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76fqf\" (UniqueName: \"kubernetes.io/projected/59dc1c43-e589-42c6-98d4-a4f3754b68d4-kube-api-access-76fqf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953280 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dc1c43-e589-42c6-98d4-a4f3754b68d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953457 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953303 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953457 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953457 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76fqf\" (UniqueName: \"kubernetes.io/projected/59dc1c43-e589-42c6-98d4-a4f3754b68d4-kube-api-access-76fqf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953457 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953661 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953784 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953850 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953800 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.953901 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.953873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.955727 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.955704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59dc1c43-e589-42c6-98d4-a4f3754b68d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.955967 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.955950 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59dc1c43-e589-42c6-98d4-a4f3754b68d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:57.963625 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:57.963606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76fqf\" (UniqueName: \"kubernetes.io/projected/59dc1c43-e589-42c6-98d4-a4f3754b68d4-kube-api-access-76fqf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc\" (UID: \"59dc1c43-e589-42c6-98d4-a4f3754b68d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:58.053566 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:58.053497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:12:58.188527 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:58.188486 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc"] Jun 10 13:12:58.190593 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:12:58.190566 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dc1c43_e589_42c6_98d4_a4f3754b68d4.slice/crio-48646085ef024eaec3d328f06cd245dbe9bbbbc19a1e79f2afdf67efb562aa9f WatchSource:0}: Error finding container 48646085ef024eaec3d328f06cd245dbe9bbbbc19a1e79f2afdf67efb562aa9f: Status 404 returned error can't find the container with id 48646085ef024eaec3d328f06cd245dbe9bbbbc19a1e79f2afdf67efb562aa9f Jun 10 13:12:58.590634 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:58.590594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" event={"ID":"59dc1c43-e589-42c6-98d4-a4f3754b68d4","Type":"ContainerStarted","Data":"ca1dcb44bad41730728b57a6cee64abdf04eafbdda17b130ef50e33a19c1c451"} Jun 10 13:12:58.590809 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:58.590659 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" event={"ID":"59dc1c43-e589-42c6-98d4-a4f3754b68d4","Type":"ContainerStarted","Data":"48646085ef024eaec3d328f06cd245dbe9bbbbc19a1e79f2afdf67efb562aa9f"} Jun 10 13:12:59.599199 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:59.599170 2562 generic.go:356] "Generic (PLEG): container finished" podID="59dc1c43-e589-42c6-98d4-a4f3754b68d4" containerID="ca1dcb44bad41730728b57a6cee64abdf04eafbdda17b130ef50e33a19c1c451" exitCode=0 Jun 10 13:12:59.599585 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:12:59.599260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" event={"ID":"59dc1c43-e589-42c6-98d4-a4f3754b68d4","Type":"ContainerDied","Data":"ca1dcb44bad41730728b57a6cee64abdf04eafbdda17b130ef50e33a19c1c451"} Jun 10 13:13:00.606781 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:00.606745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" event={"ID":"59dc1c43-e589-42c6-98d4-a4f3754b68d4","Type":"ContainerStarted","Data":"802a6f6033fee924ae24e2b2362bce5ee84168f4281e5dd68eefd6d5d670bd23"} Jun 10 13:13:00.631227 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:00.631173 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" podStartSLOduration=2.115477892 podStartE2EDuration="3.631155688s" totalImagesPullingTime="302.647795ms" totalInitContainerRuntime="1.213030001s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:00.62867582 +0000 UTC m=+715.820114034" watchObservedRunningTime="2026-06-10 13:13:00.631155688 +0000 UTC m=+715.822593902" Jun 10 13:13:02.254042 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:02.254002 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:13:08.053986 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:08.053945 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:13:08.054587 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:08.054041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:13:08.066763 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:08.066740 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:13:08.657436 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:08.657398 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc" Jun 10 13:13:24.684390 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.684350 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw"] Jun 10 13:13:24.689359 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.689339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.693800 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.693774 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 13:13:24.699059 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.699032 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw"] Jun 10 13:13:24.785852 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.785813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:13:24.789933 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.789909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.790011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.789948 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.790069 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.790038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr9ln\" (UniqueName: \"kubernetes.io/projected/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-kube-api-access-zr9ln\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.790069 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.790065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.790152 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.790099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.790152 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.790141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.891687 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.891633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.891880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.891716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.891880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.891784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.891880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.891835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.891880 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.891868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.892163 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.891957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr9ln\" (UniqueName: \"kubernetes.io/projected/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-kube-api-access-zr9ln\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.892163 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.892095 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.892273 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.892210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.892323 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.892286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.894105 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.894084 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.894412 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.894392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:24.900977 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:24.900957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr9ln\" (UniqueName: \"kubernetes.io/projected/d969d657-12f1-4ba5-beb7-e1b8d7f8455f-kube-api-access-zr9ln\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lnsfw\" (UID: \"d969d657-12f1-4ba5-beb7-e1b8d7f8455f\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:25.000766 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:25.000670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:25.145901 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:13:25.145872 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd969d657_12f1_4ba5_beb7_e1b8d7f8455f.slice/crio-e9a63a036cce0e642cc5fde2d95cb25eacfbe5def94ab093fff2a95326030abc WatchSource:0}: Error finding container e9a63a036cce0e642cc5fde2d95cb25eacfbe5def94ab093fff2a95326030abc: Status 404 returned error can't find the container with id e9a63a036cce0e642cc5fde2d95cb25eacfbe5def94ab093fff2a95326030abc Jun 10 13:13:25.147049 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:25.147029 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw"] Jun 10 13:13:25.730043 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:25.730000 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" event={"ID":"d969d657-12f1-4ba5-beb7-e1b8d7f8455f","Type":"ContainerStarted","Data":"33e40904dc2d7708bd470d6b3cdf0f459f311891ae2eafa69fa3dd2651ad5d08"} Jun 10 13:13:25.730450 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:25.730054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" event={"ID":"d969d657-12f1-4ba5-beb7-e1b8d7f8455f","Type":"ContainerStarted","Data":"e9a63a036cce0e642cc5fde2d95cb25eacfbe5def94ab093fff2a95326030abc"} Jun 10 13:13:26.737263 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:26.737227 2562 generic.go:356] "Generic (PLEG): container finished" podID="d969d657-12f1-4ba5-beb7-e1b8d7f8455f" containerID="33e40904dc2d7708bd470d6b3cdf0f459f311891ae2eafa69fa3dd2651ad5d08" exitCode=0 Jun 10 13:13:26.737647 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:26.737271 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" event={"ID":"d969d657-12f1-4ba5-beb7-e1b8d7f8455f","Type":"ContainerDied","Data":"33e40904dc2d7708bd470d6b3cdf0f459f311891ae2eafa69fa3dd2651ad5d08"} Jun 10 13:13:27.744945 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:27.744910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" event={"ID":"d969d657-12f1-4ba5-beb7-e1b8d7f8455f","Type":"ContainerStarted","Data":"72b8377d3d3bd50a679581434f519977925a489705ca2027892a2d72b19b69ce"} Jun 10 13:13:27.771319 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:27.771266 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" podStartSLOduration=2.137367689 podStartE2EDuration="3.77125015s" totalImagesPullingTime="263.879654ms" totalInitContainerRuntime="1.370002807s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:27.770669126 +0000 UTC m=+742.962107351" watchObservedRunningTime="2026-06-10 13:13:27.77125015 +0000 UTC m=+742.962688363" Jun 10 13:13:35.000979 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:35.000935 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:35.000979 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:35.000987 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:35.013607 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:35.013578 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:35.794846 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:35.794818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lnsfw" Jun 10 13:13:38.799437 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:38.799405 2562 generic.go:356] "Generic (PLEG): container finished" podID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" containerID="8f6b30f0893cc929ecedc446ef22ed8504c81dec70fb387cb25c2a2ef5c3dbf8" exitCode=1 Jun 10 13:13:38.799946 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:38.799483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerDied","Data":"8f6b30f0893cc929ecedc446ef22ed8504c81dec70fb387cb25c2a2ef5c3dbf8"} Jun 10 13:13:38.799946 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:38.799901 2562 scope.go:117] "RemoveContainer" containerID="8f6b30f0893cc929ecedc446ef22ed8504c81dec70fb387cb25c2a2ef5c3dbf8" Jun 10 13:13:39.807035 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:39.806999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerStarted","Data":"bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d"} Jun 10 13:13:39.807412 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:39.807206 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:13:50.814380 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:13:50.814345 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:14:26.597487 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:14:26.597395 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:14:26.696733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:14:26.696699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:14:27.643636 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:14:27.643597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:14:27.743447 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:14:27.743410 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:39.415136 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:39.415053 2562 generic.go:356] "Generic (PLEG): container finished" podID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" containerID="bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d" exitCode=1 Jun 10 13:15:39.415136 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:39.415104 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerDied","Data":"bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d"} Jun 10 13:15:39.415692 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:39.415154 2562 scope.go:117] "RemoveContainer" containerID="8f6b30f0893cc929ecedc446ef22ed8504c81dec70fb387cb25c2a2ef5c3dbf8" Jun 10 13:15:39.415692 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:39.415428 2562 scope.go:117] "RemoveContainer" containerID="bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d" Jun 10 13:15:39.415783 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:15:39.415684 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:15:40.812868 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:40.812833 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:15:40.813258 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:40.813194 2562 scope.go:117] "RemoveContainer" containerID="bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d" Jun 10 13:15:40.813411 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:15:40.813391 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:15:54.905742 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:54.905655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:55.001063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.001019 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7845675977-bl6jn"] Jun 10 13:15:55.001311 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.001278 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7845675977-bl6jn" podUID="d2f28c68-830a-44e2-9413-871a1a1b9bbf" containerName="manager" containerID="cri-o://28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6" gracePeriod=30 Jun 10 13:15:55.251554 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.251507 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:15:55.276363 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.276338 2562 scope.go:117] "RemoveContainer" containerID="bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d" Jun 10 13:15:55.394092 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.394056 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg6f8\" (UniqueName: \"kubernetes.io/projected/d2f28c68-830a-44e2-9413-871a1a1b9bbf-kube-api-access-bg6f8\") pod \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " Jun 10 13:15:55.394251 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.394105 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert\") pod \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\" (UID: \"d2f28c68-830a-44e2-9413-871a1a1b9bbf\") " Jun 10 13:15:55.396295 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.396262 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d2f28c68-830a-44e2-9413-871a1a1b9bbf" (UID: "d2f28c68-830a-44e2-9413-871a1a1b9bbf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:15:55.396295 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.396279 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f28c68-830a-44e2-9413-871a1a1b9bbf-kube-api-access-bg6f8" (OuterVolumeSpecName: "kube-api-access-bg6f8") pod "d2f28c68-830a-44e2-9413-871a1a1b9bbf" (UID: "d2f28c68-830a-44e2-9413-871a1a1b9bbf"). InnerVolumeSpecName "kube-api-access-bg6f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:15:55.495584 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.495556 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d2f28c68-830a-44e2-9413-871a1a1b9bbf-webhook-cert\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:15:55.495584 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.495581 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg6f8\" (UniqueName: \"kubernetes.io/projected/d2f28c68-830a-44e2-9413-871a1a1b9bbf-kube-api-access-bg6f8\") on node \"ip-10-0-128-45.ec2.internal\" DevicePath \"\"" Jun 10 13:15:55.507580 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.507546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerStarted","Data":"b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608"} Jun 10 13:15:55.507789 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.507770 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:15:55.508896 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.508866 2562 generic.go:356] "Generic (PLEG): container finished" podID="d2f28c68-830a-44e2-9413-871a1a1b9bbf" containerID="28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6" exitCode=0 Jun 10 13:15:55.508989 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.508901 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845675977-bl6jn" Jun 10 13:15:55.508989 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.508930 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845675977-bl6jn" event={"ID":"d2f28c68-830a-44e2-9413-871a1a1b9bbf","Type":"ContainerDied","Data":"28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6"} Jun 10 13:15:55.508989 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.508968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845675977-bl6jn" event={"ID":"d2f28c68-830a-44e2-9413-871a1a1b9bbf","Type":"ContainerDied","Data":"edac3bed86a3ef459c8f561182d9918b4ff439e246b8762df2a1f0f29da5cdbc"} Jun 10 13:15:55.509121 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.508992 2562 scope.go:117] "RemoveContainer" containerID="28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6" Jun 10 13:15:55.520497 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.520477 2562 scope.go:117] "RemoveContainer" containerID="28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6" Jun 10 13:15:55.520834 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:15:55.520811 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6\": container with ID starting with 28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6 not found: ID does not exist" containerID="28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6" Jun 10 13:15:55.520921 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.520844 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6"} err="failed to get container status \"28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6\": rpc error: code = NotFound desc = could not find container \"28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6\": container with ID starting with 28036626befdeca2b20d228968c94974e2d1f061d39196af9e766faecf172df6 not found: ID does not exist" Jun 10 13:15:55.539570 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.539542 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7845675977-bl6jn"] Jun 10 13:15:55.543641 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:55.543621 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7845675977-bl6jn"] Jun 10 13:15:56.171666 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.171632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:56.270503 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.270468 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7845675977-n9b7c"] Jun 10 13:15:56.270926 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.270912 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f28c68-830a-44e2-9413-871a1a1b9bbf" containerName="manager" Jun 10 13:15:56.271007 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.270927 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f28c68-830a-44e2-9413-871a1a1b9bbf" containerName="manager" Jun 10 13:15:56.271061 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.271031 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f28c68-830a-44e2-9413-871a1a1b9bbf" containerName="manager" Jun 10 13:15:56.275394 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.275375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.279198 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.279176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jv2nn\"" Jun 10 13:15:56.279323 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.279175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:15:56.279323 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.279287 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:15:56.288415 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.288392 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7845675977-n9b7c"] Jun 10 13:15:56.405443 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.405417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfgk6\" (UniqueName: \"kubernetes.io/projected/a9894a6d-df6b-4136-b513-23681b5bbe73-kube-api-access-dfgk6\") pod \"maas-controller-7845675977-n9b7c\" (UID: \"a9894a6d-df6b-4136-b513-23681b5bbe73\") " pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.405587 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.405449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9894a6d-df6b-4136-b513-23681b5bbe73-webhook-cert\") pod \"maas-controller-7845675977-n9b7c\" (UID: \"a9894a6d-df6b-4136-b513-23681b5bbe73\") " pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.506440 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.506370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfgk6\" (UniqueName: \"kubernetes.io/projected/a9894a6d-df6b-4136-b513-23681b5bbe73-kube-api-access-dfgk6\") pod \"maas-controller-7845675977-n9b7c\" (UID: \"a9894a6d-df6b-4136-b513-23681b5bbe73\") " pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.506440 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.506405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9894a6d-df6b-4136-b513-23681b5bbe73-webhook-cert\") pod \"maas-controller-7845675977-n9b7c\" (UID: \"a9894a6d-df6b-4136-b513-23681b5bbe73\") " pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.508616 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.508596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9894a6d-df6b-4136-b513-23681b5bbe73-webhook-cert\") pod \"maas-controller-7845675977-n9b7c\" (UID: \"a9894a6d-df6b-4136-b513-23681b5bbe73\") " pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.515614 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.515590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfgk6\" (UniqueName: \"kubernetes.io/projected/a9894a6d-df6b-4136-b513-23681b5bbe73-kube-api-access-dfgk6\") pod \"maas-controller-7845675977-n9b7c\" (UID: \"a9894a6d-df6b-4136-b513-23681b5bbe73\") " pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.586619 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.586597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:56.717539 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:56.717494 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7845675977-n9b7c"] Jun 10 13:15:56.719666 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:15:56.719640 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9894a6d_df6b_4136_b513_23681b5bbe73.slice/crio-acb12b7f798abe444d07dfa92058f48e3d5fbca2adfdc89f5bc4fdb38f182357 WatchSource:0}: Error finding container acb12b7f798abe444d07dfa92058f48e3d5fbca2adfdc89f5bc4fdb38f182357: Status 404 returned error can't find the container with id acb12b7f798abe444d07dfa92058f48e3d5fbca2adfdc89f5bc4fdb38f182357 Jun 10 13:15:57.285774 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:57.285737 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f28c68-830a-44e2-9413-871a1a1b9bbf" path="/var/lib/kubelet/pods/d2f28c68-830a-44e2-9413-871a1a1b9bbf/volumes" Jun 10 13:15:57.522196 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:57.522156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845675977-n9b7c" event={"ID":"a9894a6d-df6b-4136-b513-23681b5bbe73","Type":"ContainerStarted","Data":"a4ea4efb94fc21c63300e7f798d7873555af7d5a6266190f2f7e56669c76f9c9"} Jun 10 13:15:57.522376 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:57.522229 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:15:57.522376 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:57.522252 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7845675977-n9b7c" event={"ID":"a9894a6d-df6b-4136-b513-23681b5bbe73","Type":"ContainerStarted","Data":"acb12b7f798abe444d07dfa92058f48e3d5fbca2adfdc89f5bc4fdb38f182357"} Jun 10 13:15:57.541449 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:15:57.541403 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7845675977-n9b7c" podStartSLOduration=1.118004649 podStartE2EDuration="1.54138964s" totalImagesPullingTime="423.384991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:57.538625467 +0000 UTC m=+892.730063682" watchObservedRunningTime="2026-06-10 13:15:57.54138964 +0000 UTC m=+892.732827854" Jun 10 13:16:06.517672 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:06.517641 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:16:08.533895 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:08.533862 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7845675977-n9b7c" Jun 10 13:16:12.042164 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:12.042121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:16:35.953390 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:35.953347 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:16:36.047334 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:36.047297 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:16:44.434268 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:44.434217 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:16:50.148753 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:50.148718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:16:50.248501 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:16:50.248453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:22.221303 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:22.221261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:22.317733 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:22.317696 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:46.144686 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:46.144602 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:52.127380 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:52.127338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:52.233069 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:52.233035 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:52.328999 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:52.328965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:52.488433 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:52.488386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:52.583999 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:52.583964 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:56.112180 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:56.112141 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.36:9004: connect: connection refused" Jun 10 13:17:56.118233 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:56.118207 2562 generic.go:356] "Generic (PLEG): container finished" podID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" containerID="b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608" exitCode=1 Jun 10 13:17:56.118370 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:56.118279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerDied","Data":"b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608"} Jun 10 13:17:56.118370 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:56.118338 2562 scope.go:117] "RemoveContainer" containerID="bf1e08794409830d6a1ac9e452a59479ce7b9028b2337a6b4ff01faa5901176d" Jun 10 13:17:56.118670 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:56.118653 2562 scope.go:117] "RemoveContainer" containerID="b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608" Jun 10 13:17:56.118887 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:17:56.118866 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:17:56.516332 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:56.516298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:17:57.125350 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:57.125324 2562 scope.go:117] "RemoveContainer" containerID="b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608" Jun 10 13:17:57.125759 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:17:57.125509 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:17:59.075895 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:59.075852 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:59.178020 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:17:59.177988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:08.271756 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:08.271725 2562 scope.go:117] "RemoveContainer" containerID="b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608" Jun 10 13:18:08.272121 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:18:08.271998 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:18:08.958096 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:08.958050 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:09.060033 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:09.059987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:09.169019 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:09.168979 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:15.480160 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:15.480120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:15.579219 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:15.579189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:16.112202 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:16.112172 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:18:16.112507 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:16.112494 2562 scope.go:117] "RemoveContainer" containerID="b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608" Jun 10 13:18:16.233363 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:16.233331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerStarted","Data":"0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3"} Jun 10 13:18:16.233583 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:16.233565 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:18:23.623085 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:23.623043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:23.719120 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:23.719079 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:23.819461 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:23.819419 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:23.946467 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:23.946435 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:27.240058 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:27.240025 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:18:40.340005 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:40.339966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:40.444130 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:40.444092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:40.560567 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:40.560509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:46.991233 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:46.991187 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.086313 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:18:47.086269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.452984 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:09.452949 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.557026 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:09.556988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.656887 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:09.656840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:11.534302 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:11.534267 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:15.625608 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:15.625574 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:15.685178 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:15.685139 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:15.775478 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:15.775442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:15.876392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:15.876302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:15.972079 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:15.972047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:21.808095 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:21.807997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:21.879136 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:19:21.879104 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:16.843824 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:16.843787 2562 generic.go:356] "Generic (PLEG): container finished" podID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" exitCode=1 Jun 10 13:20:16.844314 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:16.843857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerDied","Data":"0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3"} Jun 10 13:20:16.844314 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:16.843943 2562 scope.go:117] "RemoveContainer" containerID="b8cd404530be8b65a962be8510050af23d3654203b594c03ecf29ce41f87b608" Jun 10 13:20:16.844314 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:16.844215 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:20:16.844481 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:20:16.844424 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:20:17.238632 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:17.238598 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:20:17.850955 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:17.850927 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:20:17.851356 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:20:17.851144 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:20:33.272770 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:33.272733 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:20:33.273169 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:20:33.272997 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:20:36.111816 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:36.111779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:20:36.112224 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:36.112207 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:20:36.112420 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:20:36.112399 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:20:51.272425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:20:51.272393 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:20:51.272971 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:20:51.272638 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:21:05.275280 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:21:05.275249 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:21:06.099654 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:21:06.099618 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerStarted","Data":"0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64"} Jun 10 13:21:06.099855 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:21:06.099830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:21:17.106534 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:21:17.106481 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:23:05.703236 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:05.703202 2562 generic.go:356] "Generic (PLEG): container finished" podID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" exitCode=1 Jun 10 13:23:05.703693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:05.703244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" event={"ID":"38d9591e-ca5d-4d88-ad21-de3406c02a1e","Type":"ContainerDied","Data":"0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64"} Jun 10 13:23:05.703693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:05.703290 2562 scope.go:117] "RemoveContainer" containerID="0dacbd805e74034cc86e89fd1f61249df57b4d606bd70c71162f9d64ffe018b3" Jun 10 13:23:05.703693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:05.703647 2562 scope.go:117] "RemoveContainer" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" Jun 10 13:23:05.703927 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:23:05.703898 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:23:07.105013 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:07.104974 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:23:07.105502 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:07.105398 2562 scope.go:117] "RemoveContainer" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" Jun 10 13:23:07.105722 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:23:07.105698 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:23:16.112240 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:16.112202 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" Jun 10 13:23:16.112667 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:16.112603 2562 scope.go:117] "RemoveContainer" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" Jun 10 13:23:16.112854 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:23:16.112832 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:23:21.443761 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:21.443726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f476bfb57-25dkt_7726e73b-7d18-49b3-a869-2e8a90aac508/nginx/0.log" Jun 10 13:23:21.979629 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:21.979600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d96b7b6bc-lks8h_765ed1fd-bbf4-4844-9118-b2d1e68258fd/maas-api/0.log" Jun 10 13:23:22.219352 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:22.219322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7845675977-n9b7c_a9894a6d-df6b-4136-b513-23681b5bbe73/manager/0.log" Jun 10 13:23:22.708036 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:22.708007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c_dca72a6a-2488-4c0d-8e23-27f5d0ee334d/copy-manifests/0.log" Jun 10 13:23:22.715954 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:22.715926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c_dca72a6a-2488-4c0d-8e23-27f5d0ee334d/manager/0.log" Jun 10 13:23:24.486158 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:24.486129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vr7cf_47e9072f-3cd2-48a4-8cc2-3944f893a9c2/manager/0.log" Jun 10 13:23:24.618061 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:24.618032 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-p5t7h_acad81e9-dbe3-4f2a-b44e-d95d74f211c1/manager/0.log" Jun 10 13:23:24.872110 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:24.872008 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zc9vg_1292bd94-db0c-4b7c-acf3-49e7fa1ebd21/registry-server/0.log" Jun 10 13:23:25.019100 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:25.019071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xqnf8_0a8aa2d5-097e-4dc6-a85d-7d64c604575b/manager/0.log" Jun 10 13:23:25.615026 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:25.614979 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958x6tv_5218ddd4-1081-4207-a1f5-2026ebe27808/istio-proxy/0.log" Jun 10 13:23:26.097187 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:26.097156 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/1.log" Jun 10 13:23:26.207626 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:26.207595 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-mzddf_1ddca541-59b2-4302-a37d-cf678eb4757f/payload-pre-processing/0.log" Jun 10 13:23:26.333548 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:26.333496 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log" Jun 10 13:23:26.806807 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:26.806763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2_1426a374-1690-4915-8459-50c49e601b39/storage-initializer/0.log" Jun 10 13:23:26.817233 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:26.817206 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-lc7w2_1426a374-1690-4915-8459-50c49e601b39/main/0.log" Jun 10 13:23:27.177829 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:27.177802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc_59dc1c43-e589-42c6-98d4-a4f3754b68d4/main/0.log" Jun 10 13:23:27.186376 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:27.186356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctk5bc_59dc1c43-e589-42c6-98d4-a4f3754b68d4/storage-initializer/0.log" Jun 10 13:23:27.419109 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:27.419069 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lnsfw_d969d657-12f1-4ba5-beb7-e1b8d7f8455f/storage-initializer/0.log" Jun 10 13:23:27.428826 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:27.428750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lnsfw_d969d657-12f1-4ba5-beb7-e1b8d7f8455f/main/0.log" Jun 10 13:23:28.271966 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:28.271932 2562 scope.go:117] "RemoveContainer" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" Jun 10 13:23:28.272403 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:23:28.272240 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:23:31.409707 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:31.409667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:32.580609 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:32.580572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:34.505608 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:34.505577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4vzpr_ccf1f044-8924-435a-8dc6-bd2f3e816436/global-pull-secret-syncer/0.log" Jun 10 13:23:34.697022 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:34.696996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8cbh7_527fedf5-6673-4879-a512-7096aa7e7df6/konnectivity-agent/0.log" Jun 10 13:23:34.864373 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:34.864286 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-45.ec2.internal_25a22677b12f5f144809b9c72db24d69/haproxy/0.log" Jun 10 13:23:39.272675 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:39.272645 2562 scope.go:117] "RemoveContainer" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" Jun 10 13:23:39.273066 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:23:39.272871 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:23:39.968000 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:39.967966 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vr7cf_47e9072f-3cd2-48a4-8cc2-3944f893a9c2/manager/0.log" Jun 10 13:23:40.027458 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:40.027431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-p5t7h_acad81e9-dbe3-4f2a-b44e-d95d74f211c1/manager/0.log" Jun 10 13:23:40.129392 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:40.129364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zc9vg_1292bd94-db0c-4b7c-acf3-49e7fa1ebd21/registry-server/0.log" Jun 10 13:23:40.216627 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:40.216535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xqnf8_0a8aa2d5-097e-4dc6-a85d-7d64c604575b/manager/0.log" Jun 10 13:23:42.037767 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.037677 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/alertmanager/0.log" Jun 10 13:23:42.070252 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.070229 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/config-reloader/0.log" Jun 10 13:23:42.099757 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.099727 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/kube-rbac-proxy-web/0.log" Jun 10 13:23:42.134969 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.134942 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/kube-rbac-proxy/0.log" Jun 10 13:23:42.162104 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.162080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/kube-rbac-proxy-metric/0.log" Jun 10 13:23:42.217439 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.217416 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/prom-label-proxy/0.log" Jun 10 13:23:42.247442 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.247402 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d257b0b2-91c1-42ff-b3e9-e0675c7730da/init-config-reloader/0.log" Jun 10 13:23:42.333085 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.333009 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d5w92_1f8cae9f-bfcd-4344-a947-42192b937c27/kube-state-metrics/0.log" Jun 10 13:23:42.360028 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.359999 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d5w92_1f8cae9f-bfcd-4344-a947-42192b937c27/kube-rbac-proxy-main/0.log" Jun 10 13:23:42.395494 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.395466 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-d5w92_1f8cae9f-bfcd-4344-a947-42192b937c27/kube-rbac-proxy-self/0.log" Jun 10 13:23:42.440479 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.440454 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5966647c74-4z5nb_5f4268a2-d176-45ae-b733-bd20da9a395e/metrics-server/0.log" Jun 10 13:23:42.539592 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.539567 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2d4xw_2f5a3702-157a-410c-b600-13b6a684a137/node-exporter/0.log" Jun 10 13:23:42.576803 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.576704 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2d4xw_2f5a3702-157a-410c-b600-13b6a684a137/kube-rbac-proxy/0.log" Jun 10 13:23:42.622640 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:42.622557 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2d4xw_2f5a3702-157a-410c-b600-13b6a684a137/init-textfile/0.log" Jun 10 13:23:43.071628 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.071600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/prometheus/0.log" Jun 10 13:23:43.102724 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.102698 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/config-reloader/0.log" Jun 10 13:23:43.141425 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.141399 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/thanos-sidecar/0.log" Jun 10 13:23:43.181915 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.181891 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/kube-rbac-proxy-web/0.log" Jun 10 13:23:43.222792 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.222762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/kube-rbac-proxy/0.log" Jun 10 13:23:43.255384 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.255359 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/kube-rbac-proxy-thanos/0.log" Jun 10 13:23:43.291987 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.291959 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_40ee1c3c-d46b-4f85-87ca-eabaf0dfc81f/init-config-reloader/0.log" Jun 10 13:23:43.545663 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.545639 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7767868645-r8bv7_bf476013-ecb6-430d-99bc-c530390e8cbc/thanos-query/0.log" Jun 10 13:23:43.583177 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.583153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7767868645-r8bv7_bf476013-ecb6-430d-99bc-c530390e8cbc/kube-rbac-proxy-web/0.log" Jun 10 13:23:43.628835 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.628801 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7767868645-r8bv7_bf476013-ecb6-430d-99bc-c530390e8cbc/kube-rbac-proxy/0.log" Jun 10 13:23:43.659038 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.659015 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7767868645-r8bv7_bf476013-ecb6-430d-99bc-c530390e8cbc/prom-label-proxy/0.log" Jun 10 13:23:43.691242 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.691221 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7767868645-r8bv7_bf476013-ecb6-430d-99bc-c530390e8cbc/kube-rbac-proxy-rules/0.log" Jun 10 13:23:43.772257 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:43.772231 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7767868645-r8bv7_bf476013-ecb6-430d-99bc-c530390e8cbc/kube-rbac-proxy-metrics/0.log" Jun 10 13:23:45.023561 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.023531 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz"] Jun 10 13:23:45.028332 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.028311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.031913 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.031894 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh2q6\"/\"kube-root-ca.crt\"" Jun 10 13:23:45.032691 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.032677 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh2q6\"/\"default-dockercfg-bn54t\"" Jun 10 13:23:45.032749 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.032715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh2q6\"/\"openshift-service-ca.crt\"" Jun 10 13:23:45.041918 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.041892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz"] Jun 10 13:23:45.147087 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.147055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-sys\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.147265 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.147094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sw2g\" (UniqueName: \"kubernetes.io/projected/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-kube-api-access-9sw2g\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.147265 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.147142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-podres\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.147265 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.147221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-lib-modules\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.147399 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.147268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-proc\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.247836 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.247801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-lib-modules\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.247845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-proc\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.247912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-sys\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.247931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sw2g\" (UniqueName: \"kubernetes.io/projected/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-kube-api-access-9sw2g\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.247984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-lib-modules\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248011 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.248006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-sys\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248201 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.247993 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-proc\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248201 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.248035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-podres\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.248201 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.248171 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-podres\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.258027 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.257998 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sw2g\" (UniqueName: \"kubernetes.io/projected/ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf-kube-api-access-9sw2g\") pod \"perf-node-gather-daemonset-f2zvz\" (UID: \"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf\") " pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.338361 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.338280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.472044 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.472014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz"] Jun 10 13:23:45.474333 ip-10-0-128-45 kubenswrapper[2562]: W0610 13:23:45.474307 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podae61371d_5bbc_4e72_b1a6_bd77ce40a3cf.slice/crio-6fa690715bd7948444a9539cd61d19f468fba6dbb873ed63e5716539daa3c95f WatchSource:0}: Error finding container 6fa690715bd7948444a9539cd61d19f468fba6dbb873ed63e5716539daa3c95f: Status 404 returned error can't find the container with id 6fa690715bd7948444a9539cd61d19f468fba6dbb873ed63e5716539daa3c95f Jun 10 13:23:45.909353 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.909320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" event={"ID":"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf","Type":"ContainerStarted","Data":"336d460caca77d7426860e0b51f12f22afad010070f37c26f53c120a334c40ed"} Jun 10 13:23:45.909569 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.909370 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" event={"ID":"ae61371d-5bbc-4e72-b1a6-bd77ce40a3cf","Type":"ContainerStarted","Data":"6fa690715bd7948444a9539cd61d19f468fba6dbb873ed63e5716539daa3c95f"} Jun 10 13:23:45.909569 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.909406 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:45.933221 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:45.933166 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" podStartSLOduration=0.933148077 podStartE2EDuration="933.148077ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:23:45.932315254 +0000 UTC m=+1361.123753485" watchObservedRunningTime="2026-06-10 13:23:45.933148077 +0000 UTC m=+1361.124586291" Jun 10 13:23:48.069319 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:48.069288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmkvp_1a032599-5bb8-4ea9-b725-23e5f6f1af3f/dns/0.log" Jun 10 13:23:48.094443 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:48.094412 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmkvp_1a032599-5bb8-4ea9-b725-23e5f6f1af3f/kube-rbac-proxy/0.log" Jun 10 13:23:48.305249 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:48.305225 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wnvzr_59501f36-8370-4b9c-8666-f699e7e965d4/dns-node-resolver/0.log" Jun 10 13:23:48.990869 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:48.990843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wk7wq_770a343a-ee40-4b93-a3a1-5a3edbf45796/node-ca/0.log" Jun 10 13:23:50.125571 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:50.125537 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958x6tv_5218ddd4-1081-4207-a1f5-2026ebe27808/istio-proxy/0.log" Jun 10 13:23:50.369303 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:50.369272 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/0.log" Jun 10 13:23:50.389035 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:50.388947 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/1.log" Jun 10 13:23:50.485261 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:50.485229 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-mzddf_1ddca541-59b2-4302-a37d-cf678eb4757f/payload-pre-processing/0.log" Jun 10 13:23:50.534007 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:50.533961 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log" Jun 10 13:23:50.538714 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:50.538683 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log" Jun 10 13:23:51.461074 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:51.461047 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xm8m6_0b3f55d7-cb29-495c-806e-c70b17518661/serve-healthcheck-canary/0.log" Jun 10 13:23:51.925988 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:51.925951 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh2q6/perf-node-gather-daemonset-f2zvz" Jun 10 13:23:52.173307 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:52.173273 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62lhk_7857c752-235b-48b8-81e8-84b746e573ac/kube-rbac-proxy/0.log" Jun 10 13:23:52.204698 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:52.204620 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62lhk_7857c752-235b-48b8-81e8-84b746e573ac/exporter/0.log" Jun 10 13:23:52.241048 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:52.241018 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-62lhk_7857c752-235b-48b8-81e8-84b746e573ac/extractor/0.log" Jun 10 13:23:53.272306 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:53.272268 2562 scope.go:117] "RemoveContainer" containerID="0666ba30775d86227d60e5f8d36a50bcc1448d9d6b322d674d25a2f05cff7d64" Jun 10 13:23:53.272814 ip-10-0-128-45 kubenswrapper[2562]: E0610 13:23:53.272577 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-dnvf4_openshift-ingress(38d9591e-ca5d-4d88-ad21-de3406c02a1e)\"" pod="openshift-ingress/payload-processing-7c6c859784-dnvf4" podUID="38d9591e-ca5d-4d88-ad21-de3406c02a1e" Jun 10 13:23:55.385665 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:55.385636 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f476bfb57-25dkt_7726e73b-7d18-49b3-a869-2e8a90aac508/nginx/0.log" Jun 10 13:23:55.591836 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:55.591762 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d96b7b6bc-lks8h_765ed1fd-bbf4-4844-9118-b2d1e68258fd/maas-api/0.log" Jun 10 13:23:55.664865 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:55.664838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7845675977-n9b7c_a9894a6d-df6b-4136-b513-23681b5bbe73/manager/0.log" Jun 10 13:23:55.868543 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:55.868446 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c_dca72a6a-2488-4c0d-8e23-27f5d0ee334d/manager/0.log" Jun 10 13:23:55.905728 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:55.905707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6dc4f9d-r2c7c_dca72a6a-2488-4c0d-8e23-27f5d0ee334d/copy-manifests/0.log" Jun 10 13:23:57.895842 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:57.895812 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78489dbf64-cgb4q_824e982c-4a69-4328-90f9-0679d2bc9b5a/manager/0.log" Jun 10 13:23:59.220119 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:59.220085 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958x6tv_5218ddd4-1081-4207-a1f5-2026ebe27808/istio-proxy/0.log" Jun 10 13:23:59.350070 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:59.350040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/0.log" Jun 10 13:23:59.373292 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:59.373253 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/1.log" Jun 10 13:23:59.399368 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:59.399343 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-mzddf_1ddca541-59b2-4302-a37d-cf678eb4757f/payload-pre-processing/0.log" Jun 10 13:23:59.415578 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:59.415559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log" Jun 10 13:23:59.415693 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:23:59.415647 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log" Jun 10 13:24:00.513697 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:24:00.513663 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958x6tv_5218ddd4-1081-4207-a1f5-2026ebe27808/istio-proxy/0.log" Jun 10 13:24:00.654599 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:24:00.654568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/0.log" Jun 10 13:24:00.674063 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:24:00.674029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-69lbb_cf9a7b2d-3f64-439f-b32d-966318b7a71f/istio-proxy/1.log" Jun 10 13:24:00.734433 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:24:00.734405 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-mzddf_1ddca541-59b2-4302-a37d-cf678eb4757f/payload-pre-processing/0.log" Jun 10 13:24:00.755500 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:24:00.755467 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log" Jun 10 13:24:00.755668 ip-10-0-128-45 kubenswrapper[2562]: I0610 13:24:00.755585 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-dnvf4_38d9591e-ca5d-4d88-ad21-de3406c02a1e/payload-processing/4.log"