Jun 05 20:56:05.766352 ip-10-0-138-251 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 20:56:05.766363 ip-10-0-138-251 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 20:56:05.766370 ip-10-0-138-251 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 20:56:05.766595 ip-10-0-138-251 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 20:56:14.728750 ip-10-0-138-251 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 20:56:14.728762 ip-10-0-138-251 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aa9b6640db07448e9be26c204df93bd4 -- Jun 05 20:58:44.649491 ip-10-0-138-251 systemd[1]: Starting Kubernetes Kubelet... Jun 05 20:58:45.066500 ip-10-0-138-251 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:58:45.066500 ip-10-0-138-251 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 20:58:45.066500 ip-10-0-138-251 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:58:45.066500 ip-10-0-138-251 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 20:58:45.066500 ip-10-0-138-251 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:58:45.067085 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.066564 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 20:58:45.070543 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070527 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:45.070543 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070543 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070547 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070550 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070554 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070557 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070560 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070562 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070565 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070568 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070571 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070573 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070576 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070578 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070581 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070583 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070586 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070588 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070591 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070594 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070596 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:45.070623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070599 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070602 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070604 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070607 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070610 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070612 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070614 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070617 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070619 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070622 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070624 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070627 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070630 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070632 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070635 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070640 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070643 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070646 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070649 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:45.071095 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070652 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070655 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070657 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070663 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070666 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070668 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070671 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070674 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070677 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070680 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070682 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070685 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070687 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070690 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070693 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070696 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070699 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070703 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070706 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:45.071586 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070709 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070718 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070721 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070724 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070726 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070729 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070731 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070734 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070736 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070739 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070741 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070744 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070746 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070749 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070752 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070755 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070759 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070762 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070765 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070769 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:45.072073 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070772 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070774 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070777 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070779 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070782 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070784 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070788 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070791 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070794 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070796 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070799 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070801 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070804 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070807 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070809 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070812 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070814 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070817 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.070820 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071511 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:45.072579 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071519 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071521 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071524 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071527 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071535 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071538 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071541 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071543 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071546 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071549 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071551 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071554 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071556 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071559 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071562 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071564 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071566 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071569 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071572 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:45.073064 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071576 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071578 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071581 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071583 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071586 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071589 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071592 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071594 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071597 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071600 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071603 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071605 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071608 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071610 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071614 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071618 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071621 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071624 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071628 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:45.073571 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071630 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071633 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071635 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071638 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071640 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071643 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071645 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071648 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071650 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071653 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071655 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071658 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071661 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071664 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071667 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071669 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071672 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071674 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071677 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071679 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:45.074048 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071681 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071684 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071687 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071690 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071692 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071697 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071700 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071703 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071706 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071709 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071711 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071714 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071717 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071720 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071723 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071725 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071728 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071730 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071733 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071735 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:45.074558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071738 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071740 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071743 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071745 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071748 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071752 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071756 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071759 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071761 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071766 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071768 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071771 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071774 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071777 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071779 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071782 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071784 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071787 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071789 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.071792 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:45.075044 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072139 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072144 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072147 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072150 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072153 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072155 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072158 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072161 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072163 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072166 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072169 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072172 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072175 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072177 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072180 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072183 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072185 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072188 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072191 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072193 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:45.075559 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072215 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072218 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072221 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072224 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072226 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072229 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072231 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072234 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072237 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072239 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072242 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072244 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072247 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072252 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072254 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072257 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072260 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072264 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072267 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:45.076040 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072270 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072273 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072277 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072280 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072283 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072285 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072288 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072291 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072294 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072296 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072299 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072301 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072304 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072307 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072309 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072312 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072314 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072317 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072319 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072322 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:45.076515 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072324 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072327 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072329 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072332 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072334 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072337 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072341 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072343 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072346 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072348 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072351 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072354 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072356 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072358 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072361 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072364 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072366 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072369 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072371 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072374 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:45.077001 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072377 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072381 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072385 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072388 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072391 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072394 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072396 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072399 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072401 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072403 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072406 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072408 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072411 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072413 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072416 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072418 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072421 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072423 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072427 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.072429 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:45.077498 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072494 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072501 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072506 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072510 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072514 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072517 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072521 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072525 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072528 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072532 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072535 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072538 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072541 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072544 2559 flags.go:64] FLAG: --cgroup-root="" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072546 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072549 2559 flags.go:64] FLAG: --client-ca-file="" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072552 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072555 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072559 2559 flags.go:64] FLAG: --cluster-domain="" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072562 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072565 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072568 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072572 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072575 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 20:58:45.077986 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072578 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072581 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072585 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072588 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072591 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072594 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072598 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072601 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072605 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072608 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072611 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072614 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072617 2559 flags.go:64] FLAG: --enable-server="true" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072620 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072624 2559 flags.go:64] FLAG: --event-burst="100" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072627 2559 flags.go:64] FLAG: --event-qps="50" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072630 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072634 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072636 2559 flags.go:64] FLAG: --eviction-hard="" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072640 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072643 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072646 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072649 2559 flags.go:64] FLAG: --eviction-soft="" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072652 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072654 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 20:58:45.078582 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072657 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072660 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072663 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072666 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072669 2559 flags.go:64] FLAG: --feature-gates="" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072672 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072675 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072678 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072681 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072684 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072687 2559 flags.go:64] FLAG: --help="false" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072690 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072693 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072697 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072699 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072703 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072706 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072709 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072712 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072714 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072717 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072724 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072727 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072730 2559 flags.go:64] FLAG: --kube-reserved="" Jun 05 20:58:45.079250 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072733 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072735 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072738 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072741 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072744 2559 flags.go:64] FLAG: --lock-file="" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072747 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072750 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072752 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072757 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072760 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072763 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072766 2559 flags.go:64] FLAG: --logging-format="text" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072768 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072771 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072774 2559 flags.go:64] FLAG: --manifest-url="" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072777 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072781 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072784 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072787 2559 flags.go:64] FLAG: --max-pods="110" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072790 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072793 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072798 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072801 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072804 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072807 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 20:58:45.079866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072809 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072815 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072818 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072821 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072826 2559 flags.go:64] FLAG: --pod-cidr="" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072829 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072833 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072836 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072839 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072842 2559 flags.go:64] FLAG: --port="10250" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072845 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072848 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04360ca5c6a694d7d" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072851 2559 flags.go:64] FLAG: --qos-reserved="" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072854 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072857 2559 flags.go:64] FLAG: --register-node="true" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072860 2559 flags.go:64] FLAG: --register-with-taints="" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072863 2559 flags.go:64] FLAG: --registry-burst="10" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072866 2559 flags.go:64] FLAG: --registry-qps="5" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072869 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072871 2559 flags.go:64] FLAG: --reserved-memory="" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072875 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072878 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072881 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072883 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072886 2559 flags.go:64] FLAG: --runonce="false" Jun 05 20:58:45.080485 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072889 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072892 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072895 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072899 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072901 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072904 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072907 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072910 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072913 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072916 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072919 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072921 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072926 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072929 2559 flags.go:64] FLAG: --system-cgroups="" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072932 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072937 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072940 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072942 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072946 2559 flags.go:64] FLAG: --tls-min-version="" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072949 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072952 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072954 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072957 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072960 2559 flags.go:64] FLAG: --v="2" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072964 2559 flags.go:64] FLAG: --version="false" Jun 05 20:58:45.081088 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072967 2559 flags.go:64] FLAG: --vmodule="" Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072971 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.072974 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073082 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073086 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073089 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073091 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073094 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073097 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073099 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073103 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073106 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073109 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073111 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073114 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073117 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073119 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073122 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073124 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073128 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:45.081747 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073131 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073137 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073140 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073142 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073145 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073147 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073150 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073153 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073155 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073158 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073160 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073163 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073165 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073168 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073170 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073173 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073176 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073178 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073181 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073183 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:45.082258 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073186 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073188 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073191 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073208 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073211 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073214 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073216 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073219 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073222 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073224 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073227 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073231 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073233 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073236 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073239 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073242 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073245 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073247 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073250 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073252 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:45.082786 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073255 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073258 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073260 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073263 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073265 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073268 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073270 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073273 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073276 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073278 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073281 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073283 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073288 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073291 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073294 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073297 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073300 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073303 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073306 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073308 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:45.083309 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073311 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073313 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073316 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073321 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073324 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073327 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073330 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073333 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073335 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073338 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073340 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073343 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073345 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073348 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073351 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073353 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073356 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073360 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073363 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:45.083793 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073366 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073369 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.073372 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.073885 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.080371 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.080384 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.080400 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.080406 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080455 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080460 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080463 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080467 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080470 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080473 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080476 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:45.084315 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080478 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080481 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080485 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080488 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080491 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080493 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080496 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080499 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080502 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080504 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080507 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080510 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080512 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080515 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080519 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080522 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080525 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080528 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080531 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:45.084700 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080533 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080536 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080538 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080541 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080544 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080547 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080549 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080552 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080554 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080557 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080559 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080562 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080565 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080567 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080569 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080572 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080575 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080577 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080580 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080583 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:45.085155 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080585 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080588 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080590 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080593 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080595 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080598 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080601 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080603 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080606 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080608 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080611 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080613 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080616 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080619 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080621 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080624 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080627 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080629 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080632 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080634 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:45.085664 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080637 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080641 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080644 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080647 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080650 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080653 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080656 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080659 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080661 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080663 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080666 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080668 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080671 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080674 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080676 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080679 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080681 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080684 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080686 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:45.086151 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080689 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080691 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080694 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080696 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080699 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080701 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080703 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080706 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080708 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080711 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080714 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080717 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080719 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080722 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.080727 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:58:45.086623 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080828 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080832 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080836 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080838 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080841 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080843 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080847 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080851 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080853 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080857 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080861 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080863 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080867 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080869 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080872 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080874 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080877 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080879 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080882 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:45.086996 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080884 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080887 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080890 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080893 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080896 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080899 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080901 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080903 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080906 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080909 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080911 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080914 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080916 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080918 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080921 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080923 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080926 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080928 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080931 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080934 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:45.087470 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080936 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080939 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080941 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080944 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080947 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080949 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080952 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080954 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080957 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080959 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080962 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080964 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080967 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080970 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080972 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080975 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080977 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080980 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080982 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080984 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:45.087960 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080987 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080989 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080993 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080995 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.080998 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081000 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081003 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081005 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081008 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081010 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081013 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081016 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081018 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081021 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081023 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081025 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081030 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081033 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081035 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:45.088557 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081038 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081040 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081042 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081045 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081047 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081050 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081052 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081054 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081057 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081060 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081062 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081064 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081067 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081069 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081072 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081075 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081078 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081080 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081082 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081085 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:45.089004 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:45.081087 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.081092 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.081177 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.084825 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.086093 2559 server.go:1019] "Starting client certificate rotation" Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.086210 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.086267 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 20:58:45.089506 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.089293 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 20:58:45.093803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.093781 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 20:58:45.105068 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.105052 2559 log.go:25] "Validated CRI v1 runtime API" Jun 05 20:58:45.108120 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.108104 2559 log.go:25] "Validated CRI v1 image API" Jun 05 20:58:45.109678 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.109662 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 20:58:45.111985 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.111967 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a0d62002-60b6-40d0-9960-7393836062be:/dev/nvme0n1p4 d0db032b-541b-4f7c-9d96-9c2d4f284fdf:/dev/nvme0n1p3] Jun 05 20:58:45.112041 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.111984 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 20:58:45.117446 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.117324 2559 manager.go:216] Machine: {Timestamp:2026-06-05 20:58:45.115467596 +0000 UTC m=+0.348733621 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099946 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7253097f3742aa6d7e03b156547d SystemUUID:ec2c7253-097f-3742-aa6d-7e03b156547d BootID:aa9b6640-db07-448e-9be2-6c204df93bd4 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:5e:36:52:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:5e:36:52:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:92:7c:18:6d:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 20:58:45.117446 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.117434 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 20:58:45.117587 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.117522 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 20:58:45.118585 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.118571 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 20:58:45.120687 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.120656 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 20:58:45.120836 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.120692 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 20:58:45.122226 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.122214 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 20:58:45.122290 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.122232 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 20:58:45.122290 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.122244 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 20:58:45.123023 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.123012 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 20:58:45.123882 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.123870 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 20:58:45.127119 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127106 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 05 20:58:45.127267 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127256 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 20:58:45.127324 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127310 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 05 20:58:45.127380 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127330 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 20:58:45.127380 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127344 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 20:58:45.127380 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127358 2559 kubelet.go:398] "Adding apiserver pod source" Jun 05 20:58:45.127380 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127373 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 20:58:45.127676 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127663 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 20:58:45.127742 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.127686 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 20:58:45.129861 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.129846 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 20:58:45.131442 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.131429 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 20:58:45.131480 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.131463 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 20:58:45.132573 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132562 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 20:58:45.132606 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132577 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 20:58:45.132606 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132583 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 20:58:45.132606 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132589 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 20:58:45.132606 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132598 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 20:58:45.132606 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132603 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 20:58:45.132765 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132612 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 20:58:45.132765 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132618 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 20:58:45.132765 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132624 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 20:58:45.132765 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132630 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 20:58:45.132765 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132643 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 20:58:45.132765 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.132649 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 20:58:45.133548 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.133539 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 20:58:45.133548 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.133547 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 20:58:45.136451 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.136437 2559 server.go:1268] "Started kubelet" Jun 05 20:58:45.136620 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.136558 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 20:58:45.137041 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.137008 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 20:58:45.137116 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.137060 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 20:58:45.137397 ip-10-0-138-251 systemd[1]: Started Kubernetes Kubelet. Jun 05 20:58:45.140731 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.140706 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jndvx" Jun 05 20:58:45.141880 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.141858 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 20:58:45.142001 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.141962 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-251.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 20:58:45.142414 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.142388 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 20:58:45.142593 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.142555 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 20:58:45.144272 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.144253 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 05 20:58:45.144413 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.144385 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jndvx" Jun 05 20:58:45.145090 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.145072 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 20:58:45.148144 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.146117 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-251.ec2.internal.18b64af679bc5cb4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-251.ec2.internal,UID:ip-10-0-138-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-251.ec2.internal,},FirstTimestamp:2026-06-05 20:58:45.136407732 +0000 UTC m=+0.369673758,LastTimestamp:2026-06-05 20:58:45.136407732 +0000 UTC m=+0.369673758,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-251.ec2.internal,}" Jun 05 20:58:45.148144 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.148133 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 20:58:45.148306 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.148151 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 20:58:45.148306 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.148233 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.148885 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.148797 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 20:58:45.149004 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.148984 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 20:58:45.149061 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149023 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 20:58:45.149193 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149176 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 05 20:58:45.149193 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149191 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 05 20:58:45.149326 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149296 2559 factory.go:55] Registering systemd factory Jun 05 20:58:45.149326 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149312 2559 factory.go:223] Registration of the systemd container factory successfully Jun 05 20:58:45.149613 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149590 2559 factory.go:153] Registering CRI-O factory Jun 05 20:58:45.149613 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149607 2559 factory.go:223] Registration of the crio container factory successfully Jun 05 20:58:45.149717 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149665 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 20:58:45.149717 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149694 2559 factory.go:103] Registering Raw factory Jun 05 20:58:45.149717 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.149708 2559 manager.go:1196] Started watching for new ooms in manager Jun 05 20:58:45.150092 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.150079 2559 manager.go:349] Starting recovery of all containers Jun 05 20:58:45.153976 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.153955 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:45.156352 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.156250 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-251.ec2.internal\" not found" node="ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.160164 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.160149 2559 manager.go:354] Recovery completed Jun 05 20:58:45.163853 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.163841 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.166574 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.166556 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.166644 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.166586 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.166644 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.166596 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.167059 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.167045 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 20:58:45.167112 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.167060 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 20:58:45.167112 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.167080 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 05 20:58:45.167112 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.167052 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.168161 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.168144 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.168262 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.168180 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.168262 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.168209 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.168527 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.168516 2559 policy_none.go:49] "None policy: Start" Jun 05 20:58:45.168572 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.168531 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 20:58:45.168572 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.168541 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 20:58:45.169612 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.169601 2559 policy_none.go:47] "Start" Jun 05 20:58:45.205782 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.205766 2559 manager.go:337] "Starting Device Plugin manager" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.205802 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.205815 2559 server.go:87] "Starting device plugin registration server" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.206014 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.206023 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.206128 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.206223 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.206232 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.206780 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.206834 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.212000 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.213123 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.213160 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.213178 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.213246 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 20:58:45.217296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.215403 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:45.306307 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.306289 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.307227 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.307193 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.307310 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.307239 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.307310 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.307249 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.307310 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.307271 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.313727 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.313711 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal"] Jun 05 20:58:45.313780 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.313770 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.314764 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.314751 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.314807 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.314770 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-251.ec2.internal\": node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.315717 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.315699 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.315792 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.315729 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.315792 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.315744 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.317605 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.317560 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.317746 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.317729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.317801 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.317769 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.318338 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.318321 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.318426 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.318340 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.318426 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.318364 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.318426 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.318375 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.318426 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.318347 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.318547 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.318434 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.319728 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.319715 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.319773 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.319738 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:45.320361 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.320345 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:45.320435 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.320371 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:45.320435 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.320380 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:45.327854 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.327838 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.331720 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.331706 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-251.ec2.internal\" not found" node="ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.334779 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.334763 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-251.ec2.internal\" not found" node="ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.350860 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.350843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25447eb9cc76fb74709e0c97b7e16a2d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"25447eb9cc76fb74709e0c97b7e16a2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.350954 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.350871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f325a2c7cbaa297153b72274bb001236-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"f325a2c7cbaa297153b72274bb001236\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.350954 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.350905 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f325a2c7cbaa297153b72274bb001236-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"f325a2c7cbaa297153b72274bb001236\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.428875 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.428852 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.451282 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.451260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25447eb9cc76fb74709e0c97b7e16a2d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"25447eb9cc76fb74709e0c97b7e16a2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.451341 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.451322 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/25447eb9cc76fb74709e0c97b7e16a2d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-251.ec2.internal\" (UID: \"25447eb9cc76fb74709e0c97b7e16a2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.451375 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.451345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f325a2c7cbaa297153b72274bb001236-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"f325a2c7cbaa297153b72274bb001236\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.451375 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.451369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f325a2c7cbaa297153b72274bb001236-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"f325a2c7cbaa297153b72274bb001236\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.451437 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.451408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f325a2c7cbaa297153b72274bb001236-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"f325a2c7cbaa297153b72274bb001236\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.451469 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.451437 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f325a2c7cbaa297153b72274bb001236-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal\" (UID: \"f325a2c7cbaa297153b72274bb001236\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.529457 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.529419 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.630396 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.630188 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.637340 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.637321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.639363 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:45.639347 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jun 05 20:58:45.730452 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.730419 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.830937 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.830911 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:45.931422 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:45.931338 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.031937 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.031916 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.085409 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.085384 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 20:58:46.085870 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.085514 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 20:58:46.085870 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.085552 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 20:58:46.121162 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:46.121130 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25447eb9cc76fb74709e0c97b7e16a2d.slice/crio-7331f79885e9ce1c01f3cdab955e7c439319b65f9a5b29c853f961969a9a0d41 WatchSource:0}: Error finding container 7331f79885e9ce1c01f3cdab955e7c439319b65f9a5b29c853f961969a9a0d41: Status 404 returned error can't find the container with id 7331f79885e9ce1c01f3cdab955e7c439319b65f9a5b29c853f961969a9a0d41 Jun 05 20:58:46.121558 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:46.121541 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf325a2c7cbaa297153b72274bb001236.slice/crio-afa3a710b39b877c6ff453f890dbebbf3d082ee435c95814805c8896e6d74942 WatchSource:0}: Error finding container afa3a710b39b877c6ff453f890dbebbf3d082ee435c95814805c8896e6d74942: Status 404 returned error can't find the container with id afa3a710b39b877c6ff453f890dbebbf3d082ee435c95814805c8896e6d74942 Jun 05 20:58:46.127046 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.127022 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 20:58:46.132861 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.132844 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.150413 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.150382 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 20:53:45 +0000 UTC" deadline="2027-12-12 04:02:10.842215796 +0000 UTC" Jun 05 20:58:46.150413 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.150412 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13303h3m24.691806478s" Jun 05 20:58:46.216406 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.216330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" event={"ID":"25447eb9cc76fb74709e0c97b7e16a2d","Type":"ContainerStarted","Data":"7331f79885e9ce1c01f3cdab955e7c439319b65f9a5b29c853f961969a9a0d41"} Jun 05 20:58:46.217368 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.217348 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"f325a2c7cbaa297153b72274bb001236","Type":"ContainerStarted","Data":"afa3a710b39b877c6ff453f890dbebbf3d082ee435c95814805c8896e6d74942"} Jun 05 20:58:46.233514 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.233486 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.334067 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.334035 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.434518 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.434490 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.535071 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.534995 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.635795 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:46.635752 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-251.ec2.internal\" not found" Jun 05 20:58:46.659917 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.659612 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:46.701410 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.701093 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:46.749161 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.749103 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" Jun 05 20:58:46.756077 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.756058 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 20:58:46.757113 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.757094 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" Jun 05 20:58:46.765585 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:46.765555 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 20:58:47.128217 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.128170 2559 apiserver.go:52] "Watching apiserver" Jun 05 20:58:47.136952 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.136465 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 20:58:47.137963 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.137937 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ffxkk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal","openshift-multus/multus-b879f","openshift-multus/network-metrics-daemon-mpdbw","openshift-ovn-kubernetes/ovnkube-node-bghj9","kube-system/global-pull-secret-syncer-px84m","kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx","openshift-cluster-node-tuning-operator/tuned-t8bm9","openshift-image-registry/node-ca-7jnns","openshift-multus/multus-additional-cni-plugins-ttqwl","openshift-network-diagnostics/network-check-target-n5ch4","openshift-network-operator/iptables-alerter-fb775","kube-system/konnectivity-agent-mwcn4"] Jun 05 20:58:47.139795 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.139775 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.141001 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.140972 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.142476 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.142191 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 20:58:47.142476 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.142234 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.142476 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.142216 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tdqsl\"" Jun 05 20:58:47.142476 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.142319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.142476 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.142424 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b879f" Jun 05 20:58:47.143458 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.143231 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.143458 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.143250 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 20:58:47.143458 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.143325 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.143458 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.143377 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxffv\"" Jun 05 20:58:47.143737 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.143720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.143840 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.143802 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:58:47.144374 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.144356 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 20:58:47.144645 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.144551 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.144729 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.144688 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.144792 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.144767 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wfq79\"" Jun 05 20:58:47.144881 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.144863 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 20:58:47.145369 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.145353 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.146825 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.146807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.146920 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.146882 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:47.147521 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.147498 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.147648 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.147599 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 20:58:47.147648 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.147628 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xwv57\"" Jun 05 20:58:47.147809 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.147714 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 20:58:47.147809 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.147801 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 20:58:47.148331 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.147812 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.148331 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.148122 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 20:58:47.148711 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.148692 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.149001 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.148981 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 20:58:47.150170 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.150152 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.150661 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.150645 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.150902 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.150884 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lxvcd\"" Jun 05 20:58:47.151040 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.151024 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.151846 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.151829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.152373 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.152352 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 20:58:47.152465 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.152431 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rwv5b\"" Jun 05 20:58:47.152568 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.152551 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 20:58:47.153433 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.153387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.153958 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.153938 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 20:58:47.154685 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.154628 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.154789 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.154724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.155099 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.155031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fccrr\"" Jun 05 20:58:47.155163 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.155128 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.156234 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.156181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 20:58:47.156234 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.156223 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 20:58:47.156381 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.156288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fphjz\"" Jun 05 20:58:47.156721 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.156696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:47.156807 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.156768 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:47.158716 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.158697 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 20:58:47.158940 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.158914 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 20:58:47.159306 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qfn6w\"" Jun 05 20:58:47.159629 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-kubernetes\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.159629 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl64c\" (UniqueName: \"kubernetes.io/projected/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-kube-api-access-gl64c\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.159785 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.159785 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-slash\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.159785 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-ovn\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.159936 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-log-socket\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.159936 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c82dff7b-8902-480e-8c51-98c164faa9bd-serviceca\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.159936 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-cni-multus\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.159936 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-systemd\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.160113 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f238cda-4a7d-4a70-bd32-22f728143005-ovn-node-metrics-cert\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.160113 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.159984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-system-cni-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.160113 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.160351 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.160442 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysctl-d\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.160505 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-host\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.160505 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-cni-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.160599 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160523 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-systemd\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.160599 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-tuned\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.160697 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1c6784b-e554-4e3e-bf9c-71587638d42a-agent-certs\") pod \"konnectivity-agent-mwcn4\" (UID: \"c1c6784b-e554-4e3e-bf9c-71587638d42a\") " pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.160697 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1db0040-13bc-4ce7-98a2-86f909961ac6-cni-binary-copy\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.160800 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8ff\" (UniqueName: \"kubernetes.io/projected/9f238cda-4a7d-4a70-bd32-22f728143005-kube-api-access-mz8ff\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.160852 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-modprobe-d\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.160899 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-sys\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.160953 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160932 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-kubelet\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.161005 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.160972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6jjm\" (UniqueName: \"kubernetes.io/projected/e1db0040-13bc-4ce7-98a2-86f909961ac6-kube-api-access-s6jjm\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.161056 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c43e216a-aa76-4c86-a622-4f420b93b79b-kubelet-config\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.161056 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-ovnkube-script-lib\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161151 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c82dff7b-8902-480e-8c51-98c164faa9bd-host\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.161151 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-node-log\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161279 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-cni-bin\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161279 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-ovnkube-config\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161279 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-run\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.161415 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-cni-netd\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161415 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161512 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-var-lib-kubelet\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.161512 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-cni-bin\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.161512 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-run-netns\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161649 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-host-slash\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.161649 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-daemon-config\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.161649 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c43e216a-aa76-4c86-a622-4f420b93b79b-dbus\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.161649 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-etc-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161834 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161711 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5bk5\" (UniqueName: \"kubernetes.io/projected/c82dff7b-8902-480e-8c51-98c164faa9bd-kube-api-access-k5bk5\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.161834 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-etc-kubernetes\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.161834 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-env-overrides\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.161834 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-lib-modules\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.162024 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161836 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 20:58:47.162024 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1c6784b-e554-4e3e-bf9c-71587638d42a-konnectivity-ca\") pod \"konnectivity-agent-mwcn4\" (UID: \"c1c6784b-e554-4e3e-bf9c-71587638d42a\") " pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.162024 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-iptables-alerter-script\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.162024 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.161992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-cnibin\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.162024 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162014 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-kubelet\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.162303 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-systemd-units\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.162431 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-tmp\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.162513 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-var-lib-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.162513 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9prmk\" (UniqueName: \"kubernetes.io/projected/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-kube-api-access-9prmk\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.162625 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-k8s-cni-cncf-io\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.162964 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8ctk\" (UniqueName: \"kubernetes.io/projected/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-kube-api-access-b8ctk\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.163029 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.162986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-netns\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.163079 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-run-ovn-kubernetes\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.163079 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysconfig\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.163079 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysctl-conf\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.163402 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-os-release\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.163402 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-socket-dir-parent\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.163402 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-hostroot\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.163402 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-conf-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.163402 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.163220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-multus-certs\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.178540 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.178517 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s46w7" Jun 05 20:58:47.185487 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.185465 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s46w7" Jun 05 20:58:47.249681 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.249661 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 20:58:47.264623 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysctl-d\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.264623 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-host\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-os-release\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-cni-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-systemd\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-tuned\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1c6784b-e554-4e3e-bf9c-71587638d42a-agent-certs\") pod \"konnectivity-agent-mwcn4\" (UID: \"c1c6784b-e554-4e3e-bf9c-71587638d42a\") " pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-host\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1db0040-13bc-4ce7-98a2-86f909961ac6-cni-binary-copy\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.264797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264780 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysctl-d\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8ff\" (UniqueName: \"kubernetes.io/projected/9f238cda-4a7d-4a70-bd32-22f728143005-kube-api-access-mz8ff\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-modprobe-d\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-sys\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-registration-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-kubelet\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264933 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6jjm\" (UniqueName: \"kubernetes.io/projected/e1db0040-13bc-4ce7-98a2-86f909961ac6-kube-api-access-s6jjm\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c43e216a-aa76-4c86-a622-4f420b93b79b-kubelet-config\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.264983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-ovnkube-script-lib\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c82dff7b-8902-480e-8c51-98c164faa9bd-host\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87447519-2834-48ac-b3d0-516b7055633b-tmp-dir\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-node-log\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-cni-bin\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265098 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-ovnkube-config\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-run\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-system-cni-dir\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.265182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-cni-netd\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265240 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-var-lib-kubelet\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-cni-bin\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-run-netns\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-run-netns\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265385 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-cni-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c82dff7b-8902-480e-8c51-98c164faa9bd-host\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fxd\" (UniqueName: \"kubernetes.io/projected/daaca557-9ec4-4343-9657-a58556caf8ce-kube-api-access-84fxd\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-node-log\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-cni-bin\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-host-slash\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-daemon-config\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c43e216a-aa76-4c86-a622-4f420b93b79b-dbus\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-etc-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.265938 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265639 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5bk5\" (UniqueName: \"kubernetes.io/projected/c82dff7b-8902-480e-8c51-98c164faa9bd-kube-api-access-k5bk5\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgqd\" (UniqueName: \"kubernetes.io/projected/05c04fa9-c365-42c4-a5c0-1f759225f4d2-kube-api-access-jjgqd\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-etc-kubernetes\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-env-overrides\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265768 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-lib-modules\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1c6784b-e554-4e3e-bf9c-71587638d42a-konnectivity-ca\") pod \"konnectivity-agent-mwcn4\" (UID: \"c1c6784b-e554-4e3e-bf9c-71587638d42a\") " pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-socket-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbnc7\" (UniqueName: \"kubernetes.io/projected/87447519-2834-48ac-b3d0-516b7055633b-kube-api-access-kbnc7\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-iptables-alerter-script\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-cnibin\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.265996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-kubelet\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-systemd-units\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-ovnkube-script-lib\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266029 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-ovnkube-config\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-host-slash\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266392 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-etc-kubernetes\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.266803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c43e216a-aa76-4c86-a622-4f420b93b79b-kubelet-config\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c43e216a-aa76-4c86-a622-4f420b93b79b-dbus\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-lib-modules\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-cni-netd\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f238cda-4a7d-4a70-bd32-22f728143005-env-overrides\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-run\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266709 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c1c6784b-e554-4e3e-bf9c-71587638d42a-konnectivity-ca\") pod \"konnectivity-agent-mwcn4\" (UID: \"c1c6784b-e554-4e3e-bf9c-71587638d42a\") " pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-kubelet\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-cnibin\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-etc-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-modprobe-d\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-sys\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-kubelet\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267118 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-systemd-units\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-systemd\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267158 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-iptables-alerter-script\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-daemon-config\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-var-lib-kubelet\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.267667 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-cni-bin\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267264 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.266051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-tmp\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1db0040-13bc-4ce7-98a2-86f909961ac6-cni-binary-copy\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267321 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267369 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-var-lib-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-device-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9prmk\" (UniqueName: \"kubernetes.io/projected/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-kube-api-access-9prmk\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-k8s-cni-cncf-io\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-var-lib-openvswitch\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8ctk\" (UniqueName: \"kubernetes.io/projected/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-kube-api-access-b8ctk\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-netns\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-run-ovn-kubernetes\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-sys-fs\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysconfig\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysctl-conf\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.268445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267667 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-k8s-cni-cncf-io\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-os-release\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267696 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-netns\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-socket-dir-parent\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-run-ovn-kubernetes\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-hostroot\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysconfig\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-conf-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-socket-dir-parent\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267804 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-multus-conf-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-multus-certs\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-kubernetes\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267847 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-os-release\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl64c\" (UniqueName: \"kubernetes.io/projected/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-kube-api-access-gl64c\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-kubernetes\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-hostroot\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267839 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-run-multus-certs\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267922 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-sysctl-conf\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.269182 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-slash\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.267991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-ovn\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-log-socket\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-log-socket\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.268085 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-slash\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.268171 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:58:47.768131919 +0000 UTC m=+3.001397947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-ovn\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c82dff7b-8902-480e-8c51-98c164faa9bd-serviceca\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268299 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-cni-multus\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-systemd\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268351 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f238cda-4a7d-4a70-bd32-22f728143005-ovn-node-metrics-cert\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cnibin\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87447519-2834-48ac-b3d0-516b7055633b-hosts-file\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.269832 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-host-var-lib-cni-multus\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-run-systemd\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-system-cni-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268598 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1db0040-13bc-4ce7-98a2-86f909961ac6-system-cni-dir\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c82dff7b-8902-480e-8c51-98c164faa9bd-serviceca\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.268710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f238cda-4a7d-4a70-bd32-22f728143005-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.268768 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:47.270329 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.268824 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:47.768808684 +0000 UTC m=+3.002074696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:47.270923 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.270893 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-tmp\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.270923 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.270911 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f238cda-4a7d-4a70-bd32-22f728143005-ovn-node-metrics-cert\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.271083 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.270877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-etc-tuned\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.271283 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.271267 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c1c6784b-e554-4e3e-bf9c-71587638d42a-agent-certs\") pod \"konnectivity-agent-mwcn4\" (UID: \"c1c6784b-e554-4e3e-bf9c-71587638d42a\") " pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.278714 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.278690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5bk5\" (UniqueName: \"kubernetes.io/projected/c82dff7b-8902-480e-8c51-98c164faa9bd-kube-api-access-k5bk5\") pod \"node-ca-7jnns\" (UID: \"c82dff7b-8902-480e-8c51-98c164faa9bd\") " pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.278714 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.278705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9prmk\" (UniqueName: \"kubernetes.io/projected/c029ac8a-795a-4e3c-bd4c-e5e15eb1c609-kube-api-access-9prmk\") pod \"iptables-alerter-fb775\" (UID: \"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609\") " pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.278868 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.278732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8ctk\" (UniqueName: \"kubernetes.io/projected/e2b2d04b-cbcc-4e52-8241-0d34abc1143c-kube-api-access-b8ctk\") pod \"tuned-t8bm9\" (UID: \"e2b2d04b-cbcc-4e52-8241-0d34abc1143c\") " pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.281112 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.280930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl64c\" (UniqueName: \"kubernetes.io/projected/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-kube-api-access-gl64c\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.282339 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.282317 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6jjm\" (UniqueName: \"kubernetes.io/projected/e1db0040-13bc-4ce7-98a2-86f909961ac6-kube-api-access-s6jjm\") pod \"multus-b879f\" (UID: \"e1db0040-13bc-4ce7-98a2-86f909961ac6\") " pod="openshift-multus/multus-b879f" Jun 05 20:58:47.283505 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.283481 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8ff\" (UniqueName: \"kubernetes.io/projected/9f238cda-4a7d-4a70-bd32-22f728143005-kube-api-access-mz8ff\") pod \"ovnkube-node-bghj9\" (UID: \"9f238cda-4a7d-4a70-bd32-22f728143005\") " pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.302405 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.302381 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:47.369372 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87447519-2834-48ac-b3d0-516b7055633b-tmp-dir\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.369486 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-system-cni-dir\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369486 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fxd\" (UniqueName: \"kubernetes.io/projected/daaca557-9ec4-4343-9657-a58556caf8ce-kube-api-access-84fxd\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.369486 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369486 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:47.369486 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-system-cni-dir\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369486 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgqd\" (UniqueName: \"kubernetes.io/projected/05c04fa9-c365-42c4-a5c0-1f759225f4d2-kube-api-access-jjgqd\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-socket-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbnc7\" (UniqueName: \"kubernetes.io/projected/87447519-2834-48ac-b3d0-516b7055633b-kube-api-access-kbnc7\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369618 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-device-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87447519-2834-48ac-b3d0-516b7055633b-tmp-dir\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-sys-fs\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-sys-fs\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369699 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cnibin\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369737 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cnibin\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.369803 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87447519-2834-48ac-b3d0-516b7055633b-hosts-file\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-os-release\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-socket-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.369984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-registration-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370041 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-registration-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/87447519-2834-48ac-b3d0-516b7055633b-hosts-file\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/05c04fa9-c365-42c4-a5c0-1f759225f4d2-os-release\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370175 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/daaca557-9ec4-4343-9657-a58556caf8ce-device-dir\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.370463 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370410 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.370928 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370501 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.370928 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.370701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/05c04fa9-c365-42c4-a5c0-1f759225f4d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.375005 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.374980 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:47.375005 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.375005 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:47.375150 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.375015 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:47.375150 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.375085 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:47.875064695 +0000 UTC m=+3.108330723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:47.377106 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.377078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbnc7\" (UniqueName: \"kubernetes.io/projected/87447519-2834-48ac-b3d0-516b7055633b-kube-api-access-kbnc7\") pod \"node-resolver-ffxkk\" (UID: \"87447519-2834-48ac-b3d0-516b7055633b\") " pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.377462 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.377439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fxd\" (UniqueName: \"kubernetes.io/projected/daaca557-9ec4-4343-9657-a58556caf8ce-kube-api-access-84fxd\") pod \"aws-ebs-csi-driver-node-4g8sx\" (UID: \"daaca557-9ec4-4343-9657-a58556caf8ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.377462 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.377449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgqd\" (UniqueName: \"kubernetes.io/projected/05c04fa9-c365-42c4-a5c0-1f759225f4d2-kube-api-access-jjgqd\") pod \"multus-additional-cni-plugins-ttqwl\" (UID: \"05c04fa9-c365-42c4-a5c0-1f759225f4d2\") " pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.451406 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.451340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7jnns" Jun 05 20:58:47.462015 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.461998 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fb775" Jun 05 20:58:47.469876 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.469859 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b879f" Jun 05 20:58:47.476970 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.476952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:58:47.482934 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.482907 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" Jun 05 20:58:47.489762 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.489745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:58:47.495556 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.495542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" Jun 05 20:58:47.501039 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.501018 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffxkk" Jun 05 20:58:47.507665 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.507648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" Jun 05 20:58:47.552190 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.552173 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:47.773215 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.773106 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:47.773215 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.773150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:47.773423 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.773259 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:47.773423 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.773262 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:47.773423 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.773309 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:48.773294996 +0000 UTC m=+4.006561007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:47.773423 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.773324 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:58:48.773316578 +0000 UTC m=+4.006582589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:47.924488 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.924457 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaaca557_9ec4_4343_9657_a58556caf8ce.slice/crio-58fe386c1441b5ac96676f49fe6a23ffa7ae27395e8983bcc67098ffdf882606 WatchSource:0}: Error finding container 58fe386c1441b5ac96676f49fe6a23ffa7ae27395e8983bcc67098ffdf882606: Status 404 returned error can't find the container with id 58fe386c1441b5ac96676f49fe6a23ffa7ae27395e8983bcc67098ffdf882606 Jun 05 20:58:47.926389 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.926336 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82dff7b_8902_480e_8c51_98c164faa9bd.slice/crio-3cc050e03cb87ebf2414c26d916f4c64012eaf8e4eeafed697c9f277f0f1f40f WatchSource:0}: Error finding container 3cc050e03cb87ebf2414c26d916f4c64012eaf8e4eeafed697c9f277f0f1f40f: Status 404 returned error can't find the container with id 3cc050e03cb87ebf2414c26d916f4c64012eaf8e4eeafed697c9f277f0f1f40f Jun 05 20:58:47.929841 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.929817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c6784b_e554_4e3e_bf9c_71587638d42a.slice/crio-dee85bd3edf812e8a457a9bc3c123c9ccc35811103d6923b0c2e8ba3ddea37ad WatchSource:0}: Error finding container dee85bd3edf812e8a457a9bc3c123c9ccc35811103d6923b0c2e8ba3ddea37ad: Status 404 returned error can't find the container with id dee85bd3edf812e8a457a9bc3c123c9ccc35811103d6923b0c2e8ba3ddea37ad Jun 05 20:58:47.931552 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.931519 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87447519_2834_48ac_b3d0_516b7055633b.slice/crio-3a8f32de2a49cacf780e28629f7ea07bccb0d10d4c28860e001f61e4a0e62a43 WatchSource:0}: Error finding container 3a8f32de2a49cacf780e28629f7ea07bccb0d10d4c28860e001f61e4a0e62a43: Status 404 returned error can't find the container with id 3a8f32de2a49cacf780e28629f7ea07bccb0d10d4c28860e001f61e4a0e62a43 Jun 05 20:58:47.932599 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.932434 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc029ac8a_795a_4e3c_bd4c_e5e15eb1c609.slice/crio-91cbf5163f00a7f0253f514ec37f4313b1baa7d2accdf0c4bd7b62f860b238ec WatchSource:0}: Error finding container 91cbf5163f00a7f0253f514ec37f4313b1baa7d2accdf0c4bd7b62f860b238ec: Status 404 returned error can't find the container with id 91cbf5163f00a7f0253f514ec37f4313b1baa7d2accdf0c4bd7b62f860b238ec Jun 05 20:58:47.935148 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.935007 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b2d04b_cbcc_4e52_8241_0d34abc1143c.slice/crio-95d6534084c6e86311ac315a8453fd8757aa26d7ecccf3b851aff93b0f4bc6df WatchSource:0}: Error finding container 95d6534084c6e86311ac315a8453fd8757aa26d7ecccf3b851aff93b0f4bc6df: Status 404 returned error can't find the container with id 95d6534084c6e86311ac315a8453fd8757aa26d7ecccf3b851aff93b0f4bc6df Jun 05 20:58:47.935544 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.935520 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c04fa9_c365_42c4_a5c0_1f759225f4d2.slice/crio-9e687a76a7bf23c5a560de0f6341659650470a955322c766d276c0eee5566b02 WatchSource:0}: Error finding container 9e687a76a7bf23c5a560de0f6341659650470a955322c766d276c0eee5566b02: Status 404 returned error can't find the container with id 9e687a76a7bf23c5a560de0f6341659650470a955322c766d276c0eee5566b02 Jun 05 20:58:47.936363 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.936340 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f238cda_4a7d_4a70_bd32_22f728143005.slice/crio-6cf9ac70b3e1a01ea5d9d36c81a251a4074af9896a05e44e6fc5333b848d220e WatchSource:0}: Error finding container 6cf9ac70b3e1a01ea5d9d36c81a251a4074af9896a05e44e6fc5333b848d220e: Status 404 returned error can't find the container with id 6cf9ac70b3e1a01ea5d9d36c81a251a4074af9896a05e44e6fc5333b848d220e Jun 05 20:58:47.937389 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:58:47.937267 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1db0040_13bc_4ce7_98a2_86f909961ac6.slice/crio-2607f3c503ff6b68b19f804db1a695521d19fff7b26e64a1a6afeea4e1383d10 WatchSource:0}: Error finding container 2607f3c503ff6b68b19f804db1a695521d19fff7b26e64a1a6afeea4e1383d10: Status 404 returned error can't find the container with id 2607f3c503ff6b68b19f804db1a695521d19fff7b26e64a1a6afeea4e1383d10 Jun 05 20:58:47.974291 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:47.974272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:47.974390 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.974379 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:47.974431 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.974394 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:47.974431 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.974402 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:47.974500 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:47.974448 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:48.974430538 +0000 UTC m=+4.207696553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:48.187959 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.187932 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 20:53:47 +0000 UTC" deadline="2027-11-03 00:54:37.197904381 +0000 UTC" Jun 05 20:58:48.187959 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.187957 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12363h55m49.009950664s" Jun 05 20:58:48.220753 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.220727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"6cf9ac70b3e1a01ea5d9d36c81a251a4074af9896a05e44e6fc5333b848d220e"} Jun 05 20:58:48.221770 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.221749 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" event={"ID":"e2b2d04b-cbcc-4e52-8241-0d34abc1143c","Type":"ContainerStarted","Data":"95d6534084c6e86311ac315a8453fd8757aa26d7ecccf3b851aff93b0f4bc6df"} Jun 05 20:58:48.222788 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.222762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwcn4" event={"ID":"c1c6784b-e554-4e3e-bf9c-71587638d42a","Type":"ContainerStarted","Data":"dee85bd3edf812e8a457a9bc3c123c9ccc35811103d6923b0c2e8ba3ddea37ad"} Jun 05 20:58:48.223870 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.223851 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" event={"ID":"daaca557-9ec4-4343-9657-a58556caf8ce","Type":"ContainerStarted","Data":"58fe386c1441b5ac96676f49fe6a23ffa7ae27395e8983bcc67098ffdf882606"} Jun 05 20:58:48.226368 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.226347 2559 generic.go:356] "Generic (PLEG): container finished" podID="f325a2c7cbaa297153b72274bb001236" containerID="f8233ca6bca74884c50af9a8e66c80d7021c114056a5406bbf162b511176b147" exitCode=0 Jun 05 20:58:48.226447 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.226383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"f325a2c7cbaa297153b72274bb001236","Type":"ContainerDied","Data":"f8233ca6bca74884c50af9a8e66c80d7021c114056a5406bbf162b511176b147"} Jun 05 20:58:48.227441 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.227422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerStarted","Data":"9e687a76a7bf23c5a560de0f6341659650470a955322c766d276c0eee5566b02"} Jun 05 20:58:48.231300 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.231273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fb775" event={"ID":"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609","Type":"ContainerStarted","Data":"91cbf5163f00a7f0253f514ec37f4313b1baa7d2accdf0c4bd7b62f860b238ec"} Jun 05 20:58:48.232347 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.232329 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffxkk" event={"ID":"87447519-2834-48ac-b3d0-516b7055633b","Type":"ContainerStarted","Data":"3a8f32de2a49cacf780e28629f7ea07bccb0d10d4c28860e001f61e4a0e62a43"} Jun 05 20:58:48.233382 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.233352 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b879f" event={"ID":"e1db0040-13bc-4ce7-98a2-86f909961ac6","Type":"ContainerStarted","Data":"2607f3c503ff6b68b19f804db1a695521d19fff7b26e64a1a6afeea4e1383d10"} Jun 05 20:58:48.234403 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.234381 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7jnns" event={"ID":"c82dff7b-8902-480e-8c51-98c164faa9bd","Type":"ContainerStarted","Data":"3cc050e03cb87ebf2414c26d916f4c64012eaf8e4eeafed697c9f277f0f1f40f"} Jun 05 20:58:48.235657 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.235638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" event={"ID":"25447eb9cc76fb74709e0c97b7e16a2d","Type":"ContainerStarted","Data":"539f35e9e36f7b1812ef54854ecf66e7d401d1b13f3635b0043297a302b312ec"} Jun 05 20:58:48.254920 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.254823 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-251.ec2.internal" podStartSLOduration=2.254811435 podStartE2EDuration="2.254811435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:58:48.254393885 +0000 UTC m=+3.487659919" watchObservedRunningTime="2026-06-05 20:58:48.254811435 +0000 UTC m=+3.488077468" Jun 05 20:58:48.781638 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.781601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:48.781854 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.781657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:48.781917 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.781864 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:48.781972 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.781924 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:58:50.781905478 +0000 UTC m=+6.015171491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:48.782358 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.782305 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:48.782358 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.782356 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:50.782339699 +0000 UTC m=+6.015605713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:48.982274 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:48.982238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:48.982469 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.982449 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:48.982532 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.982477 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:48.982532 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.982491 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:48.982632 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:48.982549 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:50.982528773 +0000 UTC m=+6.215794799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:49.188918 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.188857 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 20:53:47 +0000 UTC" deadline="2027-12-11 19:36:03.411714017 +0000 UTC" Jun 05 20:58:49.188918 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.188916 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13294h37m14.222802033s" Jun 05 20:58:49.214065 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.214041 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:49.214214 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:49.214172 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:58:49.214615 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.214597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:49.214713 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:49.214688 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:49.214831 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.214807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:49.214935 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:49.214913 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:49.256579 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.256524 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" event={"ID":"f325a2c7cbaa297153b72274bb001236","Type":"ContainerStarted","Data":"b5e1eba4460ac72c113c6f8b76da9b5f0f6ab43173ebb02fdff50509d9165b66"} Jun 05 20:58:49.270691 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:49.270642 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-251.ec2.internal" podStartSLOduration=3.270602138 podStartE2EDuration="3.270602138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:58:49.269620802 +0000 UTC m=+4.502886827" watchObservedRunningTime="2026-06-05 20:58:49.270602138 +0000 UTC m=+4.503868174" Jun 05 20:58:50.798286 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:50.798250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:50.798824 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:50.798306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:50.798824 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:50.798471 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:50.798824 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:50.798525 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:54.798508622 +0000 UTC m=+10.031774650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:50.798994 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:50.798892 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:50.798994 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:50.798945 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:58:54.79892923 +0000 UTC m=+10.032195245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:50.999931 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:50.999885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:51.000086 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.000063 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:51.000164 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.000093 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:51.000164 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.000114 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:51.000298 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.000183 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:58:55.000161992 +0000 UTC m=+10.233428065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:51.213735 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:51.213661 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:51.213887 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.213788 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:51.214185 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:51.214162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:51.214318 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.214286 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:58:51.214436 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:51.214411 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:51.214540 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:51.214519 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:53.213781 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:53.213734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:53.213781 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:53.213763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:53.214283 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:53.213858 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:53.214343 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:53.214315 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:58:53.214434 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:53.214406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:53.214547 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:53.214489 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:54.829596 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:54.829297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:54.829596 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:54.829391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:54.829596 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:54.829445 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:54.829596 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:54.829482 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:54.829596 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:54.829501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:59:02.829484029 +0000 UTC m=+18.062750050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:54.829596 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:54.829520 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:59:02.829510562 +0000 UTC m=+18.062776580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:55.031239 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:55.031185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:55.031422 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.031368 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:55.031422 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.031395 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:55.031422 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.031410 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:55.031591 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.031465 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:59:03.031445431 +0000 UTC m=+18.264711448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:55.215186 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:55.215079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:55.215475 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:55.215255 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:55.215475 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:55.215289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:55.215901 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.215785 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:55.215901 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.215871 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:58:55.216397 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:55.215702 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:57.213862 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:57.213821 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:57.214339 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:57.213821 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:57.214339 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:57.213958 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:57.214339 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:57.213968 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:57.214339 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:57.214032 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:57.214339 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:57.214112 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:58:59.213546 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:59.213514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:58:59.213996 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:59.213513 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:58:59.213996 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:59.213621 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:58:59.213996 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:59.213690 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:58:59.213996 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:58:59.213516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:58:59.213996 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:58:59.213785 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:01.213967 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:01.213926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:01.214452 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:01.213926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:01.214673 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:01.213926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:01.214804 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:01.214679 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:01.214804 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:01.214445 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:01.214906 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:01.214807 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:02.896913 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:02.896875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:02.897501 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:02.896923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:02.897501 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:02.897054 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:02.897501 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:02.897056 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:02.897501 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:02.897119 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:59:18.897099018 +0000 UTC m=+34.130365032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:02.897501 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:02.897138 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:59:18.897128343 +0000 UTC m=+34.130394355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:03.098446 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:03.098406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:03.098630 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.098597 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:59:03.098630 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.098618 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:59:03.098630 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.098628 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:03.098790 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.098685 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:59:19.098666169 +0000 UTC m=+34.331932202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:03.214479 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:03.214400 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:03.214622 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:03.214400 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:03.214622 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.214532 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:03.214622 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:03.214540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:03.214768 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.214644 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:03.214814 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:03.214782 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:05.214917 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:05.214883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:05.215352 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:05.214993 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:05.215352 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:05.215039 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:05.215352 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:05.215152 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:05.215352 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:05.215222 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:05.215352 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:05.215289 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:07.214702 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.214430 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:07.215167 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.214443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:07.215167 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:07.214788 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:07.215167 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:07.214892 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:07.215167 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.214522 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:07.215167 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:07.215061 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:07.295542 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.295509 2559 generic.go:356] "Generic (PLEG): container finished" podID="05c04fa9-c365-42c4-a5c0-1f759225f4d2" containerID="cc5fcc97c1cc6123f31e3fd6d98affcf5eb3d08c021d282ecd9c1613cbb68aad" exitCode=0 Jun 05 20:59:07.295701 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.295582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerDied","Data":"cc5fcc97c1cc6123f31e3fd6d98affcf5eb3d08c021d282ecd9c1613cbb68aad"} Jun 05 20:59:07.297567 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.297543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffxkk" event={"ID":"87447519-2834-48ac-b3d0-516b7055633b","Type":"ContainerStarted","Data":"c1b5b7303af9e0d019d129e7a34dc5d7f38ce8e580a648a5dc312d8ce21b2934"} Jun 05 20:59:07.299409 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.299387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b879f" event={"ID":"e1db0040-13bc-4ce7-98a2-86f909961ac6","Type":"ContainerStarted","Data":"abd5d7fb432326b0250fe969e2c4d4b6129d1c236a00aa3fcb41c0e77673bfa3"} Jun 05 20:59:07.301011 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.300966 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7jnns" event={"ID":"c82dff7b-8902-480e-8c51-98c164faa9bd","Type":"ContainerStarted","Data":"d7f64edf1a6822b8073b86b05e33e095eeb296317eb0aad5aad699100c454872"} Jun 05 20:59:07.306649 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.306623 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 20:59:07.307024 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307005 2559 generic.go:356] "Generic (PLEG): container finished" podID="9f238cda-4a7d-4a70-bd32-22f728143005" containerID="f76d520bc8f1060d151e3c31fbc5f16ad5a17b12fd0d26a0f5fd81f61dece3af" exitCode=1 Jun 05 20:59:07.307122 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"7375f9ca04b3c24eb6ea58c6ab86e9621af8a7ebf201d4f6554f293921e4e792"} Jun 05 20:59:07.307185 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307146 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"a2d5e2867ac689340536de846c820551dc027e17145b73f6d5c8ef3f8d68bc31"} Jun 05 20:59:07.307262 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"43cf0d480e6cf23a5b95d8e8df0c331fa3513045144f858e859bdcf765efa853"} Jun 05 20:59:07.307320 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"960455a6ae458babadc2e9dfa42ee8b2c7e967ddbaf0f33e6c2fc7192d3d563e"} Jun 05 20:59:07.307320 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307313 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerDied","Data":"f76d520bc8f1060d151e3c31fbc5f16ad5a17b12fd0d26a0f5fd81f61dece3af"} Jun 05 20:59:07.307412 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.307345 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"4526b34c89d8d9d6626d1ffba3ab2d097f5c48f7b9c836f1364c0e3630134bdc"} Jun 05 20:59:07.308595 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.308561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" event={"ID":"e2b2d04b-cbcc-4e52-8241-0d34abc1143c","Type":"ContainerStarted","Data":"aac73c176824cffbe3561c095c15b139e88608e0d68ce6b2f27218f18a87e1b9"} Jun 05 20:59:07.310742 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.310715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwcn4" event={"ID":"c1c6784b-e554-4e3e-bf9c-71587638d42a","Type":"ContainerStarted","Data":"bb97c66c82c956be333573c4984fcc7d25d82c913a911183c43541f993515023"} Jun 05 20:59:07.312587 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.312565 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" event={"ID":"daaca557-9ec4-4343-9657-a58556caf8ce","Type":"ContainerStarted","Data":"de9fc51c204b55965d79060a46b3a8604b4f0882b80bca367fbeeb8528a73cff"} Jun 05 20:59:07.333264 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.333178 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t8bm9" podStartSLOduration=3.781123157 podStartE2EDuration="22.333163032s" totalImagesPullingTime="18.552039875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:07.332989315 +0000 UTC m=+22.566255349" watchObservedRunningTime="2026-06-05 20:59:07.333163032 +0000 UTC m=+22.566429069" Jun 05 20:59:07.348711 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.348673 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mwcn4" podStartSLOduration=12.178845679 podStartE2EDuration="22.348661107s" totalImagesPullingTime="10.169815428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:07.348469254 +0000 UTC m=+22.581735286" watchObservedRunningTime="2026-06-05 20:59:07.348661107 +0000 UTC m=+22.581927139" Jun 05 20:59:07.364295 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.364186 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b879f" podStartSLOduration=3.80666779 podStartE2EDuration="22.364172439s" totalImagesPullingTime="18.557504649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:07.363803313 +0000 UTC m=+22.597069346" watchObservedRunningTime="2026-06-05 20:59:07.364172439 +0000 UTC m=+22.597438473" Jun 05 20:59:07.378530 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.378487 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ffxkk" podStartSLOduration=3.826650379 podStartE2EDuration="22.378469107s" totalImagesPullingTime="18.551818728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:07.378039637 +0000 UTC m=+22.611305671" watchObservedRunningTime="2026-06-05 20:59:07.378469107 +0000 UTC m=+22.611735162" Jun 05 20:59:07.391051 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.391013 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7jnns" podStartSLOduration=3.832970293 podStartE2EDuration="22.391004335s" totalImagesPullingTime="18.558034042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:07.390988081 +0000 UTC m=+22.624254124" watchObservedRunningTime="2026-06-05 20:59:07.391004335 +0000 UTC m=+22.624270367" Jun 05 20:59:07.846776 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.846746 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:59:07.847319 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:07.847295 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:59:08.048430 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.048406 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 20:59:08.218404 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.218276 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T20:59:08.048428182Z","UUID":"7e8287b9-e9cc-439a-a5c5-89aafef08e97","Handler":null,"Name":"","Endpoint":""} Jun 05 20:59:08.219798 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.219781 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 20:59:08.219899 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.219814 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 20:59:08.316095 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.316067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fb775" event={"ID":"c029ac8a-795a-4e3c-bd4c-e5e15eb1c609","Type":"ContainerStarted","Data":"d9e902feb2b363d993742bf7a6242a132f520be273c2626f4c834a0980c31963"} Jun 05 20:59:08.318225 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.318182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" event={"ID":"daaca557-9ec4-4343-9657-a58556caf8ce","Type":"ContainerStarted","Data":"d980b8556c542045add46b0587ba8dbdfd818b3d2abe22023374f2ca9634d56c"} Jun 05 20:59:08.330453 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:08.330415 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fb775" podStartSLOduration=4.77931036 podStartE2EDuration="23.330401634s" totalImagesPullingTime="18.551091274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:08.329952898 +0000 UTC m=+23.563218932" watchObservedRunningTime="2026-06-05 20:59:08.330401634 +0000 UTC m=+23.563667666" Jun 05 20:59:09.213866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:09.213839 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:09.213866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:09.213853 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:09.214036 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:09.213944 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:09.214036 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:09.214005 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:09.214144 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:09.214037 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:09.214144 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:09.214132 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:09.322153 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:09.322127 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" event={"ID":"daaca557-9ec4-4343-9657-a58556caf8ce","Type":"ContainerStarted","Data":"05d33cf655cfa1e2d281b62f1d9111ca6a390d4c4ae2d6869765abbd7639661e"} Jun 05 20:59:09.329069 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:09.329039 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 20:59:09.345690 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:09.345647 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4g8sx" podStartSLOduration=3.537971715 podStartE2EDuration="24.345632744s" totalImagesPullingTime="20.807661029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:09.345548117 +0000 UTC m=+24.578814162" watchObservedRunningTime="2026-06-05 20:59:09.345632744 +0000 UTC m=+24.578898776" Jun 05 20:59:10.328235 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:10.328188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 20:59:10.328729 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:10.328666 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"e43aaadb20e6e8260cf505748c3fe11ee0c33ca4902c9614c0e844af4663d3e4"} Jun 05 20:59:11.191213 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.191150 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:59:11.191378 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.191349 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 20:59:11.192103 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.192076 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mwcn4" Jun 05 20:59:11.213782 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.213716 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:11.213896 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.213720 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:11.213896 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:11.213877 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:11.214010 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:11.213937 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:11.214010 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.213953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:11.214088 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:11.214072 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:11.582393 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.582348 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:11.664603 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:11.664574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:12.336477 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.336325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 20:59:12.336866 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.336841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"e35c0d6f75f787015045b8e58fc42da8ad3ab33e3fbda08727acde533ec5a372"} Jun 05 20:59:12.337107 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.337092 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:59:12.337322 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.337309 2559 scope.go:117] "RemoveContainer" containerID="f76d520bc8f1060d151e3c31fbc5f16ad5a17b12fd0d26a0f5fd81f61dece3af" Jun 05 20:59:12.338877 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.338855 2559 generic.go:356] "Generic (PLEG): container finished" podID="05c04fa9-c365-42c4-a5c0-1f759225f4d2" containerID="91c2ba3cd05baa050b3170b6ac10b57caa9f16058af4afd2222269d12ebae272" exitCode=0 Jun 05 20:59:12.338955 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.338897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerDied","Data":"91c2ba3cd05baa050b3170b6ac10b57caa9f16058af4afd2222269d12ebae272"} Jun 05 20:59:12.353770 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.353751 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:59:12.607469 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.607396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:12.709209 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.709176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:12.754085 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.754065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:12.808889 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.808857 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:12.908961 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:12.908892 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:13.214215 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.213953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:13.214215 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.213967 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:13.214400 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.214089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:13.214400 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:13.214299 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:13.214400 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:13.214366 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:13.214518 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:13.214440 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:13.343495 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.343464 2559 generic.go:356] "Generic (PLEG): container finished" podID="05c04fa9-c365-42c4-a5c0-1f759225f4d2" containerID="f89346403bf997cd038be55c4f7ef02a371bbd3d17499b7a65af26257f545b25" exitCode=0 Jun 05 20:59:13.343650 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.343551 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerDied","Data":"f89346403bf997cd038be55c4f7ef02a371bbd3d17499b7a65af26257f545b25"} Jun 05 20:59:13.347688 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.347671 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 20:59:13.348021 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.348002 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" event={"ID":"9f238cda-4a7d-4a70-bd32-22f728143005","Type":"ContainerStarted","Data":"0ac6bcee8b9c76b812ba25b4b136aedc89183cb49c200c12f9606d08ba38d4c1"} Jun 05 20:59:13.348296 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.348278 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:59:13.348396 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.348338 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:59:13.362656 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.362639 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:59:13.662893 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.662868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:13.710567 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.710538 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:13.718955 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.718904 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" podStartSLOduration=10.124198079 podStartE2EDuration="28.718884454s" totalImagesPullingTime="18.594686375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:13.389946235 +0000 UTC m=+28.623212270" watchObservedRunningTime="2026-06-05 20:59:13.718884454 +0000 UTC m=+28.952150489" Jun 05 20:59:13.719834 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.719802 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px84m"] Jun 05 20:59:13.719929 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.719905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:13.720032 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:13.720012 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:13.723331 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.723293 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mpdbw"] Jun 05 20:59:13.723464 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.723419 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:13.723560 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:13.723536 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:13.724278 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.724254 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n5ch4"] Jun 05 20:59:13.724387 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:13.724336 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:13.724454 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:13.724434 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:14.352255 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:14.352217 2559 generic.go:356] "Generic (PLEG): container finished" podID="05c04fa9-c365-42c4-a5c0-1f759225f4d2" containerID="7b17bcfb45386c0706bd44b243d5e4d959da2fa58f86a74d2e64ab25ed86973c" exitCode=0 Jun 05 20:59:14.352405 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:14.352278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerDied","Data":"7b17bcfb45386c0706bd44b243d5e4d959da2fa58f86a74d2e64ab25ed86973c"} Jun 05 20:59:14.359924 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:14.359906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:14.459001 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:14.458978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:15.214499 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:15.214469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:15.215038 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:15.214553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:15.215038 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:15.214589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:15.215038 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:15.214622 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:15.215038 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:15.214650 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:15.215038 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:15.214727 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:16.811117 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:16.811074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:16.857909 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:16.857881 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:17.214365 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:17.214287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:17.214515 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:17.214415 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:17.214515 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:17.214430 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:17.214617 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:17.214521 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:17.214617 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:17.214572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:17.214722 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:17.214628 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:18.924043 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:18.923830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:18.924043 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:18.924027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:18.924459 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:18.923970 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:18.924459 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:18.924125 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 20:59:50.924109319 +0000 UTC m=+66.157375341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:18.924459 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:18.924182 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:18.924459 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:18.924263 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret podName:c43e216a-aa76-4c86-a622-4f420b93b79b nodeName:}" failed. No retries permitted until 2026-06-05 20:59:50.92424515 +0000 UTC m=+66.157511168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret") pod "global-pull-secret-syncer-px84m" (UID: "c43e216a-aa76-4c86-a622-4f420b93b79b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:19.126432 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.126405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:19.126634 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.126541 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:59:19.126634 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.126561 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:59:19.126634 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.126571 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcqlj for pod openshift-network-diagnostics/network-check-target-n5ch4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:19.126634 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.126614 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj podName:69683b2d-c165-4178-bb72-4f685b3c408b nodeName:}" failed. No retries permitted until 2026-06-05 20:59:51.126601063 +0000 UTC m=+66.359867074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcqlj" (UniqueName: "kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj") pod "network-check-target-n5ch4" (UID: "69683b2d-c165-4178-bb72-4f685b3c408b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:19.214018 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.213966 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:19.214018 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.213986 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:19.214145 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.214055 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5ch4" podUID="69683b2d-c165-4178-bb72-4f685b3c408b" Jun 05 20:59:19.214145 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.214116 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 20:59:19.214248 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.214159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:19.214248 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.214232 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px84m" podUID="c43e216a-aa76-4c86-a622-4f420b93b79b" Jun 05 20:59:19.366018 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.365990 2559 generic.go:356] "Generic (PLEG): container finished" podID="05c04fa9-c365-42c4-a5c0-1f759225f4d2" containerID="b1e19e1ff090f1baa375f80b318d686ca7a8a6907252a572b26de13557464bb8" exitCode=0 Jun 05 20:59:19.366120 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.366043 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerDied","Data":"b1e19e1ff090f1baa375f80b318d686ca7a8a6907252a572b26de13557464bb8"} Jun 05 20:59:19.566040 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.566022 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-251.ec2.internal" event="NodeReady" Jun 05 20:59:19.566161 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.566116 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 20:59:19.607124 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.607103 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8n7bc"] Jun 05 20:59:19.615436 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.615415 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.615603 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.615572 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mcmhx"] Jun 05 20:59:19.617875 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.617854 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fnqdb\"" Jun 05 20:59:19.617978 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.617876 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 20:59:19.618042 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.617982 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 20:59:19.627605 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.627585 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8n7bc"] Jun 05 20:59:19.627697 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.627628 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcmhx"] Jun 05 20:59:19.627736 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.627698 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.630445 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.630424 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qpmv\"" Jun 05 20:59:19.630580 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.630482 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 20:59:19.630697 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.630493 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 20:59:19.630697 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.630629 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 20:59:19.721451 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.721434 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:19.731559 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.731518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c721f048-52b4-41b1-9568-ae2823f21b71-cert\") pod \"ingress-canary-mcmhx\" (UID: \"c721f048-52b4-41b1-9568-ae2823f21b71\") " pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.731559 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.731544 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68595da0-67a0-4f47-aff0-582764bb90cf-config-volume\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.731732 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.731562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.731732 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.731579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68595da0-67a0-4f47-aff0-582764bb90cf-tmp-dir\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.731732 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.731602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkj2z\" (UniqueName: \"kubernetes.io/projected/c721f048-52b4-41b1-9568-ae2823f21b71-kube-api-access-vkj2z\") pod \"ingress-canary-mcmhx\" (UID: \"c721f048-52b4-41b1-9568-ae2823f21b71\") " pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.731732 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.731666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhhr\" (UniqueName: \"kubernetes.io/projected/68595da0-67a0-4f47-aff0-582764bb90cf-kube-api-access-dvhhr\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.817555 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.817530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:19.832518 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c721f048-52b4-41b1-9568-ae2823f21b71-cert\") pod \"ingress-canary-mcmhx\" (UID: \"c721f048-52b4-41b1-9568-ae2823f21b71\") " pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.832597 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68595da0-67a0-4f47-aff0-582764bb90cf-config-volume\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.832597 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.832597 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68595da0-67a0-4f47-aff0-582764bb90cf-tmp-dir\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.832735 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkj2z\" (UniqueName: \"kubernetes.io/projected/c721f048-52b4-41b1-9568-ae2823f21b71-kube-api-access-vkj2z\") pod \"ingress-canary-mcmhx\" (UID: \"c721f048-52b4-41b1-9568-ae2823f21b71\") " pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.832735 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.832638 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:19.832735 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhhr\" (UniqueName: \"kubernetes.io/projected/68595da0-67a0-4f47-aff0-582764bb90cf-kube-api-access-dvhhr\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.832735 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:19.832692 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:20.332671613 +0000 UTC m=+35.565937625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:19.832945 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.832829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68595da0-67a0-4f47-aff0-582764bb90cf-tmp-dir\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.833169 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.833146 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68595da0-67a0-4f47-aff0-582764bb90cf-config-volume\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.836908 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.836888 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c721f048-52b4-41b1-9568-ae2823f21b71-cert\") pod \"ingress-canary-mcmhx\" (UID: \"c721f048-52b4-41b1-9568-ae2823f21b71\") " pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.840998 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.840970 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhhr\" (UniqueName: \"kubernetes.io/projected/68595da0-67a0-4f47-aff0-582764bb90cf-kube-api-access-dvhhr\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:19.844372 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.844349 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkj2z\" (UniqueName: \"kubernetes.io/projected/c721f048-52b4-41b1-9568-ae2823f21b71-kube-api-access-vkj2z\") pod \"ingress-canary-mcmhx\" (UID: \"c721f048-52b4-41b1-9568-ae2823f21b71\") " pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:19.935245 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:19.935221 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcmhx" Jun 05 20:59:20.111694 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:20.111667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcmhx"] Jun 05 20:59:20.114948 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:59:20.114925 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc721f048_52b4_41b1_9568_ae2823f21b71.slice/crio-14d0fe766a6e24b6ef0d36b2e4d952a164a73e0d8a434f9c6af5f64bdfbe4a83 WatchSource:0}: Error finding container 14d0fe766a6e24b6ef0d36b2e4d952a164a73e0d8a434f9c6af5f64bdfbe4a83: Status 404 returned error can't find the container with id 14d0fe766a6e24b6ef0d36b2e4d952a164a73e0d8a434f9c6af5f64bdfbe4a83 Jun 05 20:59:20.337236 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:20.337192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:20.337381 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:20.337335 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:20.337421 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:20.337389 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:21.337373203 +0000 UTC m=+36.570639222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:20.371144 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:20.371118 2559 generic.go:356] "Generic (PLEG): container finished" podID="05c04fa9-c365-42c4-a5c0-1f759225f4d2" containerID="aaed0973d03fa3d6dbbc8bed43845cc76b7cfafa84dc20f7f942e7ab96db49ad" exitCode=0 Jun 05 20:59:20.371290 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:20.371213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerDied","Data":"aaed0973d03fa3d6dbbc8bed43845cc76b7cfafa84dc20f7f942e7ab96db49ad"} Jun 05 20:59:20.372436 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:20.372414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcmhx" event={"ID":"c721f048-52b4-41b1-9568-ae2823f21b71","Type":"ContainerStarted","Data":"14d0fe766a6e24b6ef0d36b2e4d952a164a73e0d8a434f9c6af5f64bdfbe4a83"} Jun 05 20:59:21.214305 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.214114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:21.214777 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.214114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:21.214777 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.214113 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:21.217416 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.217396 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 20:59:21.218466 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.218367 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k95x8\"" Jun 05 20:59:21.218466 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.218373 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 20:59:21.218466 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.218387 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 20:59:21.218466 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.218372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gblp8\"" Jun 05 20:59:21.218466 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.218444 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 20:59:21.345380 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.345353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:21.345606 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:21.345587 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:21.345680 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:21.345651 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:23.345636867 +0000 UTC m=+38.578902877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:21.377891 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.377869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" event={"ID":"05c04fa9-c365-42c4-a5c0-1f759225f4d2","Type":"ContainerStarted","Data":"f6bcae128962a75a7e44ba5a08715096d1677baee94b1ba8d9f79e0a7634a80a"} Jun 05 20:59:21.398169 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.398127 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ttqwl" podStartSLOduration=7.961656906 podStartE2EDuration="36.398113321s" totalImagesPullingTime="28.436456415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:21.397264348 +0000 UTC m=+36.630530381" watchObservedRunningTime="2026-06-05 20:59:21.398113321 +0000 UTC m=+36.631379353" Jun 05 20:59:21.516242 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.516160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:21.582322 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:21.582296 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:23.360354 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:23.360323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:23.360913 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:23.360464 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:23.360913 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:23.360523 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:27.36050879 +0000 UTC m=+42.593774801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:23.383103 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:23.383077 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcmhx" event={"ID":"c721f048-52b4-41b1-9568-ae2823f21b71","Type":"ContainerStarted","Data":"4d53f12a4274bd39a1977bb163bbb0ec57e5b252901114ae22a244a94c1e22ff"} Jun 05 20:59:23.398985 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:23.398945 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mcmhx" podStartSLOduration=2.202644735 podStartE2EDuration="4.398932439s" totalImagesPullingTime="2.196287704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:23.397642227 +0000 UTC m=+38.630908261" watchObservedRunningTime="2026-06-05 20:59:23.398932439 +0000 UTC m=+38.632198471" Jun 05 20:59:24.936036 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:24.936001 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:25.035683 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:25.035656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:25.087889 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:25.087845 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:27.385026 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:27.384992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:27.385460 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:27.385119 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:27.385460 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:27.385171 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:35.385156559 +0000 UTC m=+50.618422572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:28.724731 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:28.724696 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:28.774958 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:28.774931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:30.507405 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:30.507365 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:30.608294 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:30.608247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:35.433355 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:35.433321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:35.433739 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:35.433459 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:35.433739 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:35.433516 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:51.433501055 +0000 UTC m=+66.666767070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:38.347635 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:38.347594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:38.395269 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:38.395241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:41.946456 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.946423 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm"] Jun 05 20:59:41.950821 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.950802 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg"] Jun 05 20:59:41.950954 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.950931 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:41.952797 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.952774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:41.953554 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.953524 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 05 20:59:41.953554 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.953528 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 20:59:41.953825 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.953595 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 05 20:59:41.953825 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.953674 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 05 20:59:41.953985 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.953877 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 20:59:41.953985 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.953877 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 05 20:59:41.954673 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.954631 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 20:59:41.954838 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.954824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 20:59:41.957574 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.957553 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg"] Jun 05 20:59:41.959661 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.959637 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm"] Jun 05 20:59:41.971882 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.971860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:41.972014 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.971921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28c69672-02bb-4e33-8321-ff35747a2678-tmp\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:41.972014 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.971964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/28c69672-02bb-4e33-8321-ff35747a2678-kube-api-access-sj94f\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:41.972014 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.971986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-ca\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:41.972014 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.972009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkl9z\" (UniqueName: \"kubernetes.io/projected/97943946-7f99-4241-8a70-679012e01795-kube-api-access-bkl9z\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:41.972256 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.972040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28c69672-02bb-4e33-8321-ff35747a2678-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:41.972256 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.972073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-hub\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:41.972256 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.972110 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:41.972256 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:41.972133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97943946-7f99-4241-8a70-679012e01795-additional-service-ca\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073281 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073258 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073406 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97943946-7f99-4241-8a70-679012e01795-additional-service-ca\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073406 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073406 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28c69672-02bb-4e33-8321-ff35747a2678-tmp\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.073406 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/28c69672-02bb-4e33-8321-ff35747a2678-kube-api-access-sj94f\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.073611 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-ca\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073611 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkl9z\" (UniqueName: \"kubernetes.io/projected/97943946-7f99-4241-8a70-679012e01795-kube-api-access-bkl9z\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073611 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073471 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28c69672-02bb-4e33-8321-ff35747a2678-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.073749 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-hub\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.073799 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.073757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28c69672-02bb-4e33-8321-ff35747a2678-tmp\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.074045 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.074024 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97943946-7f99-4241-8a70-679012e01795-additional-service-ca\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.077326 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.077292 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.077436 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.077426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/28c69672-02bb-4e33-8321-ff35747a2678-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.077436 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.077426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-hub\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.077527 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.077438 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-ca\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.077569 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.077545 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97943946-7f99-4241-8a70-679012e01795-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.081110 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.081078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/28c69672-02bb-4e33-8321-ff35747a2678-kube-api-access-sj94f\") pod \"klusterlet-addon-workmgr-5f658b879d-hb7tg\" (UID: \"28c69672-02bb-4e33-8321-ff35747a2678\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.081258 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.081241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkl9z\" (UniqueName: \"kubernetes.io/projected/97943946-7f99-4241-8a70-679012e01795-kube-api-access-bkl9z\") pod \"cluster-proxy-proxy-agent-678469d5bf-mlmdm\" (UID: \"97943946-7f99-4241-8a70-679012e01795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.270547 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.270468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 20:59:42.276236 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.276217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:42.394658 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.394631 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm"] Jun 05 20:59:42.397378 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:59:42.397353 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97943946_7f99_4241_8a70_679012e01795.slice/crio-369e3601e7b05cfe8ddd7b418850da113e8065535947eccea52a9bf179bb91bf WatchSource:0}: Error finding container 369e3601e7b05cfe8ddd7b418850da113e8065535947eccea52a9bf179bb91bf: Status 404 returned error can't find the container with id 369e3601e7b05cfe8ddd7b418850da113e8065535947eccea52a9bf179bb91bf Jun 05 20:59:42.409191 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.409167 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg"] Jun 05 20:59:42.411662 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:59:42.411640 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c69672_02bb_4e33_8321_ff35747a2678.slice/crio-ba47ea9a50e935cf99d7f15be8dff4be3243c50e140a7f4a3e1a78df775d9355 WatchSource:0}: Error finding container ba47ea9a50e935cf99d7f15be8dff4be3243c50e140a7f4a3e1a78df775d9355: Status 404 returned error can't find the container with id ba47ea9a50e935cf99d7f15be8dff4be3243c50e140a7f4a3e1a78df775d9355 Jun 05 20:59:42.426627 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.426605 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" event={"ID":"97943946-7f99-4241-8a70-679012e01795","Type":"ContainerStarted","Data":"369e3601e7b05cfe8ddd7b418850da113e8065535947eccea52a9bf179bb91bf"} Jun 05 20:59:42.427642 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:42.427623 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" event={"ID":"28c69672-02bb-4e33-8321-ff35747a2678","Type":"ContainerStarted","Data":"ba47ea9a50e935cf99d7f15be8dff4be3243c50e140a7f4a3e1a78df775d9355"} Jun 05 20:59:45.367808 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:45.367775 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bghj9" Jun 05 20:59:45.521034 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:45.520973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:45.570730 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:45.570695 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:48.447230 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.447180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" event={"ID":"28c69672-02bb-4e33-8321-ff35747a2678","Type":"ContainerStarted","Data":"790be480cbd22520ad563f320f3c59bc5d851215794e4aee286e24a65955cc40"} Jun 05 20:59:48.447666 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.447252 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:48.448994 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.448973 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 20:59:48.449343 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.449321 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" event={"ID":"97943946-7f99-4241-8a70-679012e01795","Type":"ContainerStarted","Data":"dac6bcf9460c50a9de892507ed4ae5d49cd631e64e4859fe4fc63e90ba63ef0f"} Jun 05 20:59:48.449399 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.449355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" event={"ID":"97943946-7f99-4241-8a70-679012e01795","Type":"ContainerStarted","Data":"ecb930156102109adc25cc4ab48b142da54256f367c3ac2b4b68883ce64b554f"} Jun 05 20:59:48.449399 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.449368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" event={"ID":"97943946-7f99-4241-8a70-679012e01795","Type":"ContainerStarted","Data":"33e98ae77b8fd8bf635a648054b9ea5078d3e562866fc3d5d1a54eab41e770dd"} Jun 05 20:59:48.462530 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.462496 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" podStartSLOduration=2.203573049 podStartE2EDuration="7.462485103s" totalImagesPullingTime="5.258912054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:48.461778582 +0000 UTC m=+63.695044616" watchObservedRunningTime="2026-06-05 20:59:48.462485103 +0000 UTC m=+63.695751130" Jun 05 20:59:48.492650 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:48.492612 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" podStartSLOduration=2.220574017 podStartE2EDuration="7.492601332s" totalImagesPullingTime="5.272027315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:48.491402565 +0000 UTC m=+63.724668598" watchObservedRunningTime="2026-06-05 20:59:48.492601332 +0000 UTC m=+63.725867365" Jun 05 20:59:50.942839 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:50.942805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 20:59:50.942839 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:50.942843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:50.945659 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:50.945642 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 20:59:50.945714 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:50.945673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 20:59:50.953772 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:50.953753 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 20:59:50.953832 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:50.953807 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 21:00:54.953791554 +0000 UTC m=+130.187057566 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : secret "metrics-daemon-secret" not found Jun 05 20:59:50.955966 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:50.955940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43e216a-aa76-4c86-a622-4f420b93b79b-original-pull-secret\") pod \"global-pull-secret-syncer-px84m\" (UID: \"c43e216a-aa76-4c86-a622-4f420b93b79b\") " pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:51.143659 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.143629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:51.146474 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.146458 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 20:59:51.156347 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.156334 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 20:59:51.167525 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.167499 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcqlj\" (UniqueName: \"kubernetes.io/projected/69683b2d-c165-4178-bb72-4f685b3c408b-kube-api-access-fcqlj\") pod \"network-check-target-n5ch4\" (UID: \"69683b2d-c165-4178-bb72-4f685b3c408b\") " pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:51.230532 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.230473 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px84m" Jun 05 20:59:51.238488 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.238469 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gblp8\"" Jun 05 20:59:51.246773 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.246755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:51.356583 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.356556 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px84m"] Jun 05 20:59:51.359719 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:59:51.359693 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43e216a_aa76_4c86_a622_4f420b93b79b.slice/crio-a246adf84486236ad9ac3277fdf81fc5712263c78612e1ca0b5c2f46bde04db2 WatchSource:0}: Error finding container a246adf84486236ad9ac3277fdf81fc5712263c78612e1ca0b5c2f46bde04db2: Status 404 returned error can't find the container with id a246adf84486236ad9ac3277fdf81fc5712263c78612e1ca0b5c2f46bde04db2 Jun 05 20:59:51.371723 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.371700 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n5ch4"] Jun 05 20:59:51.373605 ip-10-0-138-251 kubenswrapper[2559]: W0605 20:59:51.373582 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69683b2d_c165_4178_bb72_4f685b3c408b.slice/crio-6e3bd2ad197886dbbe76af73e99a694463a8b4b4b62d4250e57da9f0b3e00e6f WatchSource:0}: Error finding container 6e3bd2ad197886dbbe76af73e99a694463a8b4b4b62d4250e57da9f0b3e00e6f: Status 404 returned error can't find the container with id 6e3bd2ad197886dbbe76af73e99a694463a8b4b4b62d4250e57da9f0b3e00e6f Jun 05 20:59:51.446419 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.446392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 20:59:51.446529 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:51.446512 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:51.446591 ip-10-0-138-251 kubenswrapper[2559]: E0605 20:59:51.446580 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 21:00:23.446559655 +0000 UTC m=+98.679825669 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 20:59:51.456681 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.456661 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n5ch4" event={"ID":"69683b2d-c165-4178-bb72-4f685b3c408b","Type":"ContainerStarted","Data":"6e3bd2ad197886dbbe76af73e99a694463a8b4b4b62d4250e57da9f0b3e00e6f"} Jun 05 20:59:51.457688 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:51.457668 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px84m" event={"ID":"c43e216a-aa76-4c86-a622-4f420b93b79b","Type":"ContainerStarted","Data":"a246adf84486236ad9ac3277fdf81fc5712263c78612e1ca0b5c2f46bde04db2"} Jun 05 20:59:52.666405 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:52.666333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:52.718577 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:52.718547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:52.767529 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:52.767502 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 20:59:56.474532 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:56.474493 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n5ch4" event={"ID":"69683b2d-c165-4178-bb72-4f685b3c408b","Type":"ContainerStarted","Data":"24ae4567093f2b69982761315a69f1d82acc29e8cc087264166a1d2ccf7f9e32"} Jun 05 20:59:56.474987 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:56.474615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 20:59:56.476020 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:56.475997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px84m" event={"ID":"c43e216a-aa76-4c86-a622-4f420b93b79b","Type":"ContainerStarted","Data":"d4ed1170e7f259aced7c7b62240efaa487e4ef865ec71866395edff5e386a405"} Jun 05 20:59:56.489817 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:56.489776 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n5ch4" podStartSLOduration=67.305437363 podStartE2EDuration="1m11.489765738s" totalImagesPullingTime="4.184328375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:56.488253932 +0000 UTC m=+71.721519966" watchObservedRunningTime="2026-06-05 20:59:56.489765738 +0000 UTC m=+71.723031771" Jun 05 20:59:56.502320 ip-10-0-138-251 kubenswrapper[2559]: I0605 20:59:56.502284 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-px84m" podStartSLOduration=67.299385484 podStartE2EDuration="1m11.502272336s" totalImagesPullingTime="4.202886852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:56.501863298 +0000 UTC m=+71.735129331" watchObservedRunningTime="2026-06-05 20:59:56.502272336 +0000 UTC m=+71.735538368" Jun 05 21:00:23.461412 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:00:23.461377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 21:00:23.461820 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:00:23.461526 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:00:23.461820 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:00:23.461619 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 21:01:27.461600755 +0000 UTC m=+162.694866766 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 21:00:27.483736 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:00:27.483706 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n5ch4" Jun 05 21:00:54.959870 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:00:54.959835 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 21:00:54.960367 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:00:54.959981 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:00:54.960367 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:00:54.960059 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs podName:53a39faf-b3bf-4573-9fb9-2637ac6c1a0f nodeName:}" failed. No retries permitted until 2026-06-05 21:02:56.960041127 +0000 UTC m=+252.193307142 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs") pod "network-metrics-daemon-mpdbw" (UID: "53a39faf-b3bf-4573-9fb9-2637ac6c1a0f") : secret "metrics-daemon-secret" not found Jun 05 21:01:22.624849 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:01:22.624808 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8n7bc" podUID="68595da0-67a0-4f47-aff0-582764bb90cf" Jun 05 21:01:22.728359 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:22.728333 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8n7bc" Jun 05 21:01:24.225474 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:01:24.225423 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mpdbw" podUID="53a39faf-b3bf-4573-9fb9-2637ac6c1a0f" Jun 05 21:01:27.474423 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:27.474387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 21:01:27.474895 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:01:27.474500 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:01:27.474895 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:01:27.474565 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls podName:68595da0-67a0-4f47-aff0-582764bb90cf nodeName:}" failed. No retries permitted until 2026-06-05 21:03:29.47455071 +0000 UTC m=+284.707816721 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls") pod "dns-default-8n7bc" (UID: "68595da0-67a0-4f47-aff0-582764bb90cf") : secret "dns-default-metrics-tls" not found Jun 05 21:01:39.213624 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:39.213589 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 21:01:47.800144 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:47.800118 2559 generic.go:356] "Generic (PLEG): container finished" podID="28c69672-02bb-4e33-8321-ff35747a2678" containerID="790be480cbd22520ad563f320f3c59bc5d851215794e4aee286e24a65955cc40" exitCode=1 Jun 05 21:01:47.800436 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:47.800159 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" event={"ID":"28c69672-02bb-4e33-8321-ff35747a2678","Type":"ContainerDied","Data":"790be480cbd22520ad563f320f3c59bc5d851215794e4aee286e24a65955cc40"} Jun 05 21:01:47.800480 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:47.800470 2559 scope.go:117] "RemoveContainer" containerID="790be480cbd22520ad563f320f3c59bc5d851215794e4aee286e24a65955cc40" Jun 05 21:01:48.447645 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:48.447602 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 21:01:48.804853 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:48.804817 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" event={"ID":"28c69672-02bb-4e33-8321-ff35747a2678","Type":"ContainerStarted","Data":"84d701398a694a643a054a99ac5fb0099ed0869813ee961241368aa3161afe60"} Jun 05 21:01:48.805377 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:48.805047 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 21:01:48.805890 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:48.805870 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f658b879d-hb7tg" Jun 05 21:01:51.456524 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:01:51.456481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:16.151413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:16.151379 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:16.251945 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:16.251889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:18.763765 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:18.763721 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:18.810104 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:18.810080 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:20.511493 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:20.511457 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:20.611373 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:20.611324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:20.729320 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:20.729289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:20.780700 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:20.780609 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:21.201935 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:21.201907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:21.292021 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:21.291976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:21.431188 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:21.431160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:21.532101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:21.532023 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:22.237620 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:22.237594 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffxkk_87447519-2834-48ac-b3d0-516b7055633b/dns-node-resolver/0.log" Jun 05 21:02:23.053148 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:23.053114 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:23.438058 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:23.437991 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7jnns_c82dff7b-8902-480e-8c51-98c164faa9bd/node-ca/0.log" Jun 05 21:02:23.880325 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:23.880294 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:24.038622 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:24.038599 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcmhx_c721f048-52b4-41b1-9568-ae2823f21b71/serve-healthcheck-canary/0.log" Jun 05 21:02:24.545139 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:24.545110 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:24.789157 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:24.789129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:24.890516 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:24.890453 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:24.985457 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:24.985431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:25.127957 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:25.127930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:25.245103 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:25.245004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:26.039930 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:26.039894 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:26.525646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:26.525575 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:26.645164 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:26.645137 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:26.849148 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:26.849118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:27.059871 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:27.059847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:27.439371 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:27.439343 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:28.241551 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:28.241523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:28.342491 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:28.342463 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:28.441980 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:28.441958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:28.642471 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:28.642448 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:28.839287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:28.839242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:29.038875 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:29.038804 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:29.435978 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:29.435949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:29.817463 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:29.817430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:30.038444 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:30.038380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:30.641487 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:30.641449 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:30.837995 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:30.837961 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:31.036548 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:31.036470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:31.239982 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:31.239955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:31.434913 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:31.434888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:31.840842 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:31.840813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:32.636471 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:32.636436 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:32.838084 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:32.838053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:33.242106 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:33.242075 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:33.434929 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:33.434905 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:33.536140 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:33.536077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:33.839613 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:33.839589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:34.030146 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:34.030120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:34.274513 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:34.274437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:34.436025 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:34.435981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:34.638920 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:34.638895 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:35.037489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:35.037420 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:35.442859 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:35.442829 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:35.636913 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:35.636869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:39.394736 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:39.394703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:39.483104 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:39.483075 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:39.528773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:39.528747 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:39.690072 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:39.690000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.052797 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.052769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.105907 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.105880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.466812 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.466728 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.513786 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.513759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.684734 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.684711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.734108 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.734051 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:40.869878 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:40.869847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:41.072314 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:41.072286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:41.481127 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:41.481048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:42.685522 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:42.685487 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:42.798014 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:42.797985 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:42.898643 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:42.898590 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:45.363596 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.363566 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j9dbx"] Jun 05 21:02:45.365762 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.365743 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.368475 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.368455 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4q526\"" Jun 05 21:02:45.368583 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.368504 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 21:02:45.369686 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.369668 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 21:02:45.369777 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.369667 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 21:02:45.369777 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.369708 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 21:02:45.380162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.380140 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9dbx"] Jun 05 21:02:45.458835 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.458807 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59bd9dfd6c-sc8ss"] Jun 05 21:02:45.460924 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.460909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.463912 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.463891 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9mmq4\"" Jun 05 21:02:45.463912 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.463908 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 21:02:45.464055 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.463891 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 21:02:45.464055 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.463921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 21:02:45.472375 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.472355 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 21:02:45.476526 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.476506 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bd9dfd6c-sc8ss"] Jun 05 21:02:45.480336 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.480316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:45.493709 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.493688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91add39a-8c0f-411d-9357-456e86f2667e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.493841 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.493718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zk6t\" (UniqueName: \"kubernetes.io/projected/91add39a-8c0f-411d-9357-456e86f2667e-kube-api-access-9zk6t\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.493841 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.493750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91add39a-8c0f-411d-9357-456e86f2667e-crio-socket\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.493841 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.493774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91add39a-8c0f-411d-9357-456e86f2667e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.493841 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.493808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91add39a-8c0f-411d-9357-456e86f2667e-data-volume\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.562741 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.562712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:45.594636 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-installation-pull-secrets\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.594716 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddh6x\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-kube-api-access-ddh6x\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.594716 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-registry-tls\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.594793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91add39a-8c0f-411d-9357-456e86f2667e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.594793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-registry-certificates\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.594865 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-trusted-ca\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.594865 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zk6t\" (UniqueName: \"kubernetes.io/projected/91add39a-8c0f-411d-9357-456e86f2667e-kube-api-access-9zk6t\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.594935 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-bound-sa-token\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.594935 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91add39a-8c0f-411d-9357-456e86f2667e-crio-socket\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.594935 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91add39a-8c0f-411d-9357-456e86f2667e-data-volume\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.595043 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.594978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-image-registry-private-configuration\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.595043 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.595029 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91add39a-8c0f-411d-9357-456e86f2667e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.595120 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.595055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-ca-trust-extracted\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.595120 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.595031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91add39a-8c0f-411d-9357-456e86f2667e-crio-socket\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.595242 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.595227 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91add39a-8c0f-411d-9357-456e86f2667e-data-volume\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.595407 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.595386 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91add39a-8c0f-411d-9357-456e86f2667e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.597246 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.597231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91add39a-8c0f-411d-9357-456e86f2667e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.605120 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.605097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zk6t\" (UniqueName: \"kubernetes.io/projected/91add39a-8c0f-411d-9357-456e86f2667e-kube-api-access-9zk6t\") pod \"insights-runtime-extractor-j9dbx\" (UID: \"91add39a-8c0f-411d-9357-456e86f2667e\") " pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.674401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.674323 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j9dbx" Jun 05 21:02:45.695851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.695826 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-installation-pull-secrets\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.695954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.695875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddh6x\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-kube-api-access-ddh6x\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.695954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.695902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-registry-tls\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.695954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.695940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-registry-certificates\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.696101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.695962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-trusted-ca\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.696101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.696001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-bound-sa-token\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.696101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.696036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-image-registry-private-configuration\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.696101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.696072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-ca-trust-extracted\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.696831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.696809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-ca-trust-extracted\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.696989 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.696917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-registry-certificates\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.697093 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.697002 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-trusted-ca\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.698505 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.698483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-registry-tls\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.698597 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.698494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-installation-pull-secrets\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.698845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.698828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-image-registry-private-configuration\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.703128 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.703111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddh6x\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-kube-api-access-ddh6x\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.703225 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.703189 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1-bound-sa-token\") pod \"image-registry-59bd9dfd6c-sc8ss\" (UID: \"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1\") " pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.772545 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.772520 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.796108 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.796086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j9dbx"] Jun 05 21:02:45.908733 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.908707 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bd9dfd6c-sc8ss"] Jun 05 21:02:45.911210 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:02:45.911173 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7955ee7_4e10_4856_b9ca_2d55eb9b5bc1.slice/crio-7e076bfd1ee13f196363ded409b83946774f1c4c9a46d2455cffb7bdf6ba3adf WatchSource:0}: Error finding container 7e076bfd1ee13f196363ded409b83946774f1c4c9a46d2455cffb7bdf6ba3adf: Status 404 returned error can't find the container with id 7e076bfd1ee13f196363ded409b83946774f1c4c9a46d2455cffb7bdf6ba3adf Jun 05 21:02:45.965890 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.965858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" event={"ID":"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1","Type":"ContainerStarted","Data":"df489d25051eeec966ec417d5f76986404fed8bae1e82b75f47e381efaada616"} Jun 05 21:02:45.966006 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.965920 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" event={"ID":"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1","Type":"ContainerStarted","Data":"7e076bfd1ee13f196363ded409b83946774f1c4c9a46d2455cffb7bdf6ba3adf"} Jun 05 21:02:45.966006 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.965948 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:02:45.967343 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.967322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9dbx" event={"ID":"91add39a-8c0f-411d-9357-456e86f2667e","Type":"ContainerStarted","Data":"bb55a26e7fc07a95b6e27249421ac4f11370b1090366a647c70e6a155015f8a4"} Jun 05 21:02:45.967441 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.967373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9dbx" event={"ID":"91add39a-8c0f-411d-9357-456e86f2667e","Type":"ContainerStarted","Data":"98298a8c265557eb8c9dd6279fda8af2ca3c7498b1f7fdbbe68312edd8cb3491"} Jun 05 21:02:45.982918 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:45.982878 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podStartSLOduration=0.982865026 podStartE2EDuration="982.865026ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:45.981580273 +0000 UTC m=+241.214846306" watchObservedRunningTime="2026-06-05 21:02:45.982865026 +0000 UTC m=+241.216131060" Jun 05 21:02:46.972534 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:46.972499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9dbx" event={"ID":"91add39a-8c0f-411d-9357-456e86f2667e","Type":"ContainerStarted","Data":"afd8df35219ff707b025410a759ddd8297ce7d2966470df9f271e6aef3362ad3"} Jun 05 21:02:47.775439 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:47.775401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:47.875967 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:47.875936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:48.215800 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:48.215759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:48.269816 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:48.269778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:48.783039 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:48.783002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:48.984543 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:48.984510 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j9dbx" event={"ID":"91add39a-8c0f-411d-9357-456e86f2667e","Type":"ContainerStarted","Data":"7f75c44f58249abe3cdde6a2556efeeff86482785313e879150cf59f8611da41"} Jun 05 21:02:49.001518 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:49.001471 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j9dbx" podStartSLOduration=1.5551893300000001 podStartE2EDuration="4.001457109s" totalImagesPullingTime="2.446267779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:02:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:48.999677268 +0000 UTC m=+244.232943304" watchObservedRunningTime="2026-06-05 21:02:49.001457109 +0000 UTC m=+244.234723182" Jun 05 21:02:51.088311 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:51.088281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:51.188853 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:51.188831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:52.688308 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:52.688275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:52.897969 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:52.897937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:52.997847 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:52.997755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:53.098235 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:53.098183 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:53.274443 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:53.274389 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:53.336295 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:53.336276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:54.335888 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.335798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:54.546168 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.546140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:54.606509 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.606439 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wtfwj"] Jun 05 21:02:54.608624 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.608603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.611216 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.611172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6tt9d\"" Jun 05 21:02:54.611303 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.611172 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 21:02:54.612417 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.612396 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 21:02:54.612511 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.612415 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 21:02:54.612511 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.612430 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 21:02:54.612511 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.612420 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 21:02:54.612511 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.612477 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 21:02:54.632329 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.632309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:54.734819 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.734797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:54.758918 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.758901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-root\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.758979 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.758927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.758979 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.758949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ce046a-7a82-4e52-9ced-8f95647f3758-metrics-client-ca\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.758979 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.758968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.759102 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.758999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-wtmp\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.759102 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.759056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-sys\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.759102 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.759075 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-textfile\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.759327 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.759109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtpph\" (UniqueName: \"kubernetes.io/projected/74ce046a-7a82-4e52-9ced-8f95647f3758-kube-api-access-vtpph\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.759327 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.759181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-tls\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.835553 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.835533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:54.859586 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-sys\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859586 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-textfile\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859712 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtpph\" (UniqueName: \"kubernetes.io/projected/74ce046a-7a82-4e52-9ced-8f95647f3758-kube-api-access-vtpph\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859712 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859643 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-sys\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859712 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-tls\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-root\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859770 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ce046a-7a82-4e52-9ced-8f95647f3758-metrics-client-ca\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.859851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-root\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.860077 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.859943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-wtmp\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.860077 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.860016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-textfile\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.860174 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.860109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-wtmp\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.860423 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.860399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74ce046a-7a82-4e52-9ced-8f95647f3758-metrics-client-ca\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.860423 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.860413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.862374 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.862349 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.862487 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.862470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/74ce046a-7a82-4e52-9ced-8f95647f3758-node-exporter-tls\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.866709 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.866684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtpph\" (UniqueName: \"kubernetes.io/projected/74ce046a-7a82-4e52-9ced-8f95647f3758-kube-api-access-vtpph\") pod \"node-exporter-wtfwj\" (UID: \"74ce046a-7a82-4e52-9ced-8f95647f3758\") " pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.917208 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.917175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtfwj" Jun 05 21:02:54.926140 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:02:54.926120 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ce046a_7a82_4e52_9ced_8f95647f3758.slice/crio-500e9e610867576402be9d1d3c25957b0fbdd14df07b16535b5505038f0a01ef WatchSource:0}: Error finding container 500e9e610867576402be9d1d3c25957b0fbdd14df07b16535b5505038f0a01ef: Status 404 returned error can't find the container with id 500e9e610867576402be9d1d3c25957b0fbdd14df07b16535b5505038f0a01ef Jun 05 21:02:54.935191 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:54.935173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:55.003135 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.003113 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtfwj" event={"ID":"74ce046a-7a82-4e52-9ced-8f95647f3758","Type":"ContainerStarted","Data":"500e9e610867576402be9d1d3c25957b0fbdd14df07b16535b5505038f0a01ef"} Jun 05 21:02:55.036523 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.036501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:55.136740 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.136688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:55.189373 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.189352 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:55.560227 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.560162 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:55.654048 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.654008 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:55.875493 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:55.875466 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:56.007101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:56.007075 2559 generic.go:356] "Generic (PLEG): container finished" podID="74ce046a-7a82-4e52-9ced-8f95647f3758" containerID="442026831e9180536293d8a9e13d0321e446778d5013b38b23222af5b0589890" exitCode=0 Jun 05 21:02:56.007221 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:56.007139 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtfwj" event={"ID":"74ce046a-7a82-4e52-9ced-8f95647f3758","Type":"ContainerDied","Data":"442026831e9180536293d8a9e13d0321e446778d5013b38b23222af5b0589890"} Jun 05 21:02:56.975014 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:56.974973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 21:02:56.977381 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:56.977354 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a39faf-b3bf-4573-9fb9-2637ac6c1a0f-metrics-certs\") pod \"network-metrics-daemon-mpdbw\" (UID: \"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f\") " pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 21:02:57.013515 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.013483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtfwj" event={"ID":"74ce046a-7a82-4e52-9ced-8f95647f3758","Type":"ContainerStarted","Data":"2153695f552b835462af6d638a2074fe25270046785d66f83f4404e31e8a05a1"} Jun 05 21:02:57.013648 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.013541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtfwj" event={"ID":"74ce046a-7a82-4e52-9ced-8f95647f3758","Type":"ContainerStarted","Data":"d55585f046941c99f0e601753fea5674fd10de6c1520ba44b60ee3c1a2e3af18"} Jun 05 21:02:57.031741 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.031693 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wtfwj" podStartSLOduration=2.115697899 podStartE2EDuration="3.03167874s" totalImagesPullingTime="853.096531ms" totalInitContainerRuntime="62.88431ms" isStatefulPod=true podCreationTimestamp="2026-06-05 21:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:57.030284637 +0000 UTC m=+252.263550670" watchObservedRunningTime="2026-06-05 21:02:57.03167874 +0000 UTC m=+252.264944773" Jun 05 21:02:57.216531 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.216505 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k95x8\"" Jun 05 21:02:57.224599 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.224581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mpdbw" Jun 05 21:02:57.338946 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.338924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mpdbw"] Jun 05 21:02:57.341310 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:02:57.341285 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a39faf_b3bf_4573_9fb9_2637ac6c1a0f.slice/crio-95ef65195d173bd4000c1a33c2d30d9e1bb695579853b537a604a38b3b7ff7c3 WatchSource:0}: Error finding container 95ef65195d173bd4000c1a33c2d30d9e1bb695579853b537a604a38b3b7ff7c3: Status 404 returned error can't find the container with id 95ef65195d173bd4000c1a33c2d30d9e1bb695579853b537a604a38b3b7ff7c3 Jun 05 21:02:57.497529 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.497473 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:57.561865 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.561842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:57.764427 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.764360 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:57.920102 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:57.920060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:58.018054 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:58.017989 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mpdbw" event={"ID":"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f","Type":"ContainerStarted","Data":"95ef65195d173bd4000c1a33c2d30d9e1bb695579853b537a604a38b3b7ff7c3"} Jun 05 21:02:58.688697 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:58.688656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:59.023266 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.023176 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mpdbw" event={"ID":"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f","Type":"ContainerStarted","Data":"7e6841b25cade0e4d6900e5eeb0c9ee3281cd9db11b58c4efd44be2038d3ae9b"} Jun 05 21:02:59.023266 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.023243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mpdbw" event={"ID":"53a39faf-b3bf-4573-9fb9-2637ac6c1a0f","Type":"ContainerStarted","Data":"d372e47a79bf0fb9cfbf283b89e69d38ce492bd0ef3b4e5b70e8b34413811ffd"} Jun 05 21:02:59.039522 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.039476 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mpdbw" podStartSLOduration=253.115532016 podStartE2EDuration="4m14.039461692s" totalImagesPullingTime="923.929676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:59.038326687 +0000 UTC m=+254.271592745" watchObservedRunningTime="2026-06-05 21:02:59.039461692 +0000 UTC m=+254.272727724" Jun 05 21:02:59.114596 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.114570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:59.163347 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.163324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:59.371324 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.371297 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:59.419781 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.419758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:02:59.711356 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:02:59.711281 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:00.780072 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.780041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:00.784921 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.784896 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:03:00.788377 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.788363 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.790844 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.790820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a583ptm7qt0uv\"" Jun 05 21:03:00.790958 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.790927 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 21:03:00.791157 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791142 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 21:03:00.791233 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791157 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 21:03:00.791290 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 21:03:00.791586 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791574 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 21:03:00.791657 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791575 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 21:03:00.791657 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791578 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 21:03:00.791992 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.791971 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 21:03:00.792253 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.792234 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 21:03:00.792318 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.792277 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 21:03:00.792564 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.792545 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 21:03:00.792663 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.792580 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v9hhx\"" Jun 05 21:03:00.792728 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.792697 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 21:03:00.793397 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.793379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 21:03:00.793493 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.793371 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 21:03:00.794373 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.794353 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 21:03:00.801505 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.801483 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:03:00.907260 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907356 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907356 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907286 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907356 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-config\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpr94\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-kube-api-access-qpr94\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907943 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:00.907943 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:00.907734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008630 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008630 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008630 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008630 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008630 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008882 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-config\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008882 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008882 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.008882 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpr94\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-kube-api-access-qpr94\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.008974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009283 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.009692 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.009594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.010128 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.010100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.010128 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.010111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.010690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.010667 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.012144 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.012124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.012813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.012407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.012813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.012707 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.012813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.012732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-config\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.012813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.012776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.013217 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.013176 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.013528 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.013488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.013711 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.013689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.014348 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.014316 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.014687 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.014665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.014736 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.014691 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.014736 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.014726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.014939 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.014923 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.019567 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.019544 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpr94\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-kube-api-access-qpr94\") pod \"prometheus-k8s-0\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.098515 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.098494 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:01.228190 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:01.228165 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:03:01.230285 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:03:01.230258 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc11218_5398_4b74_95ac_da0783bcd834.slice/crio-fceff2861c979c36b289a6cd4acdb9de71d7c10d8fdb199033c2053cdd1c7d7b WatchSource:0}: Error finding container fceff2861c979c36b289a6cd4acdb9de71d7c10d8fdb199033c2053cdd1c7d7b: Status 404 returned error can't find the container with id fceff2861c979c36b289a6cd4acdb9de71d7c10d8fdb199033c2053cdd1c7d7b Jun 05 21:03:02.034730 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:02.034693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"fceff2861c979c36b289a6cd4acdb9de71d7c10d8fdb199033c2053cdd1c7d7b"} Jun 05 21:03:03.039241 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:03.039182 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="aed1c23b16c1c9022255babf8240c2c16456400262ee787d0451ca66ce894ea7" exitCode=0 Jun 05 21:03:03.039241 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:03.039230 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"aed1c23b16c1c9022255babf8240c2c16456400262ee787d0451ca66ce894ea7"} Jun 05 21:03:03.105392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:03.105361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:03.206442 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:03.206411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:04.321645 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:04.321611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:04.369535 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:04.369512 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:05.777049 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:05.777018 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:05.777437 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:05.777069 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:06.978855 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:06.978820 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:06.979277 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:06.978878 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:07.057151 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:07.057109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"ed2ac680a17f5b69518802398c868832f6302a709c882c6c0c8587ca87780722"} Jun 05 21:03:07.057343 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:07.057256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"54a623a0ab8abf230f98d8468175d0121b5c15ce7d9db4158b897ec4149ced97"} Jun 05 21:03:08.064081 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:08.064034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"39b92f9608b06e4a474b7d85d0926c01c2f2879b0fd2be5635a2bf40afd4d0c6"} Jun 05 21:03:08.064470 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:08.064128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"dc026641a6124f085ee039bda13c3100ec779506d12be19d1020ae52a07774c5"} Jun 05 21:03:09.070329 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:09.070292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"6426bbc2efedfbe51e1a400f06b0f9e463d2a9bc93ff2c0aef4e4c35bd447fa3"} Jun 05 21:03:09.070704 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:09.070358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerStarted","Data":"d97bd21286f77d8ac6a25af30b6c101e5ff95445e0115db248364fa4e2f85b6f"} Jun 05 21:03:09.098168 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:09.098115 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.381408644 podStartE2EDuration="9.09809626s" totalImagesPullingTime="5.693770381s" totalInitContainerRuntime="22.917235ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:03:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:09.095943688 +0000 UTC m=+264.329209720" watchObservedRunningTime="2026-06-05 21:03:09.09809626 +0000 UTC m=+264.331362293" Jun 05 21:03:09.100423 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:09.100399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:09.149210 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:09.149174 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:11.099466 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:11.099434 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:03:12.792592 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:12.792558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:12.843277 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:12.843247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:15.776750 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:15.776716 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:15.777101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:15.776763 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:16.918724 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:16.918691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:16.976958 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:16.976928 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:16.977078 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:16.976982 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:22.271961 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:22.271927 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" podUID="97943946-7f99-4241-8a70-679012e01795" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 21:03:25.729614 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:03:25.729573 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8n7bc" podUID="68595da0-67a0-4f47-aff0-582764bb90cf" Jun 05 21:03:25.777503 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:25.777467 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:25.777623 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:25.777530 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:25.777623 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:25.777564 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:03:25.778022 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:25.777994 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"df489d25051eeec966ec417d5f76986404fed8bae1e82b75f47e381efaada616"} pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 21:03:25.781612 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:25.781584 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:25.781708 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:25.781636 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:26.126512 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:26.126487 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8n7bc" Jun 05 21:03:26.548413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:26.548384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:26.650287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:26.650260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:27.798741 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:27.798707 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:27.844068 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:27.844039 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:29.521690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:29.521652 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 21:03:29.523965 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:29.523945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68595da0-67a0-4f47-aff0-582764bb90cf-metrics-tls\") pod \"dns-default-8n7bc\" (UID: \"68595da0-67a0-4f47-aff0-582764bb90cf\") " pod="openshift-dns/dns-default-8n7bc" Jun 05 21:03:29.730365 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:29.730341 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fnqdb\"" Jun 05 21:03:29.738469 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:29.738441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8n7bc" Jun 05 21:03:29.857538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:29.857513 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8n7bc"] Jun 05 21:03:29.859935 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:03:29.859910 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68595da0_67a0_4f47_aff0_582764bb90cf.slice/crio-3927411757f4a3fcff7be461a2ed067b13232eea8b8f1247aa8ee84360d03808 WatchSource:0}: Error finding container 3927411757f4a3fcff7be461a2ed067b13232eea8b8f1247aa8ee84360d03808: Status 404 returned error can't find the container with id 3927411757f4a3fcff7be461a2ed067b13232eea8b8f1247aa8ee84360d03808 Jun 05 21:03:30.141069 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:30.141042 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8n7bc" event={"ID":"68595da0-67a0-4f47-aff0-582764bb90cf","Type":"ContainerStarted","Data":"3927411757f4a3fcff7be461a2ed067b13232eea8b8f1247aa8ee84360d03808"} Jun 05 21:03:32.149298 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.149256 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8n7bc" event={"ID":"68595da0-67a0-4f47-aff0-582764bb90cf","Type":"ContainerStarted","Data":"3d74351eceafeed73ee3b7f2e52001d6ba2c95b214d76d1203cffa4224011211"} Jun 05 21:03:32.149766 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.149316 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8n7bc" event={"ID":"68595da0-67a0-4f47-aff0-582764bb90cf","Type":"ContainerStarted","Data":"30959b0a9e01a460f6c2a6399f8a351dff3ab86665fd9a0f74e86eb1bedf3469"} Jun 05 21:03:32.149766 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.149400 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8n7bc" Jun 05 21:03:32.164296 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.164251 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8n7bc" podStartSLOduration=251.5896793 podStartE2EDuration="4m13.164239127s" totalImagesPullingTime="1.574559827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:32.163596291 +0000 UTC m=+287.396862325" watchObservedRunningTime="2026-06-05 21:03:32.164239127 +0000 UTC m=+287.397505161" Jun 05 21:03:32.272160 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.272129 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" podUID="97943946-7f99-4241-8a70-679012e01795" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 21:03:32.629970 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.629941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtfwj_74ce046a-7a82-4e52-9ced-8f95647f3758/init-textfile/0.log" Jun 05 21:03:32.831124 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:32.831095 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtfwj_74ce046a-7a82-4e52-9ced-8f95647f3758/node-exporter/0.log" Jun 05 21:03:33.030143 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:33.030073 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtfwj_74ce046a-7a82-4e52-9ced-8f95647f3758/kube-rbac-proxy/0.log" Jun 05 21:03:33.830237 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:33.830191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/init-config-reloader/0.log" Jun 05 21:03:34.031260 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:34.031234 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/prometheus/0.log" Jun 05 21:03:34.230983 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:34.230912 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/config-reloader/0.log" Jun 05 21:03:34.430158 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:34.430132 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/thanos-sidecar/0.log" Jun 05 21:03:34.630324 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:34.630302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/kube-rbac-proxy-web/0.log" Jun 05 21:03:34.830382 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:34.830357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/kube-rbac-proxy/0.log" Jun 05 21:03:35.030377 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:35.030319 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bc11218-5398-4b74-95ac-da0783bcd834/kube-rbac-proxy-thanos/0.log" Jun 05 21:03:35.782356 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:35.782326 2559 patch_prober.go:28] interesting pod/image-registry-59bd9dfd6c-sc8ss container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:35.782509 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:35.782372 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:36.096589 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:36.096560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:36.147052 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:36.147010 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:36.939399 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:36.939366 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:37.039052 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:37.039027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:37.153765 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:37.153740 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:38.431434 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:38.431403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8n7bc_68595da0-67a0-4f47-aff0-582764bb90cf/dns/0.log" Jun 05 21:03:38.630769 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:38.630743 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8n7bc_68595da0-67a0-4f47-aff0-582764bb90cf/kube-rbac-proxy/0.log" Jun 05 21:03:39.630921 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:39.630896 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffxkk_87447519-2834-48ac-b3d0-516b7055633b/dns-node-resolver/0.log" Jun 05 21:03:40.230807 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:40.230779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59bd9dfd6c-sc8ss_a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1/registry/0.log" Jun 05 21:03:40.830375 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:40.830345 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7jnns_c82dff7b-8902-480e-8c51-98c164faa9bd/node-ca/0.log" Jun 05 21:03:41.430334 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:41.430305 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcmhx_c721f048-52b4-41b1-9568-ae2823f21b71/serve-healthcheck-canary/0.log" Jun 05 21:03:42.155506 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:42.155469 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8n7bc" Jun 05 21:03:42.272113 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:42.272074 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" podUID="97943946-7f99-4241-8a70-679012e01795" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 05 21:03:42.272299 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:42.272142 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" Jun 05 21:03:42.272621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:42.272603 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"dac6bcf9460c50a9de892507ed4ae5d49cd631e64e4859fe4fc63e90ba63ef0f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 05 21:03:42.272659 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:42.272647 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" podUID="97943946-7f99-4241-8a70-679012e01795" containerName="service-proxy" containerID="cri-o://dac6bcf9460c50a9de892507ed4ae5d49cd631e64e4859fe4fc63e90ba63ef0f" gracePeriod=30 Jun 05 21:03:43.190064 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:43.190034 2559 generic.go:356] "Generic (PLEG): container finished" podID="97943946-7f99-4241-8a70-679012e01795" containerID="dac6bcf9460c50a9de892507ed4ae5d49cd631e64e4859fe4fc63e90ba63ef0f" exitCode=2 Jun 05 21:03:43.190444 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:43.190109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" event={"ID":"97943946-7f99-4241-8a70-679012e01795","Type":"ContainerDied","Data":"dac6bcf9460c50a9de892507ed4ae5d49cd631e64e4859fe4fc63e90ba63ef0f"} Jun 05 21:03:43.190444 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:43.190154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-678469d5bf-mlmdm" event={"ID":"97943946-7f99-4241-8a70-679012e01795","Type":"ContainerStarted","Data":"fa6c15a06e2c4fd39306e52c5836747acc912822894dbf7919d961becff3559d"} Jun 05 21:03:43.246037 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:43.246004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:44.440603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:44.440572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:44.635823 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:44.635787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:44.737779 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:44.737703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:44.781874 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:44.781814 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:45.164997 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:45.164973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:03:45.167551 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:45.167527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:03:45.173165 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:45.173143 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 21:03:45.782583 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:45.782557 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:03:45.892437 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:45.892405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:45.943285 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:45.943255 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:46.057503 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:46.057480 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:46.108418 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:46.108396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:50.796854 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:50.796818 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" podUID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerName="registry" containerID="cri-o://df489d25051eeec966ec417d5f76986404fed8bae1e82b75f47e381efaada616" gracePeriod=30 Jun 05 21:03:52.223930 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:52.223852 2559 generic.go:356] "Generic (PLEG): container finished" podID="a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1" containerID="df489d25051eeec966ec417d5f76986404fed8bae1e82b75f47e381efaada616" exitCode=0 Jun 05 21:03:52.223930 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:52.223910 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" event={"ID":"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1","Type":"ContainerDied","Data":"df489d25051eeec966ec417d5f76986404fed8bae1e82b75f47e381efaada616"} Jun 05 21:03:52.224330 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:52.223948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" event={"ID":"a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1","Type":"ContainerStarted","Data":"9c599d71ba496166b1aee97718a3bf7165e7921a08c28d3fcdc987830d76d6f9"} Jun 05 21:03:52.224330 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:52.224018 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:03:52.504009 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:52.503926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:52.605382 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:52.605336 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:53.105028 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:53.104997 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:53.155622 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:53.155594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:57.390761 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:57.390726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:57.439842 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:57.439808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:57.790490 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:57.790465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:03:57.838625 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:03:57.838602 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:01.099152 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:01.099122 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:01.118287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:01.118263 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:01.275917 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:01.275890 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:02.129637 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:02.129602 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:06.503845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:06.503799 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:06.602392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:06.602358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:12.796775 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:12.796737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:12.847943 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:12.847920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:13.236222 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:13.236139 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59bd9dfd6c-sc8ss" Jun 05 21:04:13.401033 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:13.401005 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:13.449688 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:13.449656 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:13.759128 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:13.759095 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:14.192640 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:14.192608 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:15.006001 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:15.005973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:15.052442 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:15.052417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:19.140578 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140540 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:04:19.140986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140852 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy" containerID="cri-o://d97bd21286f77d8ac6a25af30b6c101e5ff95445e0115db248364fa4e2f85b6f" gracePeriod=600 Jun 05 21:04:19.140986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140858 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-web" containerID="cri-o://39b92f9608b06e4a474b7d85d0926c01c2f2879b0fd2be5635a2bf40afd4d0c6" gracePeriod=600 Jun 05 21:04:19.140986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140895 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6426bbc2efedfbe51e1a400f06b0f9e463d2a9bc93ff2c0aef4e4c35bd447fa3" gracePeriod=600 Jun 05 21:04:19.140986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140908 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="thanos-sidecar" containerID="cri-o://dc026641a6124f085ee039bda13c3100ec779506d12be19d1020ae52a07774c5" gracePeriod=600 Jun 05 21:04:19.141230 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140977 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="prometheus" containerID="cri-o://54a623a0ab8abf230f98d8468175d0121b5c15ce7d9db4158b897ec4149ced97" gracePeriod=600 Jun 05 21:04:19.141230 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.140921 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="config-reloader" containerID="cri-o://ed2ac680a17f5b69518802398c868832f6302a709c882c6c0c8587ca87780722" gracePeriod=600 Jun 05 21:04:19.324827 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324796 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="6426bbc2efedfbe51e1a400f06b0f9e463d2a9bc93ff2c0aef4e4c35bd447fa3" exitCode=0 Jun 05 21:04:19.324827 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324829 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="d97bd21286f77d8ac6a25af30b6c101e5ff95445e0115db248364fa4e2f85b6f" exitCode=0 Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324840 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="39b92f9608b06e4a474b7d85d0926c01c2f2879b0fd2be5635a2bf40afd4d0c6" exitCode=0 Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324849 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="dc026641a6124f085ee039bda13c3100ec779506d12be19d1020ae52a07774c5" exitCode=0 Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324857 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="ed2ac680a17f5b69518802398c868832f6302a709c882c6c0c8587ca87780722" exitCode=0 Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324865 2559 generic.go:356] "Generic (PLEG): container finished" podID="8bc11218-5398-4b74-95ac-da0783bcd834" containerID="54a623a0ab8abf230f98d8468175d0121b5c15ce7d9db4158b897ec4149ced97" exitCode=0 Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"6426bbc2efedfbe51e1a400f06b0f9e463d2a9bc93ff2c0aef4e4c35bd447fa3"} Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324942 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"d97bd21286f77d8ac6a25af30b6c101e5ff95445e0115db248364fa4e2f85b6f"} Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.324985 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"39b92f9608b06e4a474b7d85d0926c01c2f2879b0fd2be5635a2bf40afd4d0c6"} Jun 05 21:04:19.325032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.325028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"dc026641a6124f085ee039bda13c3100ec779506d12be19d1020ae52a07774c5"} Jun 05 21:04:19.325336 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.325067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"ed2ac680a17f5b69518802398c868832f6302a709c882c6c0c8587ca87780722"} Jun 05 21:04:19.325336 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.325110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"54a623a0ab8abf230f98d8468175d0121b5c15ce7d9db4158b897ec4149ced97"} Jun 05 21:04:19.376882 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.376862 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:19.464954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.464895 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-tls-assets\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.464954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.464933 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-grpc-tls\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.464954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.464955 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-tls\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.464970 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-thanos-prometheus-http-client-file\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.464990 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-config-out\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465009 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-metrics-client-ca\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465034 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-trusted-ca-bundle\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465051 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-2\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465068 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-1\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465087 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-metrics-client-certs\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465118 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpr94\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-kube-api-access-qpr94\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465148 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-db\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465170 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-kubelet-serving-ca-bundle\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465188 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-config\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465297 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-kube-rbac-proxy\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465334 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-0\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465366 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-serving-certs-ca-bundle\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465399 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465425 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-web-config\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465452 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8bc11218-5398-4b74-95ac-da0783bcd834\" (UID: \"8bc11218-5398-4b74-95ac-da0783bcd834\") " Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465512 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.465603 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465527 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.466087 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465704 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-metrics-client-ca\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.466087 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465723 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.466087 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.465908 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.467763 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.467729 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.467881 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.467758 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.467881 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.467774 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.468050 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468020 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-config" (OuterVolumeSpecName: "config") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.468162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468051 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.468162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468081 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.468312 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468259 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.468408 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468379 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-config-out" (OuterVolumeSpecName: "config-out") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:04:19.468582 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468556 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.468678 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468657 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:04:19.468758 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.468734 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.469038 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.469004 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:04:19.469611 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.469583 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:19.469683 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.469666 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-kube-api-access-qpr94" (OuterVolumeSpecName: "kube-api-access-qpr94") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "kube-api-access-qpr94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:04:19.470312 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.470292 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.470595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.470582 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.479102 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.479071 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-web-config" (OuterVolumeSpecName: "web-config") pod "8bc11218-5398-4b74-95ac-da0783bcd834" (UID: "8bc11218-5398-4b74-95ac-da0783bcd834"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:19.566482 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566449 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpr94\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-kube-api-access-qpr94\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566482 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566481 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-db\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566498 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566513 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-config\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566526 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-kube-rbac-proxy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566539 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566551 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566565 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566579 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-web-config\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566591 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566604 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bc11218-5398-4b74-95ac-da0783bcd834-tls-assets\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566618 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-grpc-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566632 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.566646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566646 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.567020 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566658 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bc11218-5398-4b74-95ac-da0783bcd834-config-out\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.567020 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566672 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.567020 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566686 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bc11218-5398-4b74-95ac-da0783bcd834-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:19.567020 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:19.566700 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bc11218-5398-4b74-95ac-da0783bcd834-secret-metrics-client-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:04:20.331609 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.331572 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bc11218-5398-4b74-95ac-da0783bcd834","Type":"ContainerDied","Data":"fceff2861c979c36b289a6cd4acdb9de71d7c10d8fdb199033c2053cdd1c7d7b"} Jun 05 21:04:20.332048 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.331629 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.332048 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.331653 2559 scope.go:117] "RemoveContainer" containerID="6426bbc2efedfbe51e1a400f06b0f9e463d2a9bc93ff2c0aef4e4c35bd447fa3" Jun 05 21:04:20.341293 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.341276 2559 scope.go:117] "RemoveContainer" containerID="d97bd21286f77d8ac6a25af30b6c101e5ff95445e0115db248364fa4e2f85b6f" Jun 05 21:04:20.348647 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.348631 2559 scope.go:117] "RemoveContainer" containerID="39b92f9608b06e4a474b7d85d0926c01c2f2879b0fd2be5635a2bf40afd4d0c6" Jun 05 21:04:20.354808 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.354784 2559 scope.go:117] "RemoveContainer" containerID="dc026641a6124f085ee039bda13c3100ec779506d12be19d1020ae52a07774c5" Jun 05 21:04:20.356575 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.356553 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:04:20.360799 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.360775 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:04:20.361654 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.361636 2559 scope.go:117] "RemoveContainer" containerID="ed2ac680a17f5b69518802398c868832f6302a709c882c6c0c8587ca87780722" Jun 05 21:04:20.367761 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.367746 2559 scope.go:117] "RemoveContainer" containerID="54a623a0ab8abf230f98d8468175d0121b5c15ce7d9db4158b897ec4149ced97" Jun 05 21:04:20.374133 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.374118 2559 scope.go:117] "RemoveContainer" containerID="aed1c23b16c1c9022255babf8240c2c16456400262ee787d0451ca66ce894ea7" Jun 05 21:04:20.383573 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383555 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:04:20.383775 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383764 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="prometheus" Jun 05 21:04:20.383813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383777 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="prometheus" Jun 05 21:04:20.383813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383786 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="thanos-sidecar" Jun 05 21:04:20.383813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383791 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="thanos-sidecar" Jun 05 21:04:20.383813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383799 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-web" Jun 05 21:04:20.383813 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383808 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-web" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383816 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383821 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383829 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="config-reloader" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383834 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="config-reloader" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383840 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-thanos" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383845 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-thanos" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383859 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="init-config-reloader" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383863 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="init-config-reloader" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383905 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="thanos-sidecar" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383913 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383919 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-web" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383926 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="config-reloader" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383931 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="prometheus" Jun 05 21:04:20.383962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.383936 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" containerName="kube-rbac-proxy-thanos" Jun 05 21:04:20.387497 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.387483 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.389971 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.389952 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 21:04:20.390082 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390020 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 21:04:20.390082 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390022 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 21:04:20.390427 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390407 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 21:04:20.390427 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390422 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 21:04:20.390570 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390413 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 21:04:20.390570 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390513 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 21:04:20.390791 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390774 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 21:04:20.390899 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390880 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v9hhx\"" Jun 05 21:04:20.390999 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.390971 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a583ptm7qt0uv\"" Jun 05 21:04:20.391176 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.391156 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 21:04:20.391293 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.391207 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 21:04:20.391293 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.391266 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 21:04:20.391413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.391350 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 21:04:20.391413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.391389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 21:04:20.397510 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.397489 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 21:04:20.399306 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.399286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 21:04:20.403954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.403934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:04:20.472457 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-config-out\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472457 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472457 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b64bs\" (UniqueName: \"kubernetes.io/projected/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-kube-api-access-b64bs\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-web-config\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472726 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-config\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472937 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472937 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472937 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472937 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.472937 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.472841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574135 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574268 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574268 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64bs\" (UniqueName: \"kubernetes.io/projected/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-kube-api-access-b64bs\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574268 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574429 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574429 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574531 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574460 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-web-config\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574531 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574496 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-config\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574634 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574634 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574634 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574634 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-config-out\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.574831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.575192 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574849 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.575192 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.575192 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.574979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.575486 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.575464 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.575831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.575811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.576468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.576443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.577327 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.577300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-config-out\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.577426 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.577404 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.577487 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.577418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.577595 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.577572 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-web-config\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.578184 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.577725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.578184 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.577776 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.578184 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.578131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.578410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.578387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-config\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.578864 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.578838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.579897 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.579864 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.580150 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.580122 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.580252 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.580160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.580252 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.580231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.580822 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.580804 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.581881 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.581862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b64bs\" (UniqueName: \"kubernetes.io/projected/23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95-kube-api-access-b64bs\") pod \"prometheus-k8s-0\" (UID: \"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.698380 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.698342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:20.827345 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:20.827318 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 21:04:20.829611 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:04:20.829588 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ecf4d7_4892_4fe7_ae2e_4d1df2f65b95.slice/crio-38a8c0151d7fc0c6965f07142bad0a0fc4c62595305b735b663f057e14852464 WatchSource:0}: Error finding container 38a8c0151d7fc0c6965f07142bad0a0fc4c62595305b735b663f057e14852464: Status 404 returned error can't find the container with id 38a8c0151d7fc0c6965f07142bad0a0fc4c62595305b735b663f057e14852464 Jun 05 21:04:21.217789 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:21.217751 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc11218-5398-4b74-95ac-da0783bcd834" path="/var/lib/kubelet/pods/8bc11218-5398-4b74-95ac-da0783bcd834/volumes" Jun 05 21:04:21.336052 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:21.336023 2559 generic.go:356] "Generic (PLEG): container finished" podID="23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95" containerID="e34bb57f7a7a4424d4c4a0d1e909a85562b1dfa50689e01b66217e7b575f6834" exitCode=0 Jun 05 21:04:21.336436 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:21.336104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerDied","Data":"e34bb57f7a7a4424d4c4a0d1e909a85562b1dfa50689e01b66217e7b575f6834"} Jun 05 21:04:21.336436 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:21.336220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"38a8c0151d7fc0c6965f07142bad0a0fc4c62595305b735b663f057e14852464"} Jun 05 21:04:22.343941 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.343911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"867b3101b8748b047d9c92dc2f5cc2cc018ae6a860b1dec9335be3d50b065ae4"} Jun 05 21:04:22.344413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.343972 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"d3036730248a8bf6c6f3fe907e923569bfa9840859d26d4e751879f0af9366fd"} Jun 05 21:04:22.344413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.343999 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"03c2fbf3c973d9e68a69f0e04d65c7c5d74436e61a83bac0f893a6cb089cf2fd"} Jun 05 21:04:22.344413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.344024 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"e7941dae8c5e3d4e03c62123179bb8b561e17b142bf5dbf80a306b6273d5d328"} Jun 05 21:04:22.344413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.344047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"ed152c2b87aa07b77435a988d004911f5b8bc2f02d7dcdc9759ea6ef073770da"} Jun 05 21:04:22.344413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.344079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95","Type":"ContainerStarted","Data":"7a33d277a234fa5a4a1dd559ec005d633c6ee9c01c7c0ba2d869939a75dedacb"} Jun 05 21:04:22.373697 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.373645 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.3552878870000002 podStartE2EDuration="2.373624254s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.336367ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:04:22.372354309 +0000 UTC m=+337.605620341" watchObservedRunningTime="2026-06-05 21:04:22.373624254 +0000 UTC m=+337.606890287" Jun 05 21:04:22.636972 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.636885 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:22.738002 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:22.737940 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:25.698829 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:25.698747 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:04:27.793254 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:27.793219 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:27.843626 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:27.843598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:33.421444 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:33.421402 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:56.993830 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:56.993774 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:04:57.043863 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:04:57.043833 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:02.392385 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:02.392346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:02.438933 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:02.438904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:20.698998 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:20.698966 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:05:20.714387 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:20.714363 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:05:21.557436 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:21.557411 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 21:05:28.995748 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:28.995712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:29.043302 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:29.043269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:37.083650 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:37.083617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:37.137831 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:37.137804 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:37.229976 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:37.229948 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:37.831938 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:37.831906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:37.879503 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:37.879478 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:40.759287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:40.759248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:40.807490 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:40.807464 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:47.730124 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:47.730085 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:47.831636 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:47.831601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:47.879137 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:47.879112 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.807101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:57.807026 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:57.908302 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:57.908275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:05:58.236361 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:05:58.236289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:06:24.378468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:06:24.378435 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:17.754560 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:17.754522 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:17.845996 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:17.845952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:33.099475 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:33.099441 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:44.231076 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:44.231027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:45.015235 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:45.015173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:47.838411 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:47.838362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:47.893597 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:47.893527 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:48.997462 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:48.997410 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:49.102167 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:49.102132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:49.497272 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:49.497243 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:49.594689 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:49.594658 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:52.297496 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:52.297463 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:52.890987 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:52.890952 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:54.634959 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:54.634926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:54.683134 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:54.683100 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:58.876636 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:58.876601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:07:58.924723 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:07:58.924678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:00.697986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:00.697954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:02.113947 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:02.113912 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:02.211368 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:02.211320 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:08.064252 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:08.064180 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:08.164348 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:08.164312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:10.351397 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:10.351336 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:27.472087 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:27.472049 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:27.563733 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:27.563704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.089225 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.089184 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.261970 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.261938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.363315 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.363183 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.425211 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.425181 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p"] Jun 05 21:08:28.428067 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.428054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.430702 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:08:28.430667 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="081fa85b-b121-4048-8260-88f92d99d8d2" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.431143 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:08:28.431120 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-w957v\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w957v\"" type="*v1.Secret" Jun 05 21:08:28.431449 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:08:28.431428 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 05 21:08:28.431524 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:08:28.431447 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret" Jun 05 21:08:28.432229 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:08:28.432189 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 21:08:28.432579 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:08:28.432545 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" Jun 05 21:08:28.470904 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.470882 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p"] Jun 05 21:08:28.514306 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.514286 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/081fa85b-b121-4048-8260-88f92d99d8d2-manifests\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.514621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.514327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/081fa85b-b121-4048-8260-88f92d99d8d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.514621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.514368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/081fa85b-b121-4048-8260-88f92d99d8d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.514621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.514395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/081fa85b-b121-4048-8260-88f92d99d8d2-tmp\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.514621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.514467 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wdst\" (UniqueName: \"kubernetes.io/projected/081fa85b-b121-4048-8260-88f92d99d8d2-kube-api-access-8wdst\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.566777 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.566751 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.614926 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.614874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/081fa85b-b121-4048-8260-88f92d99d8d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.614926 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.614903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/081fa85b-b121-4048-8260-88f92d99d8d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.614926 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.614920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/081fa85b-b121-4048-8260-88f92d99d8d2-tmp\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.615113 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.614962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wdst\" (UniqueName: \"kubernetes.io/projected/081fa85b-b121-4048-8260-88f92d99d8d2-kube-api-access-8wdst\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.615113 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.615012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/081fa85b-b121-4048-8260-88f92d99d8d2-manifests\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.615372 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.615355 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/081fa85b-b121-4048-8260-88f92d99d8d2-manifests\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.617079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.617059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/081fa85b-b121-4048-8260-88f92d99d8d2-tmp\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:28.660380 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.660355 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.760838 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.760816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.843943 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.843920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:28.904486 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:28.904435 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.005250 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.005229 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.106464 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.106442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:29.316945 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.316927 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 21:08:29.417624 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.417601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 21:08:29.427392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.427365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/081fa85b-b121-4048-8260-88f92d99d8d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:29.427476 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.427395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/081fa85b-b121-4048-8260-88f92d99d8d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:29.546314 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.546294 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w957v\"" Jun 05 21:08:29.815152 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.815130 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 21:08:29.924900 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.924876 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 21:08:29.929271 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.929247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wdst\" (UniqueName: \"kubernetes.io/projected/081fa85b-b121-4048-8260-88f92d99d8d2-kube-api-access-8wdst\") pod \"opendatahub-operator-controller-manager-7d46cb5566-rb75p\" (UID: \"081fa85b-b121-4048-8260-88f92d99d8d2\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:29.938123 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:29.938075 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:30.078334 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:30.078311 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p"] Jun 05 21:08:30.080648 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:08:30.080621 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081fa85b_b121_4048_8260_88f92d99d8d2.slice/crio-4c48d7979822bac43ce707a1366b603ccedd4491bab3952da69433588ef4c500 WatchSource:0}: Error finding container 4c48d7979822bac43ce707a1366b603ccedd4491bab3952da69433588ef4c500: Status 404 returned error can't find the container with id 4c48d7979822bac43ce707a1366b603ccedd4491bab3952da69433588ef4c500 Jun 05 21:08:30.082415 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:30.082399 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:08:30.186052 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:30.186024 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" event={"ID":"081fa85b-b121-4048-8260-88f92d99d8d2","Type":"ContainerStarted","Data":"4c48d7979822bac43ce707a1366b603ccedd4491bab3952da69433588ef4c500"} Jun 05 21:08:33.200190 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:33.200158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" event={"ID":"081fa85b-b121-4048-8260-88f92d99d8d2","Type":"ContainerStarted","Data":"33950a41311929031b607b512982d323c12264e9209c5ceafc24a12005426b16"} Jun 05 21:08:34.204695 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:34.204662 2559 generic.go:356] "Generic (PLEG): container finished" podID="081fa85b-b121-4048-8260-88f92d99d8d2" containerID="33950a41311929031b607b512982d323c12264e9209c5ceafc24a12005426b16" exitCode=0 Jun 05 21:08:34.205071 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:34.204753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" event={"ID":"081fa85b-b121-4048-8260-88f92d99d8d2","Type":"ContainerDied","Data":"33950a41311929031b607b512982d323c12264e9209c5ceafc24a12005426b16"} Jun 05 21:08:35.210709 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:35.210672 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" event={"ID":"081fa85b-b121-4048-8260-88f92d99d8d2","Type":"ContainerStarted","Data":"4e5fa45b3576d93235aeb678d5207218c906e43b2dd50ba8c6aa0f7c91bc1c03"} Jun 05 21:08:35.211155 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:35.210821 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:35.231401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:35.231354 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" podStartSLOduration=3.3216229090000002 podStartE2EDuration="7.231340014s" totalImagesPullingTime="2.938276533s" totalInitContainerRuntime="971.440572ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:35.22951643 +0000 UTC m=+590.462782463" watchObservedRunningTime="2026-06-05 21:08:35.231340014 +0000 UTC m=+590.464606106" Jun 05 21:08:38.840674 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:38.840639 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:38.961499 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:38.961468 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:39.679571 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:39.679539 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:39.782862 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:39.782832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:45.189529 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:45.189500 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:08:45.189890 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:45.189500 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:08:46.217066 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:46.217035 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-rb75p" Jun 05 21:08:47.633489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:47.633456 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:48.960804 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:48.960763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:49.047172 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:49.047141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:49.421216 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:49.421160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:55.398429 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.398351 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl"] Jun 05 21:08:55.400645 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.400628 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.404355 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.404321 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 21:08:55.404355 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.404333 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 21:08:55.404543 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.404321 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:55.404924 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.404898 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q8l9l\"" Jun 05 21:08:55.404924 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.404930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:55.405162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.404934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 21:08:55.413352 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.413328 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl"] Jun 05 21:08:55.512228 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.512182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f38ad861-771a-4859-8b54-936c3fb573c4-cert\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.512364 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.512236 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f38ad861-771a-4859-8b54-936c3fb573c4-metrics-cert\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.512364 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.512307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f38ad861-771a-4859-8b54-936c3fb573c4-manager-config\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.512364 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.512325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw86w\" (UniqueName: \"kubernetes.io/projected/f38ad861-771a-4859-8b54-936c3fb573c4-kube-api-access-pw86w\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.613032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.612999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f38ad861-771a-4859-8b54-936c3fb573c4-cert\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.613032 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.613033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f38ad861-771a-4859-8b54-936c3fb573c4-metrics-cert\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.613258 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.613059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f38ad861-771a-4859-8b54-936c3fb573c4-manager-config\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.613258 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.613078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw86w\" (UniqueName: \"kubernetes.io/projected/f38ad861-771a-4859-8b54-936c3fb573c4-kube-api-access-pw86w\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.613679 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.613656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f38ad861-771a-4859-8b54-936c3fb573c4-manager-config\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.615478 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.615448 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f38ad861-771a-4859-8b54-936c3fb573c4-cert\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.615602 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.615584 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f38ad861-771a-4859-8b54-936c3fb573c4-metrics-cert\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.621108 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.621081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw86w\" (UniqueName: \"kubernetes.io/projected/f38ad861-771a-4859-8b54-936c3fb573c4-kube-api-access-pw86w\") pod \"lws-controller-manager-695db9fb68-25bcl\" (UID: \"f38ad861-771a-4859-8b54-936c3fb573c4\") " pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.714214 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.714119 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:55.850744 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:55.850715 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl"] Jun 05 21:08:55.853812 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:08:55.853783 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38ad861_771a_4859_8b54_936c3fb573c4.slice/crio-b514cc1800392d57297e1d085efa88243ad3fbadecef0385e53fabd888c08aa1 WatchSource:0}: Error finding container b514cc1800392d57297e1d085efa88243ad3fbadecef0385e53fabd888c08aa1: Status 404 returned error can't find the container with id b514cc1800392d57297e1d085efa88243ad3fbadecef0385e53fabd888c08aa1 Jun 05 21:08:56.282565 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:56.282529 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" event={"ID":"f38ad861-771a-4859-8b54-936c3fb573c4","Type":"ContainerStarted","Data":"b514cc1800392d57297e1d085efa88243ad3fbadecef0385e53fabd888c08aa1"} Jun 05 21:08:57.939104 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:57.939072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:58.016895 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:58.016867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:58.082708 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:58.082673 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:58.452522 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:58.452494 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:59.019021 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:59.018986 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:59.295005 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:59.294973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" event={"ID":"f38ad861-771a-4859-8b54-936c3fb573c4","Type":"ContainerStarted","Data":"b0558c2a37d266bb0b87732a082c4015017dce15ae4be99e57e71bf3e27a90e9"} Jun 05 21:08:59.295225 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:59.295086 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:08:59.318950 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:59.318925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:08:59.341969 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:59.341926 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" podStartSLOduration=1.810843105 podStartE2EDuration="4.341913357s" totalImagesPullingTime="2.531070252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:59.339879351 +0000 UTC m=+614.573145458" watchObservedRunningTime="2026-06-05 21:08:59.341913357 +0000 UTC m=+614.575179399" Jun 05 21:08:59.397972 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:08:59.397947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:05.374471 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:05.374438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:05.476497 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:05.476472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:06.421969 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:06.421936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:06.489726 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:06.489699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:07.113620 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:07.113564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:07.217508 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:07.217477 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:07.721839 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:07.721787 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:10.300554 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:10.300527 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-695db9fb68-25bcl" Jun 05 21:09:17.578446 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:17.578411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:17.727918 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:17.727868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:17.919775 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:17.919711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:18.018760 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:18.018735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:18.073789 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:18.073767 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:20.135002 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:20.134954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:20.235588 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:20.235546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:22.483082 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:22.483048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:22.537463 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:22.537398 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:23.755680 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:23.755632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:23.853767 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:23.853734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:28.949572 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:28.949530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:33.043674 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.043636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:33.298472 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.298398 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8"] Jun 05 21:09:33.303536 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.303517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.306124 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.306101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 21:09:33.306256 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.306123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 21:09:33.306256 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.306101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 21:09:33.306256 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.306189 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d8jd9\"" Jun 05 21:09:33.312167 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.312144 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8"] Jun 05 21:09:33.324694 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.324675 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:33.380768 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.380744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.380878 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.380779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.380878 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.380804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.380995 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.380909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.380995 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.380949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.380995 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.380984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p98n\" (UniqueName: \"kubernetes.io/projected/afb569bb-4a2c-42aa-a103-da0f74f3cd09-kube-api-access-8p98n\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.381139 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.381013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.381139 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.381048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.381139 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.381089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.481740 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.481838 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.481838 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.481838 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481789 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p98n\" (UniqueName: \"kubernetes.io/projected/afb569bb-4a2c-42aa-a103-da0f74f3cd09-kube-api-access-8p98n\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.481838 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482044 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482044 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482044 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482044 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.481952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482301 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.482161 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482358 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.482305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482358 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.482328 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482458 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.482411 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.482721 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.482652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.484245 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.484223 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.484583 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.484568 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.489017 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.488988 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afb569bb-4a2c-42aa-a103-da0f74f3cd09-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.489234 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.489179 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p98n\" (UniqueName: \"kubernetes.io/projected/afb569bb-4a2c-42aa-a103-da0f74f3cd09-kube-api-access-8p98n\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcsjls8\" (UID: \"afb569bb-4a2c-42aa-a103-da0f74f3cd09\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.525154 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.525135 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:33.614021 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.613965 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:33.625420 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.625401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:33.736140 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:33.736117 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8"] Jun 05 21:09:33.738637 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:09:33.738610 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb569bb_4a2c_42aa_a103_da0f74f3cd09.slice/crio-e3231de831eb7e3f4d70b9e6a814e1f8cf94c57150aae34da13da868ab0b5107 WatchSource:0}: Error finding container e3231de831eb7e3f4d70b9e6a814e1f8cf94c57150aae34da13da868ab0b5107: Status 404 returned error can't find the container with id e3231de831eb7e3f4d70b9e6a814e1f8cf94c57150aae34da13da868ab0b5107 Jun 05 21:09:34.418333 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:34.418290 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" event={"ID":"afb569bb-4a2c-42aa-a103-da0f74f3cd09","Type":"ContainerStarted","Data":"e3231de831eb7e3f4d70b9e6a814e1f8cf94c57150aae34da13da868ab0b5107"} Jun 05 21:09:35.017553 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:35.017509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:35.118569 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:35.118535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:36.640396 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:36.640354 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:09:36.640702 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:36.640426 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:09:36.640702 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:36.640456 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:09:37.431830 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.431793 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" event={"ID":"afb569bb-4a2c-42aa-a103-da0f74f3cd09","Type":"ContainerStarted","Data":"234974ae0ffaf2c895d1835e7bb039e681882c414fd319ae8254a755b0cfd845"} Jun 05 21:09:37.451036 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.450995 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" podStartSLOduration=1.551449906 podStartE2EDuration="4.450981065s" totalImagesPullingTime="2.899531159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:37.450001869 +0000 UTC m=+652.683267902" watchObservedRunningTime="2026-06-05 21:09:37.450981065 +0000 UTC m=+652.684247097" Jun 05 21:09:37.614923 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.614898 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:37.619567 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.619547 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:37.813607 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.813579 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d4cdcb7d7-d984l"] Jun 05 21:09:37.816731 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.816711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:37.819578 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.819539 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jkk68\"" Jun 05 21:09:37.819578 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.819570 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 21:09:37.826629 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.826607 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d4cdcb7d7-d984l"] Jun 05 21:09:37.851829 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.851785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:37.917249 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.917225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1e67af61-4747-4a86-a6ba-3b63bb38db97-redirect-config\") pod \"dashboard-redirect-6d4cdcb7d7-d984l\" (UID: \"1e67af61-4747-4a86-a6ba-3b63bb38db97\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:37.917362 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:37.917261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jr27\" (UniqueName: \"kubernetes.io/projected/1e67af61-4747-4a86-a6ba-3b63bb38db97-kube-api-access-4jr27\") pod \"dashboard-redirect-6d4cdcb7d7-d984l\" (UID: \"1e67af61-4747-4a86-a6ba-3b63bb38db97\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:38.018447 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.018413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1e67af61-4747-4a86-a6ba-3b63bb38db97-redirect-config\") pod \"dashboard-redirect-6d4cdcb7d7-d984l\" (UID: \"1e67af61-4747-4a86-a6ba-3b63bb38db97\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:38.018565 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.018473 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jr27\" (UniqueName: \"kubernetes.io/projected/1e67af61-4747-4a86-a6ba-3b63bb38db97-kube-api-access-4jr27\") pod \"dashboard-redirect-6d4cdcb7d7-d984l\" (UID: \"1e67af61-4747-4a86-a6ba-3b63bb38db97\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:38.019061 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.019045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1e67af61-4747-4a86-a6ba-3b63bb38db97-redirect-config\") pod \"dashboard-redirect-6d4cdcb7d7-d984l\" (UID: \"1e67af61-4747-4a86-a6ba-3b63bb38db97\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:38.027256 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.027230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jr27\" (UniqueName: \"kubernetes.io/projected/1e67af61-4747-4a86-a6ba-3b63bb38db97-kube-api-access-4jr27\") pod \"dashboard-redirect-6d4cdcb7d7-d984l\" (UID: \"1e67af61-4747-4a86-a6ba-3b63bb38db97\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:38.129439 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.129386 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" Jun 05 21:09:38.249569 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.249548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d4cdcb7d7-d984l"] Jun 05 21:09:38.251552 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:09:38.251527 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e67af61_4747_4a86_a6ba_3b63bb38db97.slice/crio-298128641bb62a9828ef06483eefc97d928c61c4464c824ed5ecb69b3ce018d3 WatchSource:0}: Error finding container 298128641bb62a9828ef06483eefc97d928c61c4464c824ed5ecb69b3ce018d3: Status 404 returned error can't find the container with id 298128641bb62a9828ef06483eefc97d928c61c4464c824ed5ecb69b3ce018d3 Jun 05 21:09:38.437171 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.437109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" event={"ID":"1e67af61-4747-4a86-a6ba-3b63bb38db97","Type":"ContainerStarted","Data":"298128641bb62a9828ef06483eefc97d928c61c4464c824ed5ecb69b3ce018d3"} Jun 05 21:09:38.437473 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.437447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:38.438266 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:38.438247 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcsjls8" Jun 05 21:09:41.453665 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:41.453629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" event={"ID":"1e67af61-4747-4a86-a6ba-3b63bb38db97","Type":"ContainerStarted","Data":"3324671804da87fd29ed8572e0080d36a39f29139e9156f16c28609367d1f7b1"} Jun 05 21:09:41.469847 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:41.469792 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-d984l" podStartSLOduration=2.314806557 podStartE2EDuration="4.469776405s" totalImagesPullingTime="2.154969848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:41.468547196 +0000 UTC m=+656.701813224" watchObservedRunningTime="2026-06-05 21:09:41.469776405 +0000 UTC m=+656.703042438" Jun 05 21:09:49.137962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.137918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:49.239633 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.239599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:49.262233 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.262190 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j6lm5"] Jun 05 21:09:49.265317 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.265302 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:49.267880 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.267858 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:09:49.268003 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.267925 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mcszm\"" Jun 05 21:09:49.268884 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.268869 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:09:49.274688 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.274668 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j6lm5"] Jun 05 21:09:49.341421 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.341395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:09:49.413363 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.413306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltdw\" (UniqueName: \"kubernetes.io/projected/27278039-8826-4836-ac3c-1a1a67ed90c1-kube-api-access-8ltdw\") pod \"kuadrant-operator-catalog-j6lm5\" (UID: \"27278039-8826-4836-ac3c-1a1a67ed90c1\") " pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:49.514375 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.514352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltdw\" (UniqueName: \"kubernetes.io/projected/27278039-8826-4836-ac3c-1a1a67ed90c1-kube-api-access-8ltdw\") pod \"kuadrant-operator-catalog-j6lm5\" (UID: \"27278039-8826-4836-ac3c-1a1a67ed90c1\") " pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:49.522305 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.522282 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltdw\" (UniqueName: \"kubernetes.io/projected/27278039-8826-4836-ac3c-1a1a67ed90c1-kube-api-access-8ltdw\") pod \"kuadrant-operator-catalog-j6lm5\" (UID: \"27278039-8826-4836-ac3c-1a1a67ed90c1\") " pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:49.575947 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.575923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:49.629826 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.629799 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j6lm5"] Jun 05 21:09:49.696613 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.696592 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j6lm5"] Jun 05 21:09:49.698832 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:09:49.698808 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27278039_8826_4836_ac3c_1a1a67ed90c1.slice/crio-8156bda98a9ed83fbdb75f60a67fc02493e279293c299aedbdeb832f8380e613 WatchSource:0}: Error finding container 8156bda98a9ed83fbdb75f60a67fc02493e279293c299aedbdeb832f8380e613: Status 404 returned error can't find the container with id 8156bda98a9ed83fbdb75f60a67fc02493e279293c299aedbdeb832f8380e613 Jun 05 21:09:49.839451 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.839428 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6x95"] Jun 05 21:09:49.842634 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.842618 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:09:49.849988 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.849960 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6x95"] Jun 05 21:09:49.918145 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:49.918121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqvw\" (UniqueName: \"kubernetes.io/projected/530852b5-7741-49db-803b-602c6d620fa9-kube-api-access-dcqvw\") pod \"kuadrant-operator-catalog-z6x95\" (UID: \"530852b5-7741-49db-803b-602c6d620fa9\") " pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:09:50.019077 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:50.019015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqvw\" (UniqueName: \"kubernetes.io/projected/530852b5-7741-49db-803b-602c6d620fa9-kube-api-access-dcqvw\") pod \"kuadrant-operator-catalog-z6x95\" (UID: \"530852b5-7741-49db-803b-602c6d620fa9\") " pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:09:50.026921 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:50.026891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqvw\" (UniqueName: \"kubernetes.io/projected/530852b5-7741-49db-803b-602c6d620fa9-kube-api-access-dcqvw\") pod \"kuadrant-operator-catalog-z6x95\" (UID: \"530852b5-7741-49db-803b-602c6d620fa9\") " pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:09:50.152533 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:50.152505 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:09:50.274494 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:50.274426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z6x95"] Jun 05 21:09:50.277511 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:09:50.277486 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530852b5_7741_49db_803b_602c6d620fa9.slice/crio-e793bbd018e6e1826113282073cce056566702f0b157794f6bb3a21e13205f01 WatchSource:0}: Error finding container e793bbd018e6e1826113282073cce056566702f0b157794f6bb3a21e13205f01: Status 404 returned error can't find the container with id e793bbd018e6e1826113282073cce056566702f0b157794f6bb3a21e13205f01 Jun 05 21:09:50.486973 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:50.486935 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" event={"ID":"27278039-8826-4836-ac3c-1a1a67ed90c1","Type":"ContainerStarted","Data":"8156bda98a9ed83fbdb75f60a67fc02493e279293c299aedbdeb832f8380e613"} Jun 05 21:09:50.488055 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:50.488021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" event={"ID":"530852b5-7741-49db-803b-602c6d620fa9","Type":"ContainerStarted","Data":"e793bbd018e6e1826113282073cce056566702f0b157794f6bb3a21e13205f01"} Jun 05 21:09:52.499361 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.499318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" event={"ID":"530852b5-7741-49db-803b-602c6d620fa9","Type":"ContainerStarted","Data":"204e2c087bee88de56d3c92409590ab897165e30f48fe361c941af69cf978d85"} Jun 05 21:09:52.500798 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.500776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" event={"ID":"27278039-8826-4836-ac3c-1a1a67ed90c1","Type":"ContainerStarted","Data":"507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b"} Jun 05 21:09:52.500913 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.500820 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" podUID="27278039-8826-4836-ac3c-1a1a67ed90c1" containerName="registry-server" containerID="cri-o://507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b" gracePeriod=2 Jun 05 21:09:52.514396 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.514338 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" podStartSLOduration=1.796262059 podStartE2EDuration="3.514323555s" totalImagesPullingTime="1.718061496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:52.513668195 +0000 UTC m=+667.746934235" watchObservedRunningTime="2026-06-05 21:09:52.514323555 +0000 UTC m=+667.747589587" Jun 05 21:09:52.528676 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.528637 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" podStartSLOduration=1.234947027 podStartE2EDuration="3.528625495s" totalImagesPullingTime="2.293678468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:52.528035076 +0000 UTC m=+667.761301120" watchObservedRunningTime="2026-06-05 21:09:52.528625495 +0000 UTC m=+667.761891528" Jun 05 21:09:52.732842 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.732819 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:52.845467 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.845440 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltdw\" (UniqueName: \"kubernetes.io/projected/27278039-8826-4836-ac3c-1a1a67ed90c1-kube-api-access-8ltdw\") pod \"27278039-8826-4836-ac3c-1a1a67ed90c1\" (UID: \"27278039-8826-4836-ac3c-1a1a67ed90c1\") " Jun 05 21:09:52.847553 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.847523 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27278039-8826-4836-ac3c-1a1a67ed90c1-kube-api-access-8ltdw" (OuterVolumeSpecName: "kube-api-access-8ltdw") pod "27278039-8826-4836-ac3c-1a1a67ed90c1" (UID: "27278039-8826-4836-ac3c-1a1a67ed90c1"). InnerVolumeSpecName "kube-api-access-8ltdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:09:52.946850 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:52.946826 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltdw\" (UniqueName: \"kubernetes.io/projected/27278039-8826-4836-ac3c-1a1a67ed90c1-kube-api-access-8ltdw\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:09:53.506043 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.505949 2559 generic.go:356] "Generic (PLEG): container finished" podID="27278039-8826-4836-ac3c-1a1a67ed90c1" containerID="507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b" exitCode=0 Jun 05 21:09:53.506043 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.505998 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" Jun 05 21:09:53.506488 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.506039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" event={"ID":"27278039-8826-4836-ac3c-1a1a67ed90c1","Type":"ContainerDied","Data":"507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b"} Jun 05 21:09:53.506488 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.506086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-j6lm5" event={"ID":"27278039-8826-4836-ac3c-1a1a67ed90c1","Type":"ContainerDied","Data":"8156bda98a9ed83fbdb75f60a67fc02493e279293c299aedbdeb832f8380e613"} Jun 05 21:09:53.506488 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.506107 2559 scope.go:117] "RemoveContainer" containerID="507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b" Jun 05 21:09:53.514034 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.514018 2559 scope.go:117] "RemoveContainer" containerID="507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b" Jun 05 21:09:53.514295 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:09:53.514278 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b\": container with ID starting with 507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b not found: ID does not exist" containerID="507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b" Jun 05 21:09:53.514346 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.514302 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b"} err="failed to get container status \"507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b\": rpc error: code = NotFound desc = could not find container \"507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b\": container with ID starting with 507b5e435797c1c2bd57ef7d74789018cf606c7188a90759f453b7495439368b not found: ID does not exist" Jun 05 21:09:53.522293 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.522272 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j6lm5"] Jun 05 21:09:53.525587 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:53.525564 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-j6lm5"] Jun 05 21:09:55.218083 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:09:55.218036 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27278039-8826-4836-ac3c-1a1a67ed90c1" path="/var/lib/kubelet/pods/27278039-8826-4836-ac3c-1a1a67ed90c1/volumes" Jun 05 21:10:00.152986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:00.152931 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:10:00.153479 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:00.153031 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:10:00.174965 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:00.174941 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:10:00.554308 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:00.554284 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-z6x95" Jun 05 21:10:17.972238 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:17.972182 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:21.180701 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:21.180668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:21.766394 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:21.766362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:24.281525 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.281438 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k"] Jun 05 21:10:24.281960 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.281831 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27278039-8826-4836-ac3c-1a1a67ed90c1" containerName="registry-server" Jun 05 21:10:24.281960 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.281848 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27278039-8826-4836-ac3c-1a1a67ed90c1" containerName="registry-server" Jun 05 21:10:24.281960 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.281934 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27278039-8826-4836-ac3c-1a1a67ed90c1" containerName="registry-server" Jun 05 21:10:24.292523 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.292499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:24.293571 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.293550 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k"] Jun 05 21:10:24.295625 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.295604 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qpdkh\"" Jun 05 21:10:24.375576 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.375551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwr2\" (UniqueName: \"kubernetes.io/projected/51d85443-0e5b-410b-85a4-08f0ee036701-kube-api-access-xbwr2\") pod \"authorino-operator-75cc8d5cb7-f7n7k\" (UID: \"51d85443-0e5b-410b-85a4-08f0ee036701\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:24.476857 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.476831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwr2\" (UniqueName: \"kubernetes.io/projected/51d85443-0e5b-410b-85a4-08f0ee036701-kube-api-access-xbwr2\") pod \"authorino-operator-75cc8d5cb7-f7n7k\" (UID: \"51d85443-0e5b-410b-85a4-08f0ee036701\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:24.486124 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.486100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwr2\" (UniqueName: \"kubernetes.io/projected/51d85443-0e5b-410b-85a4-08f0ee036701-kube-api-access-xbwr2\") pod \"authorino-operator-75cc8d5cb7-f7n7k\" (UID: \"51d85443-0e5b-410b-85a4-08f0ee036701\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:24.603590 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.603563 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:24.743401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:24.743372 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k"] Jun 05 21:10:24.745538 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:10:24.745511 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d85443_0e5b_410b_85a4_08f0ee036701.slice/crio-f79a39e6a6b2c0ff9f57518989faab4fc55184d8eecffc07fd21e8cc71b51894 WatchSource:0}: Error finding container f79a39e6a6b2c0ff9f57518989faab4fc55184d8eecffc07fd21e8cc71b51894: Status 404 returned error can't find the container with id f79a39e6a6b2c0ff9f57518989faab4fc55184d8eecffc07fd21e8cc71b51894 Jun 05 21:10:25.035394 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:25.035323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:25.130872 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:25.130844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:25.391076 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:25.391044 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:25.631944 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:25.631905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" event={"ID":"51d85443-0e5b-410b-85a4-08f0ee036701","Type":"ContainerStarted","Data":"f79a39e6a6b2c0ff9f57518989faab4fc55184d8eecffc07fd21e8cc71b51894"} Jun 05 21:10:27.024376 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.024342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:27.573084 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.573048 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz"] Jun 05 21:10:27.575783 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.575767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:27.578375 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.578354 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6jwfj\"" Jun 05 21:10:27.578484 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.578406 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 21:10:27.586586 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.586564 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz"] Jun 05 21:10:27.606514 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.606479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrpl7\" (UniqueName: \"kubernetes.io/projected/8efe1f06-74e9-41dc-ac0f-387345233e0f-kube-api-access-nrpl7\") pod \"dns-operator-controller-manager-864dd78c4c-9hckz\" (UID: \"8efe1f06-74e9-41dc-ac0f-387345233e0f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:27.641999 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.641974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" event={"ID":"51d85443-0e5b-410b-85a4-08f0ee036701","Type":"ContainerStarted","Data":"6486b09754d6abeef151be9908605292efd30878521a7bb35fe66c17cf288474"} Jun 05 21:10:27.642103 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.642022 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:27.658137 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.658094 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" podStartSLOduration=1.34668363 podStartE2EDuration="3.658082948s" totalImagesPullingTime="2.311399318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:27.656977133 +0000 UTC m=+702.890243193" watchObservedRunningTime="2026-06-05 21:10:27.658082948 +0000 UTC m=+702.891348980" Jun 05 21:10:27.707639 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.707608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrpl7\" (UniqueName: \"kubernetes.io/projected/8efe1f06-74e9-41dc-ac0f-387345233e0f-kube-api-access-nrpl7\") pod \"dns-operator-controller-manager-864dd78c4c-9hckz\" (UID: \"8efe1f06-74e9-41dc-ac0f-387345233e0f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:27.716183 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.716164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrpl7\" (UniqueName: \"kubernetes.io/projected/8efe1f06-74e9-41dc-ac0f-387345233e0f-kube-api-access-nrpl7\") pod \"dns-operator-controller-manager-864dd78c4c-9hckz\" (UID: \"8efe1f06-74e9-41dc-ac0f-387345233e0f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:27.886472 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:27.886413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:28.024931 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:28.024910 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz"] Jun 05 21:10:28.027009 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:10:28.026981 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efe1f06_74e9_41dc_ac0f_387345233e0f.slice/crio-8ec82f6b31abab26f63fa4ed65455293059ea03392206ca7662a551a3153fffe WatchSource:0}: Error finding container 8ec82f6b31abab26f63fa4ed65455293059ea03392206ca7662a551a3153fffe: Status 404 returned error can't find the container with id 8ec82f6b31abab26f63fa4ed65455293059ea03392206ca7662a551a3153fffe Jun 05 21:10:28.184655 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:28.184592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:28.284717 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:28.284694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:28.647986 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:28.647954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" event={"ID":"8efe1f06-74e9-41dc-ac0f-387345233e0f","Type":"ContainerStarted","Data":"8ec82f6b31abab26f63fa4ed65455293059ea03392206ca7662a551a3153fffe"} Jun 05 21:10:30.067540 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:30.067513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:30.656660 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:30.656627 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" event={"ID":"8efe1f06-74e9-41dc-ac0f-387345233e0f","Type":"ContainerStarted","Data":"68b171b36e2940efbd16c30fcd613e4d93b87a82448ceef81a9af019d7520a63"} Jun 05 21:10:30.656833 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:30.656753 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:30.674321 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:30.674278 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" podStartSLOduration=1.5816781629999999 podStartE2EDuration="3.674266534s" totalImagesPullingTime="2.092588371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:30.672244187 +0000 UTC m=+705.905510220" watchObservedRunningTime="2026-06-05 21:10:30.674266534 +0000 UTC m=+705.907532566" Jun 05 21:10:31.985230 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:31.985185 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826"] Jun 05 21:10:31.988453 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:31.988438 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:31.991087 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:31.991068 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hvcs2\"" Jun 05 21:10:32.000808 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.000788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826"] Jun 05 21:10:32.046341 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.046317 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8934c99c-6298-45c3-b63c-a6c40cda74e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.046447 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.046357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v59r\" (UniqueName: \"kubernetes.io/projected/8934c99c-6298-45c3-b63c-a6c40cda74e2-kube-api-access-5v59r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.146764 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.146740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v59r\" (UniqueName: \"kubernetes.io/projected/8934c99c-6298-45c3-b63c-a6c40cda74e2-kube-api-access-5v59r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.146858 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.146803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8934c99c-6298-45c3-b63c-a6c40cda74e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.147114 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.147098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8934c99c-6298-45c3-b63c-a6c40cda74e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.154488 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.154463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v59r\" (UniqueName: \"kubernetes.io/projected/8934c99c-6298-45c3-b63c-a6c40cda74e2-kube-api-access-5v59r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.297838 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.297816 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:32.446181 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.446157 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826"] Jun 05 21:10:32.448066 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:10:32.448037 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8934c99c_6298_45c3_b63c_a6c40cda74e2.slice/crio-f93fbc11bd75da37b3ae16c8f458c95d40dc3deaa5faa4ca4e38814fbd1fa80a WatchSource:0}: Error finding container f93fbc11bd75da37b3ae16c8f458c95d40dc3deaa5faa4ca4e38814fbd1fa80a: Status 404 returned error can't find the container with id f93fbc11bd75da37b3ae16c8f458c95d40dc3deaa5faa4ca4e38814fbd1fa80a Jun 05 21:10:32.666357 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:32.666276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" event={"ID":"8934c99c-6298-45c3-b63c-a6c40cda74e2","Type":"ContainerStarted","Data":"f93fbc11bd75da37b3ae16c8f458c95d40dc3deaa5faa4ca4e38814fbd1fa80a"} Jun 05 21:10:33.185561 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:33.185520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:33.281610 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:33.281579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:37.690120 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:37.690083 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" event={"ID":"8934c99c-6298-45c3-b63c-a6c40cda74e2","Type":"ContainerStarted","Data":"0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e"} Jun 05 21:10:37.690579 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:37.690224 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:37.713311 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:37.713268 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" podStartSLOduration=2.105252942 podStartE2EDuration="6.713257813s" totalImagesPullingTime="4.608004871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:37.710183916 +0000 UTC m=+712.943449949" watchObservedRunningTime="2026-06-05 21:10:37.713257813 +0000 UTC m=+712.946523846" Jun 05 21:10:38.584769 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:38.584734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:38.649917 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:38.649892 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f7n7k" Jun 05 21:10:38.669411 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:38.669385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:38.986973 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:38.986894 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:39.094288 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:39.094239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:39.873914 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:39.873879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:40.380011 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:40.379965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:41.663021 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:41.662989 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9hckz" Jun 05 21:10:42.809722 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:42.809685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:42.909261 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:42.909230 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:46.118338 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:46.118296 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:46.218391 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:46.218323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:48.697328 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:48.697299 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:50.504654 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.504624 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826"] Jun 05 21:10:50.505127 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.504780 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" containerName="manager" containerID="cri-o://0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e" gracePeriod=2 Jun 05 21:10:50.510532 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.510506 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826"] Jun 05 21:10:50.534446 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.534422 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78"] Jun 05 21:10:50.534871 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.534851 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" containerName="manager" Jun 05 21:10:50.534871 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.534871 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" containerName="manager" Jun 05 21:10:50.535046 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.534945 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" containerName="manager" Jun 05 21:10:50.538400 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.538371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.540850 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:10:50.540820 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:50.551754 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.551731 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78"] Jun 05 21:10:50.586862 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.586834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92d856e-0241-4649-9b53-10adacc954be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gjw78\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.586959 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.586873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjb7\" (UniqueName: \"kubernetes.io/projected/b92d856e-0241-4649-9b53-10adacc954be-kube-api-access-xcjb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gjw78\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.687773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.687744 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92d856e-0241-4649-9b53-10adacc954be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gjw78\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.687889 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.687788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjb7\" (UniqueName: \"kubernetes.io/projected/b92d856e-0241-4649-9b53-10adacc954be-kube-api-access-xcjb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gjw78\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.688232 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.688190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92d856e-0241-4649-9b53-10adacc954be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gjw78\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.696890 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.696863 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjb7\" (UniqueName: \"kubernetes.io/projected/b92d856e-0241-4649-9b53-10adacc954be-kube-api-access-xcjb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gjw78\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.749820 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.749798 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:50.751005 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.750985 2559 generic.go:356] "Generic (PLEG): container finished" podID="8934c99c-6298-45c3-b63c-a6c40cda74e2" containerID="0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e" exitCode=0 Jun 05 21:10:50.751101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.751046 2559 scope.go:117] "RemoveContainer" containerID="0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e" Jun 05 21:10:50.753369 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:10:50.753347 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:50.758359 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.758344 2559 scope.go:117] "RemoveContainer" containerID="0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e" Jun 05 21:10:50.758609 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:10:50.758593 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e\": container with ID starting with 0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e not found: ID does not exist" containerID="0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e" Jun 05 21:10:50.758656 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.758617 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e"} err="failed to get container status \"0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e\": rpc error: code = NotFound desc = could not find container \"0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e\": container with ID starting with 0d18b708ed98930f7576dfc60d97985ea7e0b557ed719e394ff70be48a5ef30e not found: ID does not exist" Jun 05 21:10:50.869070 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.869048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:50.889708 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.889689 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v59r\" (UniqueName: \"kubernetes.io/projected/8934c99c-6298-45c3-b63c-a6c40cda74e2-kube-api-access-5v59r\") pod \"8934c99c-6298-45c3-b63c-a6c40cda74e2\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " Jun 05 21:10:50.889807 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.889752 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8934c99c-6298-45c3-b63c-a6c40cda74e2-extensions-socket-volume\") pod \"8934c99c-6298-45c3-b63c-a6c40cda74e2\" (UID: \"8934c99c-6298-45c3-b63c-a6c40cda74e2\") " Jun 05 21:10:50.890130 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.890093 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8934c99c-6298-45c3-b63c-a6c40cda74e2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8934c99c-6298-45c3-b63c-a6c40cda74e2" (UID: "8934c99c-6298-45c3-b63c-a6c40cda74e2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:10:50.891676 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.891650 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8934c99c-6298-45c3-b63c-a6c40cda74e2-kube-api-access-5v59r" (OuterVolumeSpecName: "kube-api-access-5v59r") pod "8934c99c-6298-45c3-b63c-a6c40cda74e2" (UID: "8934c99c-6298-45c3-b63c-a6c40cda74e2"). InnerVolumeSpecName "kube-api-access-5v59r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:50.990563 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.990534 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v59r\" (UniqueName: \"kubernetes.io/projected/8934c99c-6298-45c3-b63c-a6c40cda74e2-kube-api-access-5v59r\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:10:50.990563 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:50.990559 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8934c99c-6298-45c3-b63c-a6c40cda74e2-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:10:51.004163 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.004136 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78"] Jun 05 21:10:51.006420 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:10:51.006393 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92d856e_0241_4649_9b53_10adacc954be.slice/crio-d71bfb55eca2c7afd516a8b31ca8a1d88134f088663faf39307d7fb7846ca7cc WatchSource:0}: Error finding container d71bfb55eca2c7afd516a8b31ca8a1d88134f088663faf39307d7fb7846ca7cc: Status 404 returned error can't find the container with id d71bfb55eca2c7afd516a8b31ca8a1d88134f088663faf39307d7fb7846ca7cc Jun 05 21:10:51.132871 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.132836 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47"] Jun 05 21:10:51.136081 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.136065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.139175 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:10:51.139144 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sp826\" is forbidden: User \"system:node:ip-10-0-138-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-251.ec2.internal' and this object" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:51.154488 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.154467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47"] Jun 05 21:10:51.192273 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.192247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d562608e-97d1-45df-bcfd-2336079147b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vr47\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.192383 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.192275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4g5n\" (UniqueName: \"kubernetes.io/projected/d562608e-97d1-45df-bcfd-2336079147b4-kube-api-access-q4g5n\") pod \"kuadrant-operator-controller-manager-86878c769f-9vr47\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.219575 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.219552 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8934c99c-6298-45c3-b63c-a6c40cda74e2" path="/var/lib/kubelet/pods/8934c99c-6298-45c3-b63c-a6c40cda74e2/volumes" Jun 05 21:10:51.292821 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.292798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d562608e-97d1-45df-bcfd-2336079147b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vr47\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.292917 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.292828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4g5n\" (UniqueName: \"kubernetes.io/projected/d562608e-97d1-45df-bcfd-2336079147b4-kube-api-access-q4g5n\") pod \"kuadrant-operator-controller-manager-86878c769f-9vr47\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.293150 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.293133 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d562608e-97d1-45df-bcfd-2336079147b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vr47\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.301138 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.301108 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4g5n\" (UniqueName: \"kubernetes.io/projected/d562608e-97d1-45df-bcfd-2336079147b4-kube-api-access-q4g5n\") pod \"kuadrant-operator-controller-manager-86878c769f-9vr47\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.446489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.446456 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.575355 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.575333 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47"] Jun 05 21:10:51.577268 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:10:51.577239 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd562608e_97d1_45df_bcfd_2336079147b4.slice/crio-5200e6dc7b70243d790d8c48d63e058b7d376a0e865310ac9c8c2050dc3ed36c WatchSource:0}: Error finding container 5200e6dc7b70243d790d8c48d63e058b7d376a0e865310ac9c8c2050dc3ed36c: Status 404 returned error can't find the container with id 5200e6dc7b70243d790d8c48d63e058b7d376a0e865310ac9c8c2050dc3ed36c Jun 05 21:10:51.756015 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.755986 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sp826" Jun 05 21:10:51.757657 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.757626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" event={"ID":"b92d856e-0241-4649-9b53-10adacc954be","Type":"ContainerStarted","Data":"d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4"} Jun 05 21:10:51.757657 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.757691 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:10:51.757949 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.757717 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" event={"ID":"b92d856e-0241-4649-9b53-10adacc954be","Type":"ContainerStarted","Data":"d71bfb55eca2c7afd516a8b31ca8a1d88134f088663faf39307d7fb7846ca7cc"} Jun 05 21:10:51.759260 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.759236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" event={"ID":"d562608e-97d1-45df-bcfd-2336079147b4","Type":"ContainerStarted","Data":"542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70"} Jun 05 21:10:51.759381 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.759284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" event={"ID":"d562608e-97d1-45df-bcfd-2336079147b4","Type":"ContainerStarted","Data":"5200e6dc7b70243d790d8c48d63e058b7d376a0e865310ac9c8c2050dc3ed36c"} Jun 05 21:10:51.759381 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.759324 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:10:51.786182 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.786133 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" podStartSLOduration=1.786118586 podStartE2EDuration="1.786118586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:51.784725709 +0000 UTC m=+727.017991741" watchObservedRunningTime="2026-06-05 21:10:51.786118586 +0000 UTC m=+727.019384692" Jun 05 21:10:51.804364 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:51.804327 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" podStartSLOduration=0.804313467 podStartE2EDuration="804.313467ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:51.804089794 +0000 UTC m=+727.037355840" watchObservedRunningTime="2026-06-05 21:10:51.804313467 +0000 UTC m=+727.037579500" Jun 05 21:10:52.848578 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:52.848536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:52.948297 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:52.948256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:56.622649 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:56.622614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:56.669783 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:56.669757 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:56.818539 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:56.818512 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:10:56.917479 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:10:56.917408 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:00.640697 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:00.640662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:00.721643 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:00.721610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:02.765850 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:02.765823 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:11:02.766331 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:02.765895 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:11:02.885511 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:02.885479 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78"] Jun 05 21:11:02.885683 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:02.885641 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" podUID="b92d856e-0241-4649-9b53-10adacc954be" containerName="manager" containerID="cri-o://d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4" gracePeriod=10 Jun 05 21:11:03.128283 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.128265 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:11:03.285832 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.285792 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92d856e-0241-4649-9b53-10adacc954be-extensions-socket-volume\") pod \"b92d856e-0241-4649-9b53-10adacc954be\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " Jun 05 21:11:03.285991 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.285885 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcjb7\" (UniqueName: \"kubernetes.io/projected/b92d856e-0241-4649-9b53-10adacc954be-kube-api-access-xcjb7\") pod \"b92d856e-0241-4649-9b53-10adacc954be\" (UID: \"b92d856e-0241-4649-9b53-10adacc954be\") " Jun 05 21:11:03.286268 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.286242 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92d856e-0241-4649-9b53-10adacc954be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b92d856e-0241-4649-9b53-10adacc954be" (UID: "b92d856e-0241-4649-9b53-10adacc954be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:11:03.287788 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.287771 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92d856e-0241-4649-9b53-10adacc954be-kube-api-access-xcjb7" (OuterVolumeSpecName: "kube-api-access-xcjb7") pod "b92d856e-0241-4649-9b53-10adacc954be" (UID: "b92d856e-0241-4649-9b53-10adacc954be"). InnerVolumeSpecName "kube-api-access-xcjb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:11:03.386461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.386392 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b92d856e-0241-4649-9b53-10adacc954be-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:11:03.386461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.386416 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcjb7\" (UniqueName: \"kubernetes.io/projected/b92d856e-0241-4649-9b53-10adacc954be-kube-api-access-xcjb7\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:11:03.811376 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.811341 2559 generic.go:356] "Generic (PLEG): container finished" podID="b92d856e-0241-4649-9b53-10adacc954be" containerID="d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4" exitCode=0 Jun 05 21:11:03.811803 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.811389 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" Jun 05 21:11:03.811803 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.811429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" event={"ID":"b92d856e-0241-4649-9b53-10adacc954be","Type":"ContainerDied","Data":"d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4"} Jun 05 21:11:03.811803 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.811482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78" event={"ID":"b92d856e-0241-4649-9b53-10adacc954be","Type":"ContainerDied","Data":"d71bfb55eca2c7afd516a8b31ca8a1d88134f088663faf39307d7fb7846ca7cc"} Jun 05 21:11:03.811803 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.811504 2559 scope.go:117] "RemoveContainer" containerID="d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4" Jun 05 21:11:03.819921 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.819901 2559 scope.go:117] "RemoveContainer" containerID="d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4" Jun 05 21:11:03.820182 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:11:03.820165 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4\": container with ID starting with d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4 not found: ID does not exist" containerID="d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4" Jun 05 21:11:03.820266 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.820193 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4"} err="failed to get container status \"d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4\": rpc error: code = NotFound desc = could not find container \"d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4\": container with ID starting with d727b490381af440248f27bcf26612a7d3a03c05dc10cb593fc3e79b96c26fa4 not found: ID does not exist" Jun 05 21:11:03.835923 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.835895 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78"] Jun 05 21:11:03.841996 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:03.837513 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gjw78"] Jun 05 21:11:05.219257 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:05.219221 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92d856e-0241-4649-9b53-10adacc954be" path="/var/lib/kubelet/pods/b92d856e-0241-4649-9b53-10adacc954be/volumes" Jun 05 21:11:06.035726 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:06.035637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:06.102383 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:06.102354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:19.161606 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.161573 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c"] Jun 05 21:11:19.162158 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.162074 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92d856e-0241-4649-9b53-10adacc954be" containerName="manager" Jun 05 21:11:19.162158 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.162093 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92d856e-0241-4649-9b53-10adacc954be" containerName="manager" Jun 05 21:11:19.162308 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.162185 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92d856e-0241-4649-9b53-10adacc954be" containerName="manager" Jun 05 21:11:19.165123 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.165101 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.167748 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.167730 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fh98v\"" Jun 05 21:11:19.178647 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.178622 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c"] Jun 05 21:11:19.203498 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.203472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:19.298396 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.298368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:19.304047 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304024 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304376 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfjqr\" (UniqueName: \"kubernetes.io/projected/47ca58b9-df9c-4ec9-8684-aec5edd5907b-kube-api-access-mfjqr\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.304376 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.304315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405277 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405381 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405287 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405381 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfjqr\" (UniqueName: \"kubernetes.io/projected/47ca58b9-df9c-4ec9-8684-aec5edd5907b-kube-api-access-mfjqr\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405381 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405498 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405534 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405580 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405633 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405633 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405733 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405903 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.405969 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.406008 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.405990 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.406043 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.406016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.407817 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.407796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.407926 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.407908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.412998 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.412941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47ca58b9-df9c-4ec9-8684-aec5edd5907b-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.413161 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.413144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfjqr\" (UniqueName: \"kubernetes.io/projected/47ca58b9-df9c-4ec9-8684-aec5edd5907b-kube-api-access-mfjqr\") pod \"maas-default-gateway-openshift-default-8559cd5744-g9g6c\" (UID: \"47ca58b9-df9c-4ec9-8684-aec5edd5907b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.475568 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.475546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:19.604451 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.604422 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c"] Jun 05 21:11:19.606433 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:11:19.606406 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ca58b9_df9c_4ec9_8684_aec5edd5907b.slice/crio-decd145d531fdb1fee321ae9c5b8605436230a47bca38aa07692a9b8f66e820f WatchSource:0}: Error finding container decd145d531fdb1fee321ae9c5b8605436230a47bca38aa07692a9b8f66e820f: Status 404 returned error can't find the container with id decd145d531fdb1fee321ae9c5b8605436230a47bca38aa07692a9b8f66e820f Jun 05 21:11:19.608598 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.608565 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:11:19.608692 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.608628 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:11:19.608692 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.608656 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:11:19.889408 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.889372 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" event={"ID":"47ca58b9-df9c-4ec9-8684-aec5edd5907b","Type":"ContainerStarted","Data":"edb7797c273e326f5e19b8b5b2065d267b57ebd6588cc6427c000b31274ebfc4"} Jun 05 21:11:19.889561 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.889432 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" event={"ID":"47ca58b9-df9c-4ec9-8684-aec5edd5907b","Type":"ContainerStarted","Data":"decd145d531fdb1fee321ae9c5b8605436230a47bca38aa07692a9b8f66e820f"} Jun 05 21:11:19.917362 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:19.917288 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" podStartSLOduration=0.91726857 podStartE2EDuration="917.26857ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:11:19.91385757 +0000 UTC m=+755.147123604" watchObservedRunningTime="2026-06-05 21:11:19.91726857 +0000 UTC m=+755.150534605" Jun 05 21:11:20.476236 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:20.476188 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:20.481261 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:20.481241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:20.893538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:20.893504 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:20.894559 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:20.894542 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:11:22.773911 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:22.773880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:23.164817 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:23.164788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:23.265980 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:23.265953 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:23.333444 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:23.333372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:24.005827 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:24.005788 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:24.071898 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:24.071869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:39.383979 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:39.383945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:39.485024 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:39.484994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:44.371609 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:44.371574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:53.858245 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:53.858189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:53.958822 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:53.958791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:11:54.108498 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:11:54.108432 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:17.299557 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.299526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:17.398162 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.398127 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:17.703538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.703465 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:12:17.713814 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.713774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:17.714307 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.714274 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:12:17.716450 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.716428 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-svnhw\"" Jun 05 21:12:17.716818 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.716766 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:12:17.716818 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.716797 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:12:17.717029 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.717016 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 21:12:17.866023 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.865998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-695gq\" (UniqueName: \"kubernetes.io/projected/55bcf312-28d0-46a0-b408-13fa03218fa6-kube-api-access-695gq\") pod \"maas-keycloak-0\" (UID: \"55bcf312-28d0-46a0-b408-13fa03218fa6\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:17.966734 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.966676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-695gq\" (UniqueName: \"kubernetes.io/projected/55bcf312-28d0-46a0-b408-13fa03218fa6-kube-api-access-695gq\") pod \"maas-keycloak-0\" (UID: \"55bcf312-28d0-46a0-b408-13fa03218fa6\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:17.974600 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:17.974571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-695gq\" (UniqueName: \"kubernetes.io/projected/55bcf312-28d0-46a0-b408-13fa03218fa6-kube-api-access-695gq\") pod \"maas-keycloak-0\" (UID: \"55bcf312-28d0-46a0-b408-13fa03218fa6\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:18.024524 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:18.024501 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:18.146113 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:18.146092 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:12:18.147989 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:12:18.147965 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bcf312_28d0_46a0_b408_13fa03218fa6.slice/crio-6edfca94414e243d21543f6b0ff1d4227a67d167008368bfc8a0247294b7fb34 WatchSource:0}: Error finding container 6edfca94414e243d21543f6b0ff1d4227a67d167008368bfc8a0247294b7fb34: Status 404 returned error can't find the container with id 6edfca94414e243d21543f6b0ff1d4227a67d167008368bfc8a0247294b7fb34 Jun 05 21:12:19.150022 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:19.149988 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55bcf312-28d0-46a0-b408-13fa03218fa6","Type":"ContainerStarted","Data":"6edfca94414e243d21543f6b0ff1d4227a67d167008368bfc8a0247294b7fb34"} Jun 05 21:12:24.181938 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:24.181891 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55bcf312-28d0-46a0-b408-13fa03218fa6","Type":"ContainerStarted","Data":"815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06"} Jun 05 21:12:24.198947 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:24.198901 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.218628212 podStartE2EDuration="7.198887748s" totalImagesPullingTime="4.980259536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:12:24.197547404 +0000 UTC m=+819.430813448" watchObservedRunningTime="2026-06-05 21:12:24.198887748 +0000 UTC m=+819.432153780" Jun 05 21:12:25.025602 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:25.025558 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:25.027576 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:25.027537 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:26.025098 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:26.025060 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:27.025974 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:27.025927 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:28.024941 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:28.024869 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:28.025282 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:28.025248 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:29.025697 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:29.025643 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:30.025341 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:30.025228 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:31.025699 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:31.025641 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:32.025658 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:32.025612 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:33.025741 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:33.025693 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:34.025092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:34.025036 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:35.025567 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:35.025529 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:36.025808 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:36.025758 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 05 21:12:37.156602 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:37.156561 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:37.174585 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:37.174546 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:12:37.948489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:37.948447 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:47.163662 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:47.163626 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:12:47.804702 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:47.804668 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:47.940728 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:47.940699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:51.822101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:51.822068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:51.923720 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:51.923694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:53.188932 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.188893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:53.205150 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.205122 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d4bb7c59f-jzcvs"] Jun 05 21:12:53.212536 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.212518 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.216253 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.216230 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 21:12:53.217344 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.217301 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfswf\"" Jun 05 21:12:53.217509 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.217484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 21:12:53.222501 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.222479 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4bb7c59f-jzcvs"] Jun 05 21:12:53.259785 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.259758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:53.312438 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.312413 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:53.354994 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.354970 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-858c865b6c-mdlnh"] Jun 05 21:12:53.357392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.357374 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.366656 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.366636 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-858c865b6c-mdlnh"] Jun 05 21:12:53.378273 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.378249 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vps7f\" (UniqueName: \"kubernetes.io/projected/49a41676-d358-4fec-860e-e6af6df1163d-kube-api-access-vps7f\") pod \"maas-controller-5d4bb7c59f-jzcvs\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.378399 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.378341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49a41676-d358-4fec-860e-e6af6df1163d-webhook-cert\") pod \"maas-controller-5d4bb7c59f-jzcvs\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.381345 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.381324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:53.479620 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.479537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vps7f\" (UniqueName: \"kubernetes.io/projected/49a41676-d358-4fec-860e-e6af6df1163d-kube-api-access-vps7f\") pod \"maas-controller-5d4bb7c59f-jzcvs\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.479620 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.479580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91d42851-ffed-4aa8-a16e-b48d62db47cf-webhook-cert\") pod \"maas-controller-858c865b6c-mdlnh\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.479620 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.479611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6f5\" (UniqueName: \"kubernetes.io/projected/91d42851-ffed-4aa8-a16e-b48d62db47cf-kube-api-access-vk6f5\") pod \"maas-controller-858c865b6c-mdlnh\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.479843 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.479678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49a41676-d358-4fec-860e-e6af6df1163d-webhook-cert\") pod \"maas-controller-5d4bb7c59f-jzcvs\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.482049 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.482021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49a41676-d358-4fec-860e-e6af6df1163d-webhook-cert\") pod \"maas-controller-5d4bb7c59f-jzcvs\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.488175 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.488148 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vps7f\" (UniqueName: \"kubernetes.io/projected/49a41676-d358-4fec-860e-e6af6df1163d-kube-api-access-vps7f\") pod \"maas-controller-5d4bb7c59f-jzcvs\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.525078 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.525049 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:53.580701 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.580676 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91d42851-ffed-4aa8-a16e-b48d62db47cf-webhook-cert\") pod \"maas-controller-858c865b6c-mdlnh\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.580830 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.580713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6f5\" (UniqueName: \"kubernetes.io/projected/91d42851-ffed-4aa8-a16e-b48d62db47cf-kube-api-access-vk6f5\") pod \"maas-controller-858c865b6c-mdlnh\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.583461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.583400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91d42851-ffed-4aa8-a16e-b48d62db47cf-webhook-cert\") pod \"maas-controller-858c865b6c-mdlnh\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.589947 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.589926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6f5\" (UniqueName: \"kubernetes.io/projected/91d42851-ffed-4aa8-a16e-b48d62db47cf-kube-api-access-vk6f5\") pod \"maas-controller-858c865b6c-mdlnh\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.649124 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.649100 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4bb7c59f-jzcvs"] Jun 05 21:12:53.650683 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:12:53.650659 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a41676_d358_4fec_860e_e6af6df1163d.slice/crio-3599a0fbcf869c1930d21ec4c18af58f414e3b2077e7aa020903df1b51591db2 WatchSource:0}: Error finding container 3599a0fbcf869c1930d21ec4c18af58f414e3b2077e7aa020903df1b51591db2: Status 404 returned error can't find the container with id 3599a0fbcf869c1930d21ec4c18af58f414e3b2077e7aa020903df1b51591db2 Jun 05 21:12:53.668271 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.668243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:53.788570 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:53.788541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-858c865b6c-mdlnh"] Jun 05 21:12:53.789872 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:12:53.789834 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d42851_ffed_4aa8_a16e_b48d62db47cf.slice/crio-1bf693f8f40b80626e544ce1df0a7fbbb0bf5f10b971ad04bf22ae0917c26b86 WatchSource:0}: Error finding container 1bf693f8f40b80626e544ce1df0a7fbbb0bf5f10b971ad04bf22ae0917c26b86: Status 404 returned error can't find the container with id 1bf693f8f40b80626e544ce1df0a7fbbb0bf5f10b971ad04bf22ae0917c26b86 Jun 05 21:12:54.343002 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:54.342911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" event={"ID":"49a41676-d358-4fec-860e-e6af6df1163d","Type":"ContainerStarted","Data":"3599a0fbcf869c1930d21ec4c18af58f414e3b2077e7aa020903df1b51591db2"} Jun 05 21:12:54.345063 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:54.345009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c865b6c-mdlnh" event={"ID":"91d42851-ffed-4aa8-a16e-b48d62db47cf","Type":"ContainerStarted","Data":"1bf693f8f40b80626e544ce1df0a7fbbb0bf5f10b971ad04bf22ae0917c26b86"} Jun 05 21:12:56.357326 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.357291 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" event={"ID":"49a41676-d358-4fec-860e-e6af6df1163d","Type":"ContainerStarted","Data":"1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed"} Jun 05 21:12:56.357734 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.357513 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:12:56.359468 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.359440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c865b6c-mdlnh" event={"ID":"91d42851-ffed-4aa8-a16e-b48d62db47cf","Type":"ContainerStarted","Data":"dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d"} Jun 05 21:12:56.359571 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.359497 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:12:56.373209 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.373154 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" podStartSLOduration=0.757076839 podStartE2EDuration="3.373141412s" totalImagesPullingTime="2.616064573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:12:56.371620787 +0000 UTC m=+851.604887016" watchObservedRunningTime="2026-06-05 21:12:56.373141412 +0000 UTC m=+851.606407444" Jun 05 21:12:56.387244 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.387188 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-858c865b6c-mdlnh" podStartSLOduration=0.915220289 podStartE2EDuration="3.387173832s" totalImagesPullingTime="2.471953543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:12:56.385592786 +0000 UTC m=+851.618858840" watchObservedRunningTime="2026-06-05 21:12:56.387173832 +0000 UTC m=+851.620439901" Jun 05 21:12:56.497321 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.497286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:12:56.612550 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:12:56.612515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:07.368071 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.368039 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:13:07.368550 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.368122 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:13:07.421246 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.421211 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4bb7c59f-jzcvs"] Jun 05 21:13:07.421473 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.421451 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" podUID="49a41676-d358-4fec-860e-e6af6df1163d" containerName="manager" containerID="cri-o://1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed" gracePeriod=30 Jun 05 21:13:07.666362 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.666339 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:13:07.801950 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.801925 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49a41676-d358-4fec-860e-e6af6df1163d-webhook-cert\") pod \"49a41676-d358-4fec-860e-e6af6df1163d\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " Jun 05 21:13:07.802107 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.801989 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vps7f\" (UniqueName: \"kubernetes.io/projected/49a41676-d358-4fec-860e-e6af6df1163d-kube-api-access-vps7f\") pod \"49a41676-d358-4fec-860e-e6af6df1163d\" (UID: \"49a41676-d358-4fec-860e-e6af6df1163d\") " Jun 05 21:13:07.804165 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.804133 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49a41676-d358-4fec-860e-e6af6df1163d-kube-api-access-vps7f" (OuterVolumeSpecName: "kube-api-access-vps7f") pod "49a41676-d358-4fec-860e-e6af6df1163d" (UID: "49a41676-d358-4fec-860e-e6af6df1163d"). InnerVolumeSpecName "kube-api-access-vps7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:13:07.804301 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.804187 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49a41676-d358-4fec-860e-e6af6df1163d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "49a41676-d358-4fec-860e-e6af6df1163d" (UID: "49a41676-d358-4fec-860e-e6af6df1163d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:13:07.903509 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.903444 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49a41676-d358-4fec-860e-e6af6df1163d-webhook-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:13:07.903509 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:07.903470 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vps7f\" (UniqueName: \"kubernetes.io/projected/49a41676-d358-4fec-860e-e6af6df1163d-kube-api-access-vps7f\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:13:08.415695 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.415662 2559 generic.go:356] "Generic (PLEG): container finished" podID="49a41676-d358-4fec-860e-e6af6df1163d" containerID="1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed" exitCode=0 Jun 05 21:13:08.416101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.415704 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" Jun 05 21:13:08.416101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.415741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" event={"ID":"49a41676-d358-4fec-860e-e6af6df1163d","Type":"ContainerDied","Data":"1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed"} Jun 05 21:13:08.416101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.415788 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4bb7c59f-jzcvs" event={"ID":"49a41676-d358-4fec-860e-e6af6df1163d","Type":"ContainerDied","Data":"3599a0fbcf869c1930d21ec4c18af58f414e3b2077e7aa020903df1b51591db2"} Jun 05 21:13:08.416101 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.415811 2559 scope.go:117] "RemoveContainer" containerID="1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed" Jun 05 21:13:08.424300 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.424066 2559 scope.go:117] "RemoveContainer" containerID="1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed" Jun 05 21:13:08.424367 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:13:08.424349 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed\": container with ID starting with 1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed not found: ID does not exist" containerID="1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed" Jun 05 21:13:08.424406 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.424370 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed"} err="failed to get container status \"1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed\": rpc error: code = NotFound desc = could not find container \"1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed\": container with ID starting with 1bb8c6e4da41accf8927de36f00c2e431fec92995bf951f0ddd5f9bcb97818ed not found: ID does not exist" Jun 05 21:13:08.436555 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.436534 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4bb7c59f-jzcvs"] Jun 05 21:13:08.439688 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:08.439663 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d4bb7c59f-jzcvs"] Jun 05 21:13:09.218969 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:09.218934 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49a41676-d358-4fec-860e-e6af6df1163d" path="/var/lib/kubelet/pods/49a41676-d358-4fec-860e-e6af6df1163d/volumes" Jun 05 21:13:25.023965 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.023879 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:25.067872 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.067839 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5dc95cc54b-sstwt"] Jun 05 21:13:25.068375 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.068355 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49a41676-d358-4fec-860e-e6af6df1163d" containerName="manager" Jun 05 21:13:25.068425 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.068380 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49a41676-d358-4fec-860e-e6af6df1163d" containerName="manager" Jun 05 21:13:25.068480 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.068467 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="49a41676-d358-4fec-860e-e6af6df1163d" containerName="manager" Jun 05 21:13:25.072717 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.072701 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.075497 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.075477 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q6n5s\"" Jun 05 21:13:25.076035 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.076016 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 05 21:13:25.081287 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.081264 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5dc95cc54b-sstwt"] Jun 05 21:13:25.144537 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.144504 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhzlv\" (UniqueName: \"kubernetes.io/projected/4d7bea47-c7f9-461f-9397-22c6ef8a70af-kube-api-access-xhzlv\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.144707 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.144548 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.245544 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.245512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhzlv\" (UniqueName: \"kubernetes.io/projected/4d7bea47-c7f9-461f-9397-22c6ef8a70af-kube-api-access-xhzlv\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.245682 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.245658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.245774 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:13:25.245760 2559 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 21:13:25.245842 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:13:25.245832 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls podName:4d7bea47-c7f9-461f-9397-22c6ef8a70af nodeName:}" failed. No retries permitted until 2026-06-05 21:13:25.745815867 +0000 UTC m=+880.979081878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls") pod "maas-api-5dc95cc54b-sstwt" (UID: "4d7bea47-c7f9-461f-9397-22c6ef8a70af") : secret "maas-api-serving-cert" not found Jun 05 21:13:25.257391 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.257370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhzlv\" (UniqueName: \"kubernetes.io/projected/4d7bea47-c7f9-461f-9397-22c6ef8a70af-kube-api-access-xhzlv\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.512305 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.512276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:25.611877 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.611844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:25.662529 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.662493 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-d9jd2"] Jun 05 21:13:25.664851 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.664833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:25.667353 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.667333 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 21:13:25.667428 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.667333 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-shlrs\"" Jun 05 21:13:25.674939 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.674916 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-d9jd2"] Jun 05 21:13:25.750253 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.750211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q68pn\" (UniqueName: \"kubernetes.io/projected/8f6fecb7-5339-424b-a396-e37b5212b2c4-kube-api-access-q68pn\") pod \"payload-processing-7c6c859784-d9jd2\" (UID: \"8f6fecb7-5339-424b-a396-e37b5212b2c4\") " pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:25.750415 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.750277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:25.750473 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:13:25.750410 2559 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 21:13:25.750473 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:13:25.750466 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls podName:4d7bea47-c7f9-461f-9397-22c6ef8a70af nodeName:}" failed. No retries permitted until 2026-06-05 21:13:26.750451274 +0000 UTC m=+881.983717285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls") pod "maas-api-5dc95cc54b-sstwt" (UID: "4d7bea47-c7f9-461f-9397-22c6ef8a70af") : secret "maas-api-serving-cert" not found Jun 05 21:13:25.851151 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.851105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q68pn\" (UniqueName: \"kubernetes.io/projected/8f6fecb7-5339-424b-a396-e37b5212b2c4-kube-api-access-q68pn\") pod \"payload-processing-7c6c859784-d9jd2\" (UID: \"8f6fecb7-5339-424b-a396-e37b5212b2c4\") " pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:25.868820 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.868784 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q68pn\" (UniqueName: \"kubernetes.io/projected/8f6fecb7-5339-424b-a396-e37b5212b2c4-kube-api-access-q68pn\") pod \"payload-processing-7c6c859784-d9jd2\" (UID: \"8f6fecb7-5339-424b-a396-e37b5212b2c4\") " pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:25.889291 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.889260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:13:25.976489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:25.976461 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:26.124771 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:26.124740 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-d9jd2"] Jun 05 21:13:26.125901 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:13:26.125870 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6fecb7_5339_424b_a396_e37b5212b2c4.slice/crio-052f78c325aca4d6ec532e76ce3b05c3a4038ed53132914381942edaa760083e WatchSource:0}: Error finding container 052f78c325aca4d6ec532e76ce3b05c3a4038ed53132914381942edaa760083e: Status 404 returned error can't find the container with id 052f78c325aca4d6ec532e76ce3b05c3a4038ed53132914381942edaa760083e Jun 05 21:13:26.495247 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:26.495134 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" event={"ID":"8f6fecb7-5339-424b-a396-e37b5212b2c4","Type":"ContainerStarted","Data":"052f78c325aca4d6ec532e76ce3b05c3a4038ed53132914381942edaa760083e"} Jun 05 21:13:26.761598 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:26.761501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:26.764733 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:26.764704 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d7bea47-c7f9-461f-9397-22c6ef8a70af-maas-api-tls\") pod \"maas-api-5dc95cc54b-sstwt\" (UID: \"4d7bea47-c7f9-461f-9397-22c6ef8a70af\") " pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:26.883319 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:26.883274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:27.074636 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:27.074508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5dc95cc54b-sstwt"] Jun 05 21:13:27.077119 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:13:27.077084 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7bea47_c7f9_461f_9397_22c6ef8a70af.slice/crio-10c92e55ac77b0568ca41cc908e1fdb3fed9382a0aeb2755d3d0373599d19cea WatchSource:0}: Error finding container 10c92e55ac77b0568ca41cc908e1fdb3fed9382a0aeb2755d3d0373599d19cea: Status 404 returned error can't find the container with id 10c92e55ac77b0568ca41cc908e1fdb3fed9382a0aeb2755d3d0373599d19cea Jun 05 21:13:27.501306 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:27.501223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5dc95cc54b-sstwt" event={"ID":"4d7bea47-c7f9-461f-9397-22c6ef8a70af","Type":"ContainerStarted","Data":"10c92e55ac77b0568ca41cc908e1fdb3fed9382a0aeb2755d3d0373599d19cea"} Jun 05 21:13:28.507832 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:28.507787 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" event={"ID":"8f6fecb7-5339-424b-a396-e37b5212b2c4","Type":"ContainerStarted","Data":"d2dc96577999fc64b6f1cdd84e905cf5f754202489a1afc3559fb5e29be011ec"} Jun 05 21:13:28.508284 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:28.507882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:29.514658 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:29.514564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5dc95cc54b-sstwt" event={"ID":"4d7bea47-c7f9-461f-9397-22c6ef8a70af","Type":"ContainerStarted","Data":"f5648d31b750c26c2771e438dd2b673076843c000b4d0b106bf3ac43180caf35"} Jun 05 21:13:29.515010 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:29.514825 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:29.531581 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:29.531528 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" podStartSLOduration=3.05821924 podStartE2EDuration="4.531509053s" totalImagesPullingTime="1.473289813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:28.529417033 +0000 UTC m=+883.762683067" watchObservedRunningTime="2026-06-05 21:13:29.531509053 +0000 UTC m=+884.764775088" Jun 05 21:13:33.534406 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.534320 2559 generic.go:356] "Generic (PLEG): container finished" podID="47ca58b9-df9c-4ec9-8684-aec5edd5907b" containerID="edb7797c273e326f5e19b8b5b2065d267b57ebd6588cc6427c000b31274ebfc4" exitCode=0 Jun 05 21:13:33.534822 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.534392 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" event={"ID":"47ca58b9-df9c-4ec9-8684-aec5edd5907b","Type":"ContainerDied","Data":"edb7797c273e326f5e19b8b5b2065d267b57ebd6588cc6427c000b31274ebfc4"} Jun 05 21:13:33.534822 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.534777 2559 scope.go:117] "RemoveContainer" containerID="edb7797c273e326f5e19b8b5b2065d267b57ebd6588cc6427c000b31274ebfc4" Jun 05 21:13:33.535765 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.535738 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:13:33.535833 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.535805 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:13:33.535872 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.535837 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:13:33.555078 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:33.555026 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5dc95cc54b-sstwt" podStartSLOduration=6.541354166 podStartE2EDuration="8.555008941s" totalImagesPullingTime="2.013654775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:29.533956893 +0000 UTC m=+884.767222928" watchObservedRunningTime="2026-06-05 21:13:33.555008941 +0000 UTC m=+888.788274983" Jun 05 21:13:34.543885 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:34.543843 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" event={"ID":"47ca58b9-df9c-4ec9-8684-aec5edd5907b","Type":"ContainerStarted","Data":"4e70892ce91096b968ce84f52de9380d39dcd37bb11a0efdae8c76c9595f8cf6"} Jun 05 21:13:35.475827 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:35.475792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:13:35.477045 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:35.477021 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-g9g6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 05 21:13:35.477146 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:35.477067 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" podUID="47ca58b9-df9c-4ec9-8684-aec5edd5907b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 05 21:13:35.528077 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:35.527453 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5dc95cc54b-sstwt" Jun 05 21:13:35.893534 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:35.893502 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:13:36.476789 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:36.476753 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-g9g6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 05 21:13:36.476970 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:36.476806 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" podUID="47ca58b9-df9c-4ec9-8684-aec5edd5907b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 05 21:13:37.267218 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:37.267172 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:13:37.267646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:37.267375 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" containerID="cri-o://815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06" gracePeriod=30 Jun 05 21:13:37.476631 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:37.476595 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-g9g6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 05 21:13:37.476793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:37.476655 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" podUID="47ca58b9-df9c-4ec9-8684-aec5edd5907b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 05 21:13:38.476066 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:38.476029 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-g9g6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 05 21:13:38.476483 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:38.476085 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" podUID="47ca58b9-df9c-4ec9-8684-aec5edd5907b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 05 21:13:38.909208 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:38.909171 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:38.976478 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:38.976445 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-695gq\" (UniqueName: \"kubernetes.io/projected/55bcf312-28d0-46a0-b408-13fa03218fa6-kube-api-access-695gq\") pod \"55bcf312-28d0-46a0-b408-13fa03218fa6\" (UID: \"55bcf312-28d0-46a0-b408-13fa03218fa6\") " Jun 05 21:13:38.978646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:38.978609 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55bcf312-28d0-46a0-b408-13fa03218fa6-kube-api-access-695gq" (OuterVolumeSpecName: "kube-api-access-695gq") pod "55bcf312-28d0-46a0-b408-13fa03218fa6" (UID: "55bcf312-28d0-46a0-b408-13fa03218fa6"). InnerVolumeSpecName "kube-api-access-695gq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:13:39.077124 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.077094 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-695gq\" (UniqueName: \"kubernetes.io/projected/55bcf312-28d0-46a0-b408-13fa03218fa6-kube-api-access-695gq\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:13:39.479837 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.479777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:13:39.480798 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.480778 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-g9g6c" Jun 05 21:13:39.516264 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.516245 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-d9jd2" Jun 05 21:13:39.570657 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.570630 2559 generic.go:356] "Generic (PLEG): container finished" podID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerID="815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06" exitCode=143 Jun 05 21:13:39.570793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.570687 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.570793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.570709 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55bcf312-28d0-46a0-b408-13fa03218fa6","Type":"ContainerDied","Data":"815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06"} Jun 05 21:13:39.570793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.570762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"55bcf312-28d0-46a0-b408-13fa03218fa6","Type":"ContainerDied","Data":"6edfca94414e243d21543f6b0ff1d4227a67d167008368bfc8a0247294b7fb34"} Jun 05 21:13:39.570896 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.570784 2559 scope.go:117] "RemoveContainer" containerID="815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06" Jun 05 21:13:39.585886 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.585861 2559 scope.go:117] "RemoveContainer" containerID="815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06" Jun 05 21:13:39.586113 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.586095 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:13:39.586266 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:13:39.586179 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06\": container with ID starting with 815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06 not found: ID does not exist" containerID="815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06" Jun 05 21:13:39.586266 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.586245 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06"} err="failed to get container status \"815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06\": rpc error: code = NotFound desc = could not find container \"815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06\": container with ID starting with 815b2ad9e07307a477d771ffd0935f7ea32f522dbcf74349c61e7fdaeb6faa06 not found: ID does not exist" Jun 05 21:13:39.589729 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.589709 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:13:39.609337 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.609314 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:13:39.609656 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.609644 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" Jun 05 21:13:39.609703 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.609659 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" Jun 05 21:13:39.609740 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.609726 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" containerName="keycloak" Jun 05 21:13:39.612535 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.612521 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.615059 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.615038 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 21:13:39.615163 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.615096 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:13:39.615163 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.615120 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-svnhw\"" Jun 05 21:13:39.615296 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.615270 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 21:13:39.615401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.615386 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:13:39.620735 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.620717 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:13:39.682630 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.682608 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/128d1994-caf9-43aa-8a47-6d0459894bb2-test-realms\") pod \"maas-keycloak-0\" (UID: \"128d1994-caf9-43aa-8a47-6d0459894bb2\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.682864 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.682843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r284\" (UniqueName: \"kubernetes.io/projected/128d1994-caf9-43aa-8a47-6d0459894bb2-kube-api-access-9r284\") pod \"maas-keycloak-0\" (UID: \"128d1994-caf9-43aa-8a47-6d0459894bb2\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.784158 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.784104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r284\" (UniqueName: \"kubernetes.io/projected/128d1994-caf9-43aa-8a47-6d0459894bb2-kube-api-access-9r284\") pod \"maas-keycloak-0\" (UID: \"128d1994-caf9-43aa-8a47-6d0459894bb2\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.784158 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.784141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/128d1994-caf9-43aa-8a47-6d0459894bb2-test-realms\") pod \"maas-keycloak-0\" (UID: \"128d1994-caf9-43aa-8a47-6d0459894bb2\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.784755 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.784738 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/128d1994-caf9-43aa-8a47-6d0459894bb2-test-realms\") pod \"maas-keycloak-0\" (UID: \"128d1994-caf9-43aa-8a47-6d0459894bb2\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.791732 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.791712 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r284\" (UniqueName: \"kubernetes.io/projected/128d1994-caf9-43aa-8a47-6d0459894bb2-kube-api-access-9r284\") pod \"maas-keycloak-0\" (UID: \"128d1994-caf9-43aa-8a47-6d0459894bb2\") " pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:39.922959 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:39.922927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:40.046641 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.046619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 21:13:40.049050 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:13:40.049017 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128d1994_caf9_43aa_8a47_6d0459894bb2.slice/crio-7ca80c6fba06894247ce579dba5ecc10f72852f16f7479c2a5932d5a6534542a WatchSource:0}: Error finding container 7ca80c6fba06894247ce579dba5ecc10f72852f16f7479c2a5932d5a6534542a: Status 404 returned error can't find the container with id 7ca80c6fba06894247ce579dba5ecc10f72852f16f7479c2a5932d5a6534542a Jun 05 21:13:40.050458 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.050440 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:13:40.578519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.578482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"128d1994-caf9-43aa-8a47-6d0459894bb2","Type":"ContainerStarted","Data":"318ddeec0ded340cc5aa77365da4565c5099622028fb61c84ec983645a817129"} Jun 05 21:13:40.578957 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.578550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"128d1994-caf9-43aa-8a47-6d0459894bb2","Type":"ContainerStarted","Data":"7ca80c6fba06894247ce579dba5ecc10f72852f16f7479c2a5932d5a6534542a"} Jun 05 21:13:40.594876 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.594825 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.207527168 podStartE2EDuration="1.594805932s" totalImagesPullingTime="387.278764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:40.594652741 +0000 UTC m=+895.827918798" watchObservedRunningTime="2026-06-05 21:13:40.594805932 +0000 UTC m=+895.828071965" Jun 05 21:13:40.923426 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.923388 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:40.925215 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:40.925166 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:41.221946 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:41.221861 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55bcf312-28d0-46a0-b408-13fa03218fa6" path="/var/lib/kubelet/pods/55bcf312-28d0-46a0-b408-13fa03218fa6/volumes" Jun 05 21:13:41.923609 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:41.923555 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:42.923963 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:42.923903 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:43.924328 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:43.924276 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:44.924392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:44.924334 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:45.240682 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:45.240584 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:13:45.244643 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:45.244618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:13:45.924106 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:45.924043 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:46.924250 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:46.924180 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:47.923573 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:47.923514 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:48.923954 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:48.923910 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:49.923965 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:49.923913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:49.924465 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:49.924183 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:50.923538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:50.923480 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:51.923672 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:51.923630 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:52.924338 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:52.924285 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 05 21:13:54.053675 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:54.053481 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 21:13:54.071984 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:54.071747 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="128d1994-caf9-43aa-8a47-6d0459894bb2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:13:59.594487 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:13:59.594442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:04.060029 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:04.059993 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 21:14:16.729028 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:16.728992 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:16.828825 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:16.828799 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:20.733542 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:20.733501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:29.831759 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:29.831723 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:38.304658 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.304620 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk"] Jun 05 21:14:38.307464 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.307444 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.313660 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.313635 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 21:14:38.313772 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.313664 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 05 21:14:38.313772 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.313672 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kqzqj\"" Jun 05 21:14:38.313892 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.313847 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 21:14:38.318992 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.318967 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk"] Jun 05 21:14:38.340905 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.340884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:38.392289 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.392265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.392401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.392292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.392401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.392320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.392516 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.392423 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.392516 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.392457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2qn\" (UniqueName: \"kubernetes.io/projected/b47d30f0-40b3-4a09-9463-6ce5167bdb44-kube-api-access-6z2qn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.392516 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.392490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b47d30f0-40b3-4a09-9463-6ce5167bdb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493346 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2qn\" (UniqueName: \"kubernetes.io/projected/b47d30f0-40b3-4a09-9463-6ce5167bdb44-kube-api-access-6z2qn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493519 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b47d30f0-40b3-4a09-9463-6ce5167bdb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493922 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.493922 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.493896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.494098 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.494010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.495825 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.495799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b47d30f0-40b3-4a09-9463-6ce5167bdb44-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.496066 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.496043 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b47d30f0-40b3-4a09-9463-6ce5167bdb44-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.501521 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.501503 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2qn\" (UniqueName: \"kubernetes.io/projected/b47d30f0-40b3-4a09-9463-6ce5167bdb44-kube-api-access-6z2qn\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk\" (UID: \"b47d30f0-40b3-4a09-9463-6ce5167bdb44\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.618510 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.618436 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:38.744930 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.744902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk"] Jun 05 21:14:38.746246 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:14:38.746212 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47d30f0_40b3_4a09_9463_6ce5167bdb44.slice/crio-76473200059a7a36988eb1471846f9b46f36a433bd4a9cc26541197dc062bf64 WatchSource:0}: Error finding container 76473200059a7a36988eb1471846f9b46f36a433bd4a9cc26541197dc062bf64: Status 404 returned error can't find the container with id 76473200059a7a36988eb1471846f9b46f36a433bd4a9cc26541197dc062bf64 Jun 05 21:14:38.866624 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:38.866594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" event={"ID":"b47d30f0-40b3-4a09-9463-6ce5167bdb44","Type":"ContainerStarted","Data":"76473200059a7a36988eb1471846f9b46f36a433bd4a9cc26541197dc062bf64"} Jun 05 21:14:42.890645 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:42.890608 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" event={"ID":"b47d30f0-40b3-4a09-9463-6ce5167bdb44","Type":"ContainerStarted","Data":"0014afbac3302fb1145aaad4e46a5c9bb86eed318a84e96a2bc7050d1b3a4a08"} Jun 05 21:14:43.405785 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:43.405748 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:43.899285 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:43.899239 2559 generic.go:356] "Generic (PLEG): container finished" podID="b47d30f0-40b3-4a09-9463-6ce5167bdb44" containerID="0014afbac3302fb1145aaad4e46a5c9bb86eed318a84e96a2bc7050d1b3a4a08" exitCode=0 Jun 05 21:14:43.899746 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:43.899327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" event={"ID":"b47d30f0-40b3-4a09-9463-6ce5167bdb44","Type":"ContainerDied","Data":"0014afbac3302fb1145aaad4e46a5c9bb86eed318a84e96a2bc7050d1b3a4a08"} Jun 05 21:14:45.909657 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:45.909621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" event={"ID":"b47d30f0-40b3-4a09-9463-6ce5167bdb44","Type":"ContainerStarted","Data":"47409f193c67fbe93cae92c88e99b9279a4f05d31f8721a3861a67a66ac8302f"} Jun 05 21:14:45.928964 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:45.928916 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" podStartSLOduration=2.222558961 podStartE2EDuration="7.92890508s" totalImagesPullingTime="4.493140033s" totalInitContainerRuntime="1.213206086s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:45.92680338 +0000 UTC m=+961.160069412" watchObservedRunningTime="2026-06-05 21:14:45.92890508 +0000 UTC m=+961.162171113" Jun 05 21:14:48.619363 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:48.619324 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:48.619903 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:48.619400 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:48.631775 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:48.631750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:48.934721 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:48.934634 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk" Jun 05 21:14:56.197481 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.197407 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml"] Jun 05 21:14:56.217102 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.217073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml"] Jun 05 21:14:56.217277 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.217149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.219460 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.219438 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 05 21:14:56.229369 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.229346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:14:56.347078 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.347019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.347078 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.347077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.347325 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.347102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq5cj\" (UniqueName: \"kubernetes.io/projected/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-kube-api-access-bq5cj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.347325 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.347226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.347325 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.347271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.347421 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.347320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448538 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448774 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448583 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448774 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448774 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq5cj\" (UniqueName: \"kubernetes.io/projected/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-kube-api-access-bq5cj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.448952 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448932 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.449016 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.448978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.449075 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.449030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.450839 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.450813 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.450979 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.450961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.455558 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.455538 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq5cj\" (UniqueName: \"kubernetes.io/projected/1b2ab9fc-2bbb-4454-9943-10caa3bbc467-kube-api-access-bq5cj\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-frtml\" (UID: \"1b2ab9fc-2bbb-4454-9943-10caa3bbc467\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.528578 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.528549 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:14:56.659188 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.659166 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml"] Jun 05 21:14:56.661186 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:14:56.661157 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2ab9fc_2bbb_4454_9943_10caa3bbc467.slice/crio-2263360e54404901fde7e2eaf8a97c2b23b8f36aec2bf06303502f0435bf4066 WatchSource:0}: Error finding container 2263360e54404901fde7e2eaf8a97c2b23b8f36aec2bf06303502f0435bf4066: Status 404 returned error can't find the container with id 2263360e54404901fde7e2eaf8a97c2b23b8f36aec2bf06303502f0435bf4066 Jun 05 21:14:56.960967 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.960885 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" event={"ID":"1b2ab9fc-2bbb-4454-9943-10caa3bbc467","Type":"ContainerStarted","Data":"ae313b82487faaaa857ee1c8874fecd01af76f2e7b8cfa35f27ddcedcb458655"} Jun 05 21:14:56.960967 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:14:56.960934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" event={"ID":"1b2ab9fc-2bbb-4454-9943-10caa3bbc467","Type":"ContainerStarted","Data":"2263360e54404901fde7e2eaf8a97c2b23b8f36aec2bf06303502f0435bf4066"} Jun 05 21:15:00.982555 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:00.982522 2559 generic.go:356] "Generic (PLEG): container finished" podID="1b2ab9fc-2bbb-4454-9943-10caa3bbc467" containerID="ae313b82487faaaa857ee1c8874fecd01af76f2e7b8cfa35f27ddcedcb458655" exitCode=0 Jun 05 21:15:00.982998 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:00.982595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" event={"ID":"1b2ab9fc-2bbb-4454-9943-10caa3bbc467","Type":"ContainerDied","Data":"ae313b82487faaaa857ee1c8874fecd01af76f2e7b8cfa35f27ddcedcb458655"} Jun 05 21:15:01.988971 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:01.988931 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" event={"ID":"1b2ab9fc-2bbb-4454-9943-10caa3bbc467","Type":"ContainerStarted","Data":"f3634d4126f9d256c4e1bdb8123666e9ac42f08387b3378a81d1eb3c2f8326cb"} Jun 05 21:15:02.008927 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:02.008881 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" podStartSLOduration=2.026250826 podStartE2EDuration="6.008866597s" totalImagesPullingTime="335.397274ms" totalInitContainerRuntime="3.647218497s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:15:02.007482204 +0000 UTC m=+977.240748249" watchObservedRunningTime="2026-06-05 21:15:02.008866597 +0000 UTC m=+977.242132657" Jun 05 21:15:06.529723 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:06.529683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:15:06.530104 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:06.529795 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:15:06.542632 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:06.542608 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:15:07.023791 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:07.023761 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-frtml" Jun 05 21:15:09.903410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:09.903365 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:26.372171 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:26.372136 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:15:46.188781 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:15:46.188744 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:13.636318 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:16:13.636286 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:13.735726 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:16:13.735693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:14.692208 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:16:14.692164 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:14.792493 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:16:14.792463 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:40.103944 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:16:40.103904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:16:40.204152 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:16:40.204120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:40.125029 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.124989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:40.204136 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.204097 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-858c865b6c-mdlnh"] Jun 05 21:17:40.204375 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.204351 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-858c865b6c-mdlnh" podUID="91d42851-ffed-4aa8-a16e-b48d62db47cf" containerName="manager" containerID="cri-o://dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d" gracePeriod=30 Jun 05 21:17:40.455566 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.455537 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:17:40.579455 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.579412 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk6f5\" (UniqueName: \"kubernetes.io/projected/91d42851-ffed-4aa8-a16e-b48d62db47cf-kube-api-access-vk6f5\") pod \"91d42851-ffed-4aa8-a16e-b48d62db47cf\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " Jun 05 21:17:40.579634 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.579517 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91d42851-ffed-4aa8-a16e-b48d62db47cf-webhook-cert\") pod \"91d42851-ffed-4aa8-a16e-b48d62db47cf\" (UID: \"91d42851-ffed-4aa8-a16e-b48d62db47cf\") " Jun 05 21:17:40.581783 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.581758 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d42851-ffed-4aa8-a16e-b48d62db47cf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "91d42851-ffed-4aa8-a16e-b48d62db47cf" (UID: "91d42851-ffed-4aa8-a16e-b48d62db47cf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:17:40.581962 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.581939 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d42851-ffed-4aa8-a16e-b48d62db47cf-kube-api-access-vk6f5" (OuterVolumeSpecName: "kube-api-access-vk6f5") pod "91d42851-ffed-4aa8-a16e-b48d62db47cf" (UID: "91d42851-ffed-4aa8-a16e-b48d62db47cf"). InnerVolumeSpecName "kube-api-access-vk6f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:17:40.680875 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.680843 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91d42851-ffed-4aa8-a16e-b48d62db47cf-webhook-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:17:40.680875 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.680869 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk6f5\" (UniqueName: \"kubernetes.io/projected/91d42851-ffed-4aa8-a16e-b48d62db47cf-kube-api-access-vk6f5\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:17:40.716301 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.716238 2559 generic.go:356] "Generic (PLEG): container finished" podID="91d42851-ffed-4aa8-a16e-b48d62db47cf" containerID="dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d" exitCode=0 Jun 05 21:17:40.716301 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.716281 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c865b6c-mdlnh" Jun 05 21:17:40.716484 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.716327 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c865b6c-mdlnh" event={"ID":"91d42851-ffed-4aa8-a16e-b48d62db47cf","Type":"ContainerDied","Data":"dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d"} Jun 05 21:17:40.716484 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.716387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c865b6c-mdlnh" event={"ID":"91d42851-ffed-4aa8-a16e-b48d62db47cf","Type":"ContainerDied","Data":"1bf693f8f40b80626e544ce1df0a7fbbb0bf5f10b971ad04bf22ae0917c26b86"} Jun 05 21:17:40.716484 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.716418 2559 scope.go:117] "RemoveContainer" containerID="dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d" Jun 05 21:17:40.725808 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.725793 2559 scope.go:117] "RemoveContainer" containerID="dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d" Jun 05 21:17:40.726039 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:17:40.726020 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d\": container with ID starting with dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d not found: ID does not exist" containerID="dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d" Jun 05 21:17:40.726089 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.726046 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d"} err="failed to get container status \"dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d\": rpc error: code = NotFound desc = could not find container \"dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d\": container with ID starting with dfe56fe4bf5c26c968fa039d94802cb6b51eab7d3365faa42952b695ed05154d not found: ID does not exist" Jun 05 21:17:40.738997 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.738973 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-858c865b6c-mdlnh"] Jun 05 21:17:40.743598 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:40.743574 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-858c865b6c-mdlnh"] Jun 05 21:17:41.219598 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.219565 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d42851-ffed-4aa8-a16e-b48d62db47cf" path="/var/lib/kubelet/pods/91d42851-ffed-4aa8-a16e-b48d62db47cf/volumes" Jun 05 21:17:41.419947 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.419893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:17:41.538568 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.538491 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-858c865b6c-dzq8n"] Jun 05 21:17:41.538899 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.538882 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d42851-ffed-4aa8-a16e-b48d62db47cf" containerName="manager" Jun 05 21:17:41.538989 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.538902 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d42851-ffed-4aa8-a16e-b48d62db47cf" containerName="manager" Jun 05 21:17:41.539045 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.538992 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d42851-ffed-4aa8-a16e-b48d62db47cf" containerName="manager" Jun 05 21:17:41.543414 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.543394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.547291 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.547263 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfswf\"" Jun 05 21:17:41.547392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.547263 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 21:17:41.547392 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.547275 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 21:17:41.556222 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.555606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-858c865b6c-dzq8n"] Jun 05 21:17:41.587082 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.587060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfhp\" (UniqueName: \"kubernetes.io/projected/4dccf775-4070-4c5a-a97c-58f5e9e5d882-kube-api-access-ftfhp\") pod \"maas-controller-858c865b6c-dzq8n\" (UID: \"4dccf775-4070-4c5a-a97c-58f5e9e5d882\") " pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.587210 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.587134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dccf775-4070-4c5a-a97c-58f5e9e5d882-webhook-cert\") pod \"maas-controller-858c865b6c-dzq8n\" (UID: \"4dccf775-4070-4c5a-a97c-58f5e9e5d882\") " pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.688512 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.688488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dccf775-4070-4c5a-a97c-58f5e9e5d882-webhook-cert\") pod \"maas-controller-858c865b6c-dzq8n\" (UID: \"4dccf775-4070-4c5a-a97c-58f5e9e5d882\") " pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.688646 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.688526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfhp\" (UniqueName: \"kubernetes.io/projected/4dccf775-4070-4c5a-a97c-58f5e9e5d882-kube-api-access-ftfhp\") pod \"maas-controller-858c865b6c-dzq8n\" (UID: \"4dccf775-4070-4c5a-a97c-58f5e9e5d882\") " pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.690850 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.690832 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4dccf775-4070-4c5a-a97c-58f5e9e5d882-webhook-cert\") pod \"maas-controller-858c865b6c-dzq8n\" (UID: \"4dccf775-4070-4c5a-a97c-58f5e9e5d882\") " pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.697358 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.697331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfhp\" (UniqueName: \"kubernetes.io/projected/4dccf775-4070-4c5a-a97c-58f5e9e5d882-kube-api-access-ftfhp\") pod \"maas-controller-858c865b6c-dzq8n\" (UID: \"4dccf775-4070-4c5a-a97c-58f5e9e5d882\") " pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.861410 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.861379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:41.987797 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:41.987767 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-858c865b6c-dzq8n"] Jun 05 21:17:41.990034 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:17:41.990007 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dccf775_4070_4c5a_a97c_58f5e9e5d882.slice/crio-60ef89142aa6b54b9d66e7f93b4e67bbc6423e347e01daf22331e5fe7aabb943 WatchSource:0}: Error finding container 60ef89142aa6b54b9d66e7f93b4e67bbc6423e347e01daf22331e5fe7aabb943: Status 404 returned error can't find the container with id 60ef89142aa6b54b9d66e7f93b4e67bbc6423e347e01daf22331e5fe7aabb943 Jun 05 21:17:42.727624 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:42.727543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c865b6c-dzq8n" event={"ID":"4dccf775-4070-4c5a-a97c-58f5e9e5d882","Type":"ContainerStarted","Data":"88c36fc011d0d92e257c50618a285bf86e439fc1ceceae8796aeaaec274f9bf7"} Jun 05 21:17:42.727624 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:42.727597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-858c865b6c-dzq8n" event={"ID":"4dccf775-4070-4c5a-a97c-58f5e9e5d882","Type":"ContainerStarted","Data":"60ef89142aa6b54b9d66e7f93b4e67bbc6423e347e01daf22331e5fe7aabb943"} Jun 05 21:17:42.727979 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:42.727625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:17:42.745045 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:42.744999 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-858c865b6c-dzq8n" podStartSLOduration=1.381242244 podStartE2EDuration="1.7449863s" totalImagesPullingTime="363.744056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:17:42.744034844 +0000 UTC m=+1137.977300878" watchObservedRunningTime="2026-06-05 21:17:42.7449863 +0000 UTC m=+1137.978252371" Jun 05 21:17:53.737809 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:17:53.737778 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-858c865b6c-dzq8n" Jun 05 21:18:21.244318 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:21.244247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:21.343317 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:21.343283 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:29.726648 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:29.726611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:35.781895 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:35.781865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:35.890052 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:35.890027 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:18:45.277050 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:45.277016 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:18:45.282055 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:18:45.282027 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:19:03.561220 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:03.561160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:04.703855 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:04.703813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:07.858523 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:07.858483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:07.958848 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:07.958816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:16.116493 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:16.116458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:31.812134 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:31.812048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.550559 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:37.550525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.606157 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:37.606110 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.689575 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:37.689550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.789205 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:37.789179 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:37.909093 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:37.909030 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:38.011588 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:38.011562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:54.401856 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:54.401820 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:54.510075 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:54.510035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:19:54.619516 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:19:54.619486 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:00.512575 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:00.512539 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:00.613484 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:00.613449 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:08.654941 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:08.654888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:08.755571 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:08.755543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:08.856059 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:08.856028 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:08.956483 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:08.956416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:25.388480 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:25.388440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:25.496678 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:25.496645 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:25.607171 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:25.607137 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:31.275799 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:31.275763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:31.376469 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:31.376446 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:51.576637 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:51.576584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:51.676089 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:51.676055 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:51.775618 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:51.775581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:57.318477 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:57.318401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:57.423638 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:57.423607 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:57.518246 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:57.518221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:20:57.653083 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:20:57.653017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:03.284290 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:21:03.284260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:21:03.347815 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:21:03.347780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:13.812829 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:23:13.812792 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:24.332764 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:23:24.332727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:23:45.304371 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:23:45.304340 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:23:45.312328 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:23:45.312307 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:23:57.321506 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:23:57.321414 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:00.805817 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:25:00.805786 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:01.866977 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:25:01.866942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:25:17.159879 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:25:17.159844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:28:05.112762 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.112726 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47"] Jun 05 21:28:05.113551 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.112952 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" podUID="d562608e-97d1-45df-bcfd-2336079147b4" containerName="manager" containerID="cri-o://542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70" gracePeriod=10 Jun 05 21:28:05.363945 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.363889 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:28:05.448107 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.448080 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4g5n\" (UniqueName: \"kubernetes.io/projected/d562608e-97d1-45df-bcfd-2336079147b4-kube-api-access-q4g5n\") pod \"d562608e-97d1-45df-bcfd-2336079147b4\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " Jun 05 21:28:05.448274 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.448138 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d562608e-97d1-45df-bcfd-2336079147b4-extensions-socket-volume\") pod \"d562608e-97d1-45df-bcfd-2336079147b4\" (UID: \"d562608e-97d1-45df-bcfd-2336079147b4\") " Jun 05 21:28:05.448537 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.448514 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d562608e-97d1-45df-bcfd-2336079147b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d562608e-97d1-45df-bcfd-2336079147b4" (UID: "d562608e-97d1-45df-bcfd-2336079147b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:28:05.450015 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.449995 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d562608e-97d1-45df-bcfd-2336079147b4-kube-api-access-q4g5n" (OuterVolumeSpecName: "kube-api-access-q4g5n") pod "d562608e-97d1-45df-bcfd-2336079147b4" (UID: "d562608e-97d1-45df-bcfd-2336079147b4"). InnerVolumeSpecName "kube-api-access-q4g5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:28:05.548960 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.548935 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4g5n\" (UniqueName: \"kubernetes.io/projected/d562608e-97d1-45df-bcfd-2336079147b4-kube-api-access-q4g5n\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:28:05.548960 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.548958 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d562608e-97d1-45df-bcfd-2336079147b4-extensions-socket-volume\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:28:05.579046 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.579015 2559 generic.go:356] "Generic (PLEG): container finished" podID="d562608e-97d1-45df-bcfd-2336079147b4" containerID="542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70" exitCode=0 Jun 05 21:28:05.579149 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.579063 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" Jun 05 21:28:05.579149 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.579109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" event={"ID":"d562608e-97d1-45df-bcfd-2336079147b4","Type":"ContainerDied","Data":"542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70"} Jun 05 21:28:05.579278 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.579166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47" event={"ID":"d562608e-97d1-45df-bcfd-2336079147b4","Type":"ContainerDied","Data":"5200e6dc7b70243d790d8c48d63e058b7d376a0e865310ac9c8c2050dc3ed36c"} Jun 05 21:28:05.579278 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.579188 2559 scope.go:117] "RemoveContainer" containerID="542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70" Jun 05 21:28:05.587888 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.587872 2559 scope.go:117] "RemoveContainer" containerID="542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70" Jun 05 21:28:05.588159 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:28:05.588140 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70\": container with ID starting with 542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70 not found: ID does not exist" containerID="542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70" Jun 05 21:28:05.588221 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.588167 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70"} err="failed to get container status \"542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70\": rpc error: code = NotFound desc = could not find container \"542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70\": container with ID starting with 542c5b863297eed5e5facdd1e5aed2b36ed7236d1cd9a15b6651742530c39a70 not found: ID does not exist" Jun 05 21:28:05.600650 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.600629 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47"] Jun 05 21:28:05.606466 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:05.606446 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vr47"] Jun 05 21:28:07.219701 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:07.219671 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d562608e-97d1-45df-bcfd-2336079147b4" path="/var/lib/kubelet/pods/d562608e-97d1-45df-bcfd-2336079147b4/volumes" Jun 05 21:28:45.335040 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:45.334937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:28:45.341710 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:28:45.341687 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:29:11.238170 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.238136 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8"] Jun 05 21:29:11.238648 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.238464 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d562608e-97d1-45df-bcfd-2336079147b4" containerName="manager" Jun 05 21:29:11.238648 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.238475 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d562608e-97d1-45df-bcfd-2336079147b4" containerName="manager" Jun 05 21:29:11.238648 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.238549 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d562608e-97d1-45df-bcfd-2336079147b4" containerName="manager" Jun 05 21:29:11.241251 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.241235 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.243921 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.243899 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hvcs2\"" Jun 05 21:29:11.254308 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.254288 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8"] Jun 05 21:29:11.282233 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.282186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ljm\" (UniqueName: \"kubernetes.io/projected/79fe5243-bef8-4eb1-b466-b617d8dd3070-kube-api-access-m5ljm\") pod \"kuadrant-operator-controller-manager-86878c769f-wbnj8\" (UID: \"79fe5243-bef8-4eb1-b466-b617d8dd3070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.282326 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.282297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79fe5243-bef8-4eb1-b466-b617d8dd3070-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wbnj8\" (UID: \"79fe5243-bef8-4eb1-b466-b617d8dd3070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.382890 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.382862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ljm\" (UniqueName: \"kubernetes.io/projected/79fe5243-bef8-4eb1-b466-b617d8dd3070-kube-api-access-m5ljm\") pod \"kuadrant-operator-controller-manager-86878c769f-wbnj8\" (UID: \"79fe5243-bef8-4eb1-b466-b617d8dd3070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.382982 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.382929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79fe5243-bef8-4eb1-b466-b617d8dd3070-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wbnj8\" (UID: \"79fe5243-bef8-4eb1-b466-b617d8dd3070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.383290 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.383266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79fe5243-bef8-4eb1-b466-b617d8dd3070-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-wbnj8\" (UID: \"79fe5243-bef8-4eb1-b466-b617d8dd3070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.394551 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.394526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ljm\" (UniqueName: \"kubernetes.io/projected/79fe5243-bef8-4eb1-b466-b617d8dd3070-kube-api-access-m5ljm\") pod \"kuadrant-operator-controller-manager-86878c769f-wbnj8\" (UID: \"79fe5243-bef8-4eb1-b466-b617d8dd3070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.551564 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.551543 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.682727 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.682678 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8"] Jun 05 21:29:11.683251 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:29:11.683225 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fe5243_bef8_4eb1_b466_b617d8dd3070.slice/crio-75c41718cb8d098511701067af6d425110ca8a14dd7fc1f3dac4a50144ef553f WatchSource:0}: Error finding container 75c41718cb8d098511701067af6d425110ca8a14dd7fc1f3dac4a50144ef553f: Status 404 returned error can't find the container with id 75c41718cb8d098511701067af6d425110ca8a14dd7fc1f3dac4a50144ef553f Jun 05 21:29:11.889235 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.889142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" event={"ID":"79fe5243-bef8-4eb1-b466-b617d8dd3070","Type":"ContainerStarted","Data":"9f87e9600d896472b3635c0c1131f71dce0c05d7f4579a84a6a37bd7b170d094"} Jun 05 21:29:11.889235 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.889193 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" event={"ID":"79fe5243-bef8-4eb1-b466-b617d8dd3070","Type":"ContainerStarted","Data":"75c41718cb8d098511701067af6d425110ca8a14dd7fc1f3dac4a50144ef553f"} Jun 05 21:29:11.889408 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.889276 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:29:11.909575 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:11.909532 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" podStartSLOduration=0.909519137 podStartE2EDuration="909.519137ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:29:11.90733463 +0000 UTC m=+1827.140600662" watchObservedRunningTime="2026-06-05 21:29:11.909519137 +0000 UTC m=+1827.142785163" Jun 05 21:29:22.896845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:29:22.896808 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-wbnj8" Jun 05 21:30:42.899367 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:30:42.899335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:47.727670 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:30:47.727632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:30:47.828464 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:30:47.828437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:01.320460 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:33:01.320358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:01.407147 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:33:01.407117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:23.083178 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:33:23.083143 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:33:45.362401 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:33:45.362299 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:33:45.371702 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:33:45.371682 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:37:53.208680 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:37:53.208589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:37:58.509277 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:37:58.509182 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:22.773056 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:22.773017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:35.814885 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:35.814842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:37.381185 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.381158 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl"] Jun 05 21:38:37.384496 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.384479 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.387182 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.387160 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ee8ef7f4-openshift-default-dockercfg-vx9pc\"" Jun 05 21:38:37.403099 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403080 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-token\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403192 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-data\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403192 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-envoy\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403192 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403173 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istiod-ca-cert\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403329 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvjd\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-kube-api-access-ffvjd\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403329 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-credential-socket\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403329 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-socket\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403439 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403375 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-podinfo\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.403439 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.403398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-certs\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.408845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.408826 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl"] Jun 05 21:38:37.419582 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.419560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:37.490825 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.490794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:37.504126 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-credential-socket\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504253 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-socket\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504253 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-podinfo\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504253 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-certs\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504385 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-token\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504385 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-data\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504385 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-envoy\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504517 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istiod-ca-cert\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504517 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvjd\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-kube-api-access-ffvjd\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504614 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504552 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-credential-socket\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504783 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504756 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-data\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504920 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-socket\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.504920 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.504836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-certs\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.505233 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.505192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istiod-ca-cert\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.506654 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.506634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-envoy\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.506793 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.506777 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-podinfo\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.517455 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.517432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-token\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.517594 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.517577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvjd\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-kube-api-access-ffvjd\") pod \"e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.591473 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.591443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:37.692030 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.691956 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:37.695383 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.695365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:37.835678 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.835645 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl"] Jun 05 21:38:37.837287 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:38:37.837255 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36f645b_4021_4ee7_ac0a_1ed3713e1eb4.slice/crio-f60c0583a10c537766bb9e76f111d57c3ae5ffe705065a0b60f0477a54cf103c WatchSource:0}: Error finding container f60c0583a10c537766bb9e76f111d57c3ae5ffe705065a0b60f0477a54cf103c: Status 404 returned error can't find the container with id f60c0583a10c537766bb9e76f111d57c3ae5ffe705065a0b60f0477a54cf103c Jun 05 21:38:37.839230 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.839177 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:38:37.839322 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.839265 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:38:37.839322 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:37.839296 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:38:38.471487 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:38.471450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" event={"ID":"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4","Type":"ContainerStarted","Data":"c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1"} Jun 05 21:38:38.471857 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:38.471512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" event={"ID":"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4","Type":"ContainerStarted","Data":"f60c0583a10c537766bb9e76f111d57c3ae5ffe705065a0b60f0477a54cf103c"} Jun 05 21:38:38.495988 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:38.495941 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" podStartSLOduration=1.49592497 podStartE2EDuration="1.49592497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:38:38.494838771 +0000 UTC m=+2393.728104806" watchObservedRunningTime="2026-06-05 21:38:38.49592497 +0000 UTC m=+2393.729191003" Jun 05 21:38:38.696404 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:38.696374 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:38.701669 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:38.701646 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:39.476090 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:39.476059 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:39.477054 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:39.477034 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:40.963370 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:40.963335 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:43.620338 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:43.620303 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:43.784612 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:43.784580 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl"] Jun 05 21:38:43.784800 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:43.784769 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" podUID="d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" containerName="istio-proxy" containerID="cri-o://c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1" gracePeriod=30 Jun 05 21:38:43.811334 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:43.811309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:43.911966 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:43.911867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:45.390057 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:45.389942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:38:45.402251 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:45.399554 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bghj9_9f238cda-4a7d-4a70-bd32-22f728143005/ovn-acl-logging/0.log" Jun 05 21:38:45.827339 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:45.827313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:49.043649 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.043618 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:49.096079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096005 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-data\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096066 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-token\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096304 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096121 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-podinfo\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096304 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096186 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-envoy\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096304 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096231 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-credential-socket\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096304 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096257 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-socket\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096304 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096285 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istiod-ca-cert\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096546 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096311 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffvjd\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-kube-api-access-ffvjd\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096546 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096316 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:38:49.096546 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096336 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-certs\") pod \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\" (UID: \"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4\") " Jun 05 21:38:49.096686 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096579 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:38:49.096686 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096653 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:38:49.096686 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096672 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.096845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096692 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.096845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096816 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:38:49.096928 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.096839 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:38:49.098405 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.098383 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:38:49.098539 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.098403 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:38:49.098616 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.098599 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 21:38:49.098749 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.098733 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-kube-api-access-ffvjd" (OuterVolumeSpecName: "kube-api-access-ffvjd") pod "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" (UID: "d36f645b-4021-4ee7-ac0a-1ed3713e1eb4"). InnerVolumeSpecName "kube-api-access-ffvjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:38:49.197494 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197474 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.197494 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197494 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.197638 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197503 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.197638 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197511 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.197638 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197522 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.197638 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197531 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffvjd\" (UniqueName: \"kubernetes.io/projected/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-kube-api-access-ffvjd\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.197638 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.197538 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:38:49.526490 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.526421 2559 generic.go:356] "Generic (PLEG): container finished" podID="d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" containerID="c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1" exitCode=0 Jun 05 21:38:49.526490 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.526454 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" event={"ID":"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4","Type":"ContainerDied","Data":"c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1"} Jun 05 21:38:49.526490 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.526462 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" Jun 05 21:38:49.526709 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.526496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl" event={"ID":"d36f645b-4021-4ee7-ac0a-1ed3713e1eb4","Type":"ContainerDied","Data":"f60c0583a10c537766bb9e76f111d57c3ae5ffe705065a0b60f0477a54cf103c"} Jun 05 21:38:49.526709 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.526524 2559 scope.go:117] "RemoveContainer" containerID="c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1" Jun 05 21:38:49.535216 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.535185 2559 scope.go:117] "RemoveContainer" containerID="c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1" Jun 05 21:38:49.535536 ip-10-0-138-251 kubenswrapper[2559]: E0605 21:38:49.535513 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1\": container with ID starting with c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1 not found: ID does not exist" containerID="c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1" Jun 05 21:38:49.535637 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.535543 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1"} err="failed to get container status \"c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1\": rpc error: code = NotFound desc = could not find container \"c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1\": container with ID starting with c3612f6cf550baff66958f988cdbcd8d1f5ad54e7d8e8dcb03d179891543aee1 not found: ID does not exist" Jun 05 21:38:49.544927 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.544905 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl"] Jun 05 21:38:49.548859 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.548838 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ee8ef7f4-openshift-default-74c4dbdd5d-tw5bl"] Jun 05 21:38:49.780138 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.780060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:49.901867 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.901817 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:49.949674 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.949650 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps"] Jun 05 21:38:49.950339 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.950315 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" containerName="istio-proxy" Jun 05 21:38:49.950339 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.950339 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" containerName="istio-proxy" Jun 05 21:38:49.950500 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.950450 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" containerName="istio-proxy" Jun 05 21:38:49.954985 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.954956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:49.957993 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.957971 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1202c210-openshift-default-dockercfg-9pzc6\"" Jun 05 21:38:49.965496 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:49.965473 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps"] Jun 05 21:38:50.003258 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa64216b-dca7-4542-9127-882eda4c130a-istio-podinfo\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003354 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003285 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-socket\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003354 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b5rq\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-kube-api-access-9b5rq\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003354 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-credential-socket\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003462 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-envoy\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003462 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-istio-token\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003462 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa64216b-dca7-4542-9127-882eda4c130a-istiod-ca-cert\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003561 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-data\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.003561 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.003512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-certs\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.041035 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.041016 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:50.104359 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-data\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-certs\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa64216b-dca7-4542-9127-882eda4c130a-istio-podinfo\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-socket\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b5rq\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-kube-api-access-9b5rq\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-credential-socket\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-envoy\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.104690 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-istio-token\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.105079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa64216b-dca7-4542-9127-882eda4c130a-istiod-ca-cert\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.105079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104789 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-data\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.105079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-certs\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.105079 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.104874 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-credential-socket\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.105329 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.105105 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-socket\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.105390 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.105358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa64216b-dca7-4542-9127-882eda4c130a-istiod-ca-cert\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.106766 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.106746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-envoy\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.106872 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.106815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa64216b-dca7-4542-9127-882eda4c130a-istio-podinfo\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.117569 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.117539 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-istio-token\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.118456 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.118435 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b5rq\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-kube-api-access-9b5rq\") pod \"e2e-ait-1202c210-openshift-default-5494cfc964-wdvps\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.178916 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.178889 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:50.268206 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.268174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:50.269095 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.269069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:50.402065 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.402044 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps"] Jun 05 21:38:50.403577 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:38:50.403551 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa64216b_dca7_4542_9127_882eda4c130a.slice/crio-6d4f6edc31a5fee583ded07a3624300d88ee247accc5d207500e1c1fc68fffd5 WatchSource:0}: Error finding container 6d4f6edc31a5fee583ded07a3624300d88ee247accc5d207500e1c1fc68fffd5: Status 404 returned error can't find the container with id 6d4f6edc31a5fee583ded07a3624300d88ee247accc5d207500e1c1fc68fffd5 Jun 05 21:38:50.405856 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.405825 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:38:50.405944 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.405885 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:38:50.405944 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.405911 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 21:38:50.536912 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.536702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" event={"ID":"fa64216b-dca7-4542-9127-882eda4c130a","Type":"ContainerStarted","Data":"6ea6642d27e9c7a6fdd3572d06629b865b7c16b22ad535e541472bb3ee1ec526"} Jun 05 21:38:50.536912 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.536769 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" event={"ID":"fa64216b-dca7-4542-9127-882eda4c130a","Type":"ContainerStarted","Data":"6d4f6edc31a5fee583ded07a3624300d88ee247accc5d207500e1c1fc68fffd5"} Jun 05 21:38:50.557898 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:50.557847 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" podStartSLOduration=1.557831954 podStartE2EDuration="1.557831954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:38:50.556629607 +0000 UTC m=+2405.789895655" watchObservedRunningTime="2026-06-05 21:38:50.557831954 +0000 UTC m=+2405.791097987" Jun 05 21:38:51.219916 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:51.219874 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36f645b-4021-4ee7-ac0a-1ed3713e1eb4" path="/var/lib/kubelet/pods/d36f645b-4021-4ee7-ac0a-1ed3713e1eb4/volumes" Jun 05 21:38:51.268890 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:51.268856 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:51.273664 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:51.273644 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:51.541049 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:51.541012 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:51.541874 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:51.541855 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:38:53.234779 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:53.234743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:56.293751 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:56.293665 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:57.359667 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:57.359628 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps"] Jun 05 21:38:57.360140 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:57.359880 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" podUID="fa64216b-dca7-4542-9127-882eda4c130a" containerName="istio-proxy" containerID="cri-o://6ea6642d27e9c7a6fdd3572d06629b865b7c16b22ad535e541472bb3ee1ec526" gracePeriod=30 Jun 05 21:38:57.378928 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:57.378900 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:38:57.479390 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:38:57.479357 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:01.181920 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:01.181890 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:02.593610 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.593581 2559 generic.go:356] "Generic (PLEG): container finished" podID="fa64216b-dca7-4542-9127-882eda4c130a" containerID="6ea6642d27e9c7a6fdd3572d06629b865b7c16b22ad535e541472bb3ee1ec526" exitCode=0 Jun 05 21:39:02.594026 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.593649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" event={"ID":"fa64216b-dca7-4542-9127-882eda4c130a","Type":"ContainerDied","Data":"6ea6642d27e9c7a6fdd3572d06629b865b7c16b22ad535e541472bb3ee1ec526"} Jun 05 21:39:02.611175 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.611155 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:39:02.715817 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715727 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b5rq\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-kube-api-access-9b5rq\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.715817 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715766 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-certs\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.715817 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715804 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa64216b-dca7-4542-9127-882eda4c130a-istio-podinfo\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715827 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-credential-socket\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715850 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-istio-token\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715903 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-envoy\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715932 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa64216b-dca7-4542-9127-882eda4c130a-istiod-ca-cert\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.715979 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-data\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716092 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716063 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-socket\") pod \"fa64216b-dca7-4542-9127-882eda4c130a\" (UID: \"fa64216b-dca7-4542-9127-882eda4c130a\") " Jun 05 21:39:02.716416 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716156 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:39:02.716416 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716394 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:39:02.716416 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716399 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-certs\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.716572 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716467 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa64216b-dca7-4542-9127-882eda4c130a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:39:02.716572 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716502 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:39:02.716677 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.716614 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:39:02.718479 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.718444 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-kube-api-access-9b5rq" (OuterVolumeSpecName: "kube-api-access-9b5rq") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "kube-api-access-9b5rq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:39:02.718479 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.718448 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:39:02.718668 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.718529 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa64216b-dca7-4542-9127-882eda4c130a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 21:39:02.718668 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.718528 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa64216b-dca7-4542-9127-882eda4c130a" (UID: "fa64216b-dca7-4542-9127-882eda4c130a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:39:02.817600 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817571 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-workload-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817600 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817596 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b5rq\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-kube-api-access-9b5rq\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817607 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa64216b-dca7-4542-9127-882eda4c130a-istio-podinfo\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817616 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-credential-socket\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817625 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa64216b-dca7-4542-9127-882eda4c130a-istio-token\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817634 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-envoy\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817642 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa64216b-dca7-4542-9127-882eda4c130a-istiod-ca-cert\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:02.817773 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:02.817649 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa64216b-dca7-4542-9127-882eda4c130a-istio-data\") on node \"ip-10-0-138-251.ec2.internal\" DevicePath \"\"" Jun 05 21:39:03.135018 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.134984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:03.236135 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.236100 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:03.599319 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.599281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" event={"ID":"fa64216b-dca7-4542-9127-882eda4c130a","Type":"ContainerDied","Data":"6d4f6edc31a5fee583ded07a3624300d88ee247accc5d207500e1c1fc68fffd5"} Jun 05 21:39:03.599319 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.599320 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps" Jun 05 21:39:03.599798 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.599347 2559 scope.go:117] "RemoveContainer" containerID="6ea6642d27e9c7a6fdd3572d06629b865b7c16b22ad535e541472bb3ee1ec526" Jun 05 21:39:03.617316 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.617293 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps"] Jun 05 21:39:03.621085 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:03.621064 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1202c210-openshift-default-5494cfc964-wdvps"] Jun 05 21:39:05.220226 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:05.220179 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa64216b-dca7-4542-9127-882eda4c130a" path="/var/lib/kubelet/pods/fa64216b-dca7-4542-9127-882eda4c130a/volumes" Jun 05 21:39:14.734671 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:14.734640 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d4cdcb7d7-d984l_1e67af61-4747-4a86-a6ba-3b63bb38db97/nginx/0.log" Jun 05 21:39:15.179229 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:15.179188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5dc95cc54b-sstwt_4d7bea47-c7f9-461f-9397-22c6ef8a70af/maas-api/0.log" Jun 05 21:39:15.512522 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:15.512450 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-858c865b6c-dzq8n_4dccf775-4070-4c5a-a97c-58f5e9e5d882/manager/0.log" Jun 05 21:39:15.971167 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:15.971140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-rb75p_081fa85b-b121-4048-8260-88f92d99d8d2/copy-manifests/0.log" Jun 05 21:39:15.977608 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:15.977588 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-rb75p_081fa85b-b121-4048-8260-88f92d99d8d2/manager/0.log" Jun 05 21:39:17.552845 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:17.552811 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f7n7k_51d85443-0e5b-410b-85a4-08f0ee036701/manager/0.log" Jun 05 21:39:17.663710 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:17.663682 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hckz_8efe1f06-74e9-41dc-ac0f-387345233e0f/manager/0.log" Jun 05 21:39:17.873662 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:17.873597 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z6x95_530852b5-7741-49db-803b-602c6d620fa9/registry-server/0.log" Jun 05 21:39:17.987332 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:17.987289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wbnj8_79fe5243-bef8-4eb1-b466-b617d8dd3070/manager/0.log" Jun 05 21:39:18.219789 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:18.219723 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:18.281282 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:18.281250 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:18.551170 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:18.551146 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsjls8_afb569bb-4a2c-42aa-a103-da0f74f3cd09/istio-proxy/0.log" Jun 05 21:39:19.003145 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:19.003070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/1.log" Jun 05 21:39:19.228994 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:19.228969 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-d9jd2_8f6fecb7-5339-424b-a396-e37b5212b2c4/payload-processing/0.log" Jun 05 21:39:19.903333 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:19.903304 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk_b47d30f0-40b3-4a09-9463-6ce5167bdb44/storage-initializer/0.log" Jun 05 21:39:19.911017 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:19.910998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-q7bzk_b47d30f0-40b3-4a09-9463-6ce5167bdb44/main/0.log" Jun 05 21:39:20.164048 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:20.163970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-frtml_1b2ab9fc-2bbb-4454-9943-10caa3bbc467/storage-initializer/0.log" Jun 05 21:39:20.171302 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:20.171268 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-frtml_1b2ab9fc-2bbb-4454-9943-10caa3bbc467/main/0.log" Jun 05 21:39:23.816358 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:23.816330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:23.899859 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:23.899835 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:26.766947 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:26.766919 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-px84m_c43e216a-aa76-4c86-a622-4f420b93b79b/global-pull-secret-syncer/0.log" Jun 05 21:39:26.860859 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:26.860828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" Jun 05 21:39:26.982526 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:26.982502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-251.ec2.internal_25447eb9cc76fb74709e0c97b7e16a2d/haproxy/0.log" Jun 05 21:39:32.536091 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:32.536061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f7n7k_51d85443-0e5b-410b-85a4-08f0ee036701/manager/0.log" Jun 05 21:39:32.562627 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:32.562599 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9hckz_8efe1f06-74e9-41dc-ac0f-387345233e0f/manager/0.log" Jun 05 21:39:32.625832 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:32.625806 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z6x95_530852b5-7741-49db-803b-602c6d620fa9/registry-server/0.log" Jun 05 21:39:32.677822 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:32.677802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-wbnj8_79fe5243-bef8-4eb1-b466-b617d8dd3070/manager/0.log" Jun 05 21:39:33.756261 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:33.756175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwcn4_c1c6784b-e554-4e3e-bf9c-71587638d42a/konnectivity-agent/0.log" limit=1024 Jun 05 21:39:35.017730 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.017639 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtfwj_74ce046a-7a82-4e52-9ced-8f95647f3758/node-exporter/0.log" Jun 05 21:39:35.038262 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.038236 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtfwj_74ce046a-7a82-4e52-9ced-8f95647f3758/kube-rbac-proxy/0.log" Jun 05 21:39:35.059385 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.059363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtfwj_74ce046a-7a82-4e52-9ced-8f95647f3758/init-textfile/0.log" Jun 05 21:39:35.210504 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.210482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/prometheus/0.log" Jun 05 21:39:35.232607 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.232587 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/config-reloader/0.log" Jun 05 21:39:35.257750 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.257725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/thanos-sidecar/0.log" Jun 05 21:39:35.281910 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.281854 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/kube-rbac-proxy-web/0.log" Jun 05 21:39:35.306331 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.306312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/kube-rbac-proxy/0.log" Jun 05 21:39:35.330760 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.330741 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/kube-rbac-proxy-thanos/0.log" Jun 05 21:39:35.356383 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:35.356366 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_23ecf4d7-4892-4fe7-ae2e-4d1df2f65b95/init-config-reloader/0.log" Jun 05 21:39:38.609057 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.609022 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp"] Jun 05 21:39:38.609489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.609382 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa64216b-dca7-4542-9127-882eda4c130a" containerName="istio-proxy" Jun 05 21:39:38.609489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.609393 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa64216b-dca7-4542-9127-882eda4c130a" containerName="istio-proxy" Jun 05 21:39:38.609489 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.609463 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa64216b-dca7-4542-9127-882eda4c130a" containerName="istio-proxy" Jun 05 21:39:38.612581 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.612556 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.615571 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.615547 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7h26\"/\"default-dockercfg-2dbv6\"" Jun 05 21:39:38.615667 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.615600 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7h26\"/\"kube-root-ca.crt\"" Jun 05 21:39:38.615667 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.615595 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7h26\"/\"openshift-service-ca.crt\"" Jun 05 21:39:38.626778 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.626756 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp"] Jun 05 21:39:38.710249 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.710223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-lib-modules\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.710373 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.710272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-sys\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.710373 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.710294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-podres\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.710373 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.710327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-proc\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.710500 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.710398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8v92\" (UniqueName: \"kubernetes.io/projected/b9ef46f5-9719-4926-b32d-9b7d98305d82-kube-api-access-b8v92\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811348 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-lib-modules\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-sys\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811383 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-podres\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-proc\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811461 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8v92\" (UniqueName: \"kubernetes.io/projected/b9ef46f5-9719-4926-b32d-9b7d98305d82-kube-api-access-b8v92\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-sys\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811502 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-podres\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811500 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-lib-modules\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.811621 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.811526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9ef46f5-9719-4926-b32d-9b7d98305d82-proc\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.820276 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.820254 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8v92\" (UniqueName: \"kubernetes.io/projected/b9ef46f5-9719-4926-b32d-9b7d98305d82-kube-api-access-b8v92\") pod \"perf-node-gather-daemonset-s55hp\" (UID: \"b9ef46f5-9719-4926-b32d-9b7d98305d82\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:38.923475 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:38.923415 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:39.061457 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:39.061431 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp"] Jun 05 21:39:39.062662 ip-10-0-138-251 kubenswrapper[2559]: W0605 21:39:39.062632 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9ef46f5_9719_4926_b32d_9b7d98305d82.slice/crio-6846ecfd3b78ae7e58b32dac2eea038e2f8bf01bc2a081727a95e18d98a8721a WatchSource:0}: Error finding container 6846ecfd3b78ae7e58b32dac2eea038e2f8bf01bc2a081727a95e18d98a8721a: Status 404 returned error can't find the container with id 6846ecfd3b78ae7e58b32dac2eea038e2f8bf01bc2a081727a95e18d98a8721a Jun 05 21:39:39.771059 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:39.771021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" event={"ID":"b9ef46f5-9719-4926-b32d-9b7d98305d82","Type":"ContainerStarted","Data":"5eb0e83fb2457c089ef8ac963eebbcfbef7f3abc40b35e5c69f42d914d10e9d5"} Jun 05 21:39:39.771532 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:39.771075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" event={"ID":"b9ef46f5-9719-4926-b32d-9b7d98305d82","Type":"ContainerStarted","Data":"6846ecfd3b78ae7e58b32dac2eea038e2f8bf01bc2a081727a95e18d98a8721a"} Jun 05 21:39:39.771532 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:39.771173 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:39.788270 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:39.788188 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" podStartSLOduration=1.788172715 podStartE2EDuration="1.788172715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:39:39.787486442 +0000 UTC m=+2455.020752478" watchObservedRunningTime="2026-06-05 21:39:39.788172715 +0000 UTC m=+2455.021438748" Jun 05 21:39:40.125154 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:40.125123 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8n7bc_68595da0-67a0-4f47-aff0-582764bb90cf/dns/0.log" Jun 05 21:39:40.146491 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:40.146471 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8n7bc_68595da0-67a0-4f47-aff0-582764bb90cf/kube-rbac-proxy/0.log" Jun 05 21:39:40.269065 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:40.269044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffxkk_87447519-2834-48ac-b3d0-516b7055633b/dns-node-resolver/0.log" Jun 05 21:39:40.852585 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:40.852556 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59bd9dfd6c-sc8ss_a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1/registry/0.log" Jun 05 21:39:40.860743 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:40.860723 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59bd9dfd6c-sc8ss_a7955ee7-4e10-4856-b9ca-2d55eb9b5bc1/registry/1.log" Jun 05 21:39:40.905313 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:40.905291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7jnns_c82dff7b-8902-480e-8c51-98c164faa9bd/node-ca/0.log" Jun 05 21:39:41.892247 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:41.892218 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsjls8_afb569bb-4a2c-42aa-a103-da0f74f3cd09/istio-proxy/0.log" Jun 05 21:39:42.037559 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:42.037531 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/0.log" Jun 05 21:39:42.067504 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:42.067482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/1.log" Jun 05 21:39:42.173469 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:42.173407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-d9jd2_8f6fecb7-5339-424b-a396-e37b5212b2c4/payload-processing/0.log" Jun 05 21:39:42.810948 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:42.810921 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcmhx_c721f048-52b4-41b1-9568-ae2823f21b71/serve-healthcheck-canary/0.log" Jun 05 21:39:43.438371 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:43.438344 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9dbx_91add39a-8c0f-411d-9357-456e86f2667e/kube-rbac-proxy/0.log" Jun 05 21:39:43.461413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:43.461394 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9dbx_91add39a-8c0f-411d-9357-456e86f2667e/exporter/0.log" Jun 05 21:39:43.482667 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:43.482646 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j9dbx_91add39a-8c0f-411d-9357-456e86f2667e/extractor/0.log" Jun 05 21:39:45.784298 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:45.784220 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-s55hp" Jun 05 21:39:45.883774 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:45.883748 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d4cdcb7d7-d984l_1e67af61-4747-4a86-a6ba-3b63bb38db97/nginx/0.log" Jun 05 21:39:46.052625 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:46.052599 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5dc95cc54b-sstwt_4d7bea47-c7f9-461f-9397-22c6ef8a70af/maas-api/0.log" Jun 05 21:39:46.172100 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:46.172070 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-858c865b6c-dzq8n_4dccf775-4070-4c5a-a97c-58f5e9e5d882/manager/0.log" Jun 05 21:39:46.417495 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:46.417413 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-rb75p_081fa85b-b121-4048-8260-88f92d99d8d2/manager/0.log" Jun 05 21:39:46.442050 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:46.442032 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-rb75p_081fa85b-b121-4048-8260-88f92d99d8d2/copy-manifests/0.log" Jun 05 21:39:48.270282 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:48.270254 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-695db9fb68-25bcl_f38ad861-771a-4859-8b54-936c3fb573c4/manager/0.log" Jun 05 21:39:52.134344 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:52.134312 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsjls8_afb569bb-4a2c-42aa-a103-da0f74f3cd09/istio-proxy/0.log" Jun 05 21:39:52.242002 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:52.241975 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/0.log" Jun 05 21:39:52.274093 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:52.274068 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/1.log" Jun 05 21:39:52.367610 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:52.367583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-d9jd2_8f6fecb7-5339-424b-a396-e37b5212b2c4/payload-processing/0.log" Jun 05 21:39:53.604523 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:53.604487 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsjls8_afb569bb-4a2c-42aa-a103-da0f74f3cd09/istio-proxy/0.log" Jun 05 21:39:53.715190 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:53.715162 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/0.log" Jun 05 21:39:53.746307 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:53.746277 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/1.log" Jun 05 21:39:53.827939 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:53.827911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-d9jd2_8f6fecb7-5339-424b-a396-e37b5212b2c4/payload-processing/0.log" Jun 05 21:39:55.479190 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.479163 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcsjls8_afb569bb-4a2c-42aa-a103-da0f74f3cd09/istio-proxy/0.log" Jun 05 21:39:55.585016 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.584985 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/0.log" Jun 05 21:39:55.615360 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.615333 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-g9g6c_47ca58b9-df9c-4ec9-8684-aec5edd5907b/istio-proxy/1.log" Jun 05 21:39:55.672511 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.672485 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/kube-multus-additional-cni-plugins/0.log" Jun 05 21:39:55.696909 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.696869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-d9jd2_8f6fecb7-5339-424b-a396-e37b5212b2c4/payload-processing/0.log" Jun 05 21:39:55.698705 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.698683 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/egress-router-binary-copy/0.log" Jun 05 21:39:55.719541 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.719522 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/cni-plugins/0.log" Jun 05 21:39:55.741481 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.741413 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/bond-cni-plugin/0.log" Jun 05 21:39:55.762779 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.762759 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/routeoverride-cni/0.log" Jun 05 21:39:55.788413 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.788392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/whereabouts-cni-bincopy/0.log" Jun 05 21:39:55.809920 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.809900 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttqwl_05c04fa9-c365-42c4-a5c0-1f759225f4d2/whereabouts-cni/0.log" Jun 05 21:39:55.841007 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.840984 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b879f_e1db0040-13bc-4ce7-98a2-86f909961ac6/kube-multus/0.log" Jun 05 21:39:55.969500 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.969477 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mpdbw_53a39faf-b3bf-4573-9fb9-2637ac6c1a0f/network-metrics-daemon/0.log" Jun 05 21:39:55.990406 ip-10-0-138-251 kubenswrapper[2559]: I0605 21:39:55.990386 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mpdbw_53a39faf-b3bf-4573-9fb9-2637ac6c1a0f/kube-rbac-proxy/0.log"