Jun 11 15:29:08.271662 ip-10-0-133-9 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 15:29:08.271675 ip-10-0-133-9 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 15:29:08.271685 ip-10-0-133-9 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 15:29:08.271898 ip-10-0-133-9 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 15:29:18.336884 ip-10-0-133-9 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 15:29:18.336905 ip-10-0-133-9 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 571c427d07b447e7bdb795a502964c1c -- Jun 11 15:32:06.587578 ip-10-0-133-9 systemd[1]: Starting Kubernetes Kubelet... Jun 11 15:32:07.027469 ip-10-0-133-9 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:32:07.027469 ip-10-0-133-9 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 15:32:07.027469 ip-10-0-133-9 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:32:07.027469 ip-10-0-133-9 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 15:32:07.027469 ip-10-0-133-9 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:32:07.028546 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.028449 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 15:32:07.033500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033478 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:32:07.033500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033499 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:32:07.033500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033503 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033507 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033510 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033513 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033516 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033520 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033526 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033528 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033531 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033534 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033537 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033539 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033542 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033546 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033557 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033560 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033563 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033566 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033569 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033571 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:32:07.033607 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033574 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033577 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033581 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033585 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033588 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033590 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033593 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033596 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033599 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033601 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033604 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033606 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033609 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033612 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033615 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033618 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033620 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033623 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033626 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:32:07.034094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033629 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033631 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033635 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033637 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033640 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033648 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033651 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033653 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033656 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033658 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033661 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033663 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033666 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033668 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033671 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033676 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033679 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033682 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033685 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:32:07.034567 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033688 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033691 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033694 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033697 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033700 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033703 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033706 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033709 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033712 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033714 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033717 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033720 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033723 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033725 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033727 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033730 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033732 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033736 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033738 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033741 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:32:07.035045 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033744 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033747 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033750 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033752 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033755 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033757 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033760 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033762 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033765 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033768 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033771 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033773 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033776 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033779 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033782 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033785 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033788 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033790 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.033793 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034653 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:32:07.035541 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034661 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034665 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034668 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034671 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034681 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034685 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034688 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034691 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034695 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034699 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034701 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034706 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034715 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034718 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034721 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034724 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034726 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034729 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034732 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:32:07.036019 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034734 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034737 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034740 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034744 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034746 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034749 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034753 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034756 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034758 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034761 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034763 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034766 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034769 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034771 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034774 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034776 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034779 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034782 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034790 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034793 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:32:07.036500 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034796 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034798 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034801 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034803 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034806 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034809 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034811 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034814 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034816 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034819 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034822 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034824 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034826 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034830 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034833 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034835 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034838 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034841 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034843 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:32:07.036990 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034846 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034849 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034851 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034854 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034856 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034859 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034861 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034864 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034866 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034869 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034873 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034876 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034879 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034882 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034884 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034887 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034889 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034892 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034894 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034897 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:32:07.037486 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034899 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034902 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034904 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034907 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034909 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034912 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034915 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034927 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034929 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034933 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034935 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034938 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034942 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034946 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034949 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034952 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034955 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034958 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034960 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.034963 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:32:07.038002 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035913 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035919 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035924 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035926 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035930 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035933 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035936 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035939 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035942 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035947 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035950 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035952 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035955 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035958 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035960 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035963 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035965 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035968 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035971 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035974 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:32:07.038510 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035976 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035979 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035982 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035985 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035987 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035993 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035996 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.035998 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036001 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036003 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036006 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036008 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036011 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036013 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036016 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036018 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036021 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036029 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036032 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036035 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:32:07.039042 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036038 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036040 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036043 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036045 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036048 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036050 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036053 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036056 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036058 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036061 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036063 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036066 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036069 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036072 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036074 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036077 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036080 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036083 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036086 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036088 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:32:07.039629 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036091 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036093 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036095 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036098 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036101 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036103 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036106 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036108 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036110 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036113 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036131 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036136 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036140 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036144 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036148 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036152 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036155 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036157 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036160 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036163 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:32:07.040111 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036165 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036170 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036174 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036178 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036181 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036184 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036187 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036190 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036193 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036196 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036199 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036203 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036206 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036209 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036211 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036214 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036216 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036219 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:32:07.040636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036221 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036294 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036302 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036309 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036314 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036320 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036323 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036327 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036332 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036335 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036338 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036342 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036345 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036348 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036352 2576 flags.go:64] FLAG: --cgroup-root="" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036355 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036362 2576 flags.go:64] FLAG: --client-ca-file="" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036365 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036369 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036375 2576 flags.go:64] FLAG: --cluster-domain="" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036378 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036382 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036385 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036389 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 15:32:07.041086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036393 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036396 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036399 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036403 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036406 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036409 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036413 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036416 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036419 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036424 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036427 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036430 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036433 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036436 2576 flags.go:64] FLAG: --enable-server="true" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036440 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036445 2576 flags.go:64] FLAG: --event-burst="100" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036448 2576 flags.go:64] FLAG: --event-qps="50" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036451 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036454 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036457 2576 flags.go:64] FLAG: --eviction-hard="" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036461 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036465 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036468 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036470 2576 flags.go:64] FLAG: --eviction-soft="" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036475 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 15:32:07.041705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036478 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036481 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036484 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036487 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036490 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036492 2576 flags.go:64] FLAG: --feature-gates="" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036496 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036500 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036503 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036506 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036509 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036513 2576 flags.go:64] FLAG: --help="false" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036516 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036519 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036521 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036524 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036528 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036531 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036535 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036538 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036541 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036544 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036547 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036551 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 15:32:07.042365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036554 2576 flags.go:64] FLAG: --kube-reserved="" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036557 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036560 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036563 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036566 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036571 2576 flags.go:64] FLAG: --lock-file="" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036574 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036578 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036581 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036587 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036590 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036593 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036596 2576 flags.go:64] FLAG: --logging-format="text" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036598 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036602 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036605 2576 flags.go:64] FLAG: --manifest-url="" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036607 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036612 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036615 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036619 2576 flags.go:64] FLAG: --max-pods="110" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036622 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036625 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036627 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036630 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036633 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 15:32:07.042972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036636 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036639 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036647 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036650 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036653 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036657 2576 flags.go:64] FLAG: --pod-cidr="" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036661 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036667 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036670 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036673 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036676 2576 flags.go:64] FLAG: --port="10250" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036679 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036683 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b945fb26838f1992" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036686 2576 flags.go:64] FLAG: --qos-reserved="" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036689 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036693 2576 flags.go:64] FLAG: --register-node="true" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036696 2576 flags.go:64] FLAG: --register-with-taints="" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036700 2576 flags.go:64] FLAG: --registry-burst="10" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036703 2576 flags.go:64] FLAG: --registry-qps="5" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036706 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036709 2576 flags.go:64] FLAG: --reserved-memory="" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036713 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036717 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036720 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036723 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 15:32:07.043600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036726 2576 flags.go:64] FLAG: --runonce="false" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036729 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036732 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036735 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036738 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036741 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036744 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036747 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036750 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036753 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036756 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036759 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036761 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036765 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036768 2576 flags.go:64] FLAG: --system-cgroups="" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036771 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036777 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036780 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036782 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036789 2576 flags.go:64] FLAG: --tls-min-version="" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036792 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036794 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036798 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036801 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036804 2576 flags.go:64] FLAG: --v="2" Jun 11 15:32:07.044258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036809 2576 flags.go:64] FLAG: --version="false" Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036814 2576 flags.go:64] FLAG: --vmodule="" Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036817 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.036821 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036971 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036976 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036979 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036982 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036985 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036988 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036990 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036994 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.036998 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037000 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037004 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037007 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037009 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037013 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037016 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037018 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:32:07.044935 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037021 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037024 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037028 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037031 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037034 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037037 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037041 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037044 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037046 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037050 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037053 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037056 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037059 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037061 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037064 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037067 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037070 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037072 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037075 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037079 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:32:07.045545 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037083 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037085 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037088 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037091 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037093 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037096 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037098 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037101 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037104 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037106 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037109 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037111 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037114 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037136 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037139 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037142 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037145 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037147 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037152 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:32:07.046038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037156 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037159 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037164 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037167 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037170 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037173 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037176 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037178 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037181 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037183 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037186 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037189 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037191 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037194 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037197 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037199 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037202 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037205 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037207 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037210 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:32:07.046535 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037213 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037215 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037218 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037220 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037223 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037226 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037228 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037231 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037234 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037238 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037241 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037246 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037249 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037252 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037256 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037259 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037261 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037264 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037267 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:32:07.047038 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037270 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037273 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037275 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037278 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.037280 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.038079 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.045170 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.045186 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.045207 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.045214 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045278 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045284 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045287 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045292 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:32:07.047513 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045296 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045300 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045303 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045306 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045308 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045311 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045314 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045316 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045319 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045321 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045325 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045329 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045332 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045336 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045339 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045342 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045345 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045347 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045350 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:32:07.047906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045353 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045355 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045358 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045360 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045363 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045366 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045369 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045372 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045375 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045377 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045380 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045382 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045385 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045388 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045390 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045393 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045396 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045398 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045401 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045404 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:32:07.048394 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045406 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045409 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045411 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045414 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045417 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045420 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045422 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045425 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045428 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045431 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045433 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045435 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045438 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045441 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045443 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045446 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045448 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045451 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045454 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045457 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:32:07.048899 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045459 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045462 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045464 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045467 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045469 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045472 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045475 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045477 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045480 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045482 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045485 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045487 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045490 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045492 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045495 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045497 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045501 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045503 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045506 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:32:07.049487 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045509 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045511 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045514 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045517 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045519 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045522 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045525 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045527 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045530 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045532 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045535 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045538 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045541 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045546 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045550 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045554 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:32:07.049979 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045557 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.045562 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045678 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045684 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045687 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045690 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045693 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045696 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045699 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045702 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045705 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045708 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045711 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045714 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045717 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:32:07.050382 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045719 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045722 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045725 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045727 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045730 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045732 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045736 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045739 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045743 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045745 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045747 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045750 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045752 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045756 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045759 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045762 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045765 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045767 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045771 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:32:07.050763 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045775 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045777 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045780 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045783 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045785 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045789 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045791 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045794 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045796 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045799 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045801 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045804 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045806 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045809 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045811 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045814 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045817 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045819 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045822 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045824 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:32:07.051257 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045827 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045829 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045832 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045834 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045836 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045839 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045842 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045844 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045847 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045850 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045852 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045855 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045857 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045860 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045862 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045864 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045867 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045870 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045872 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045875 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:32:07.051744 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045877 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045880 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045882 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045884 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045887 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045889 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045892 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045897 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045900 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045902 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045905 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045908 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045910 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045913 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045915 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045918 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045921 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045923 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045926 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045929 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045931 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:32:07.052270 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045934 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045939 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045942 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045944 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045947 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:07.045950 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.045955 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.046079 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.048214 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.049608 2576 server.go:1019] "Starting client certificate rotation" Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.049719 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.049758 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:32:07.052789 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.052305 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:32:07.056768 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.056703 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:32:07.064351 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.064328 2576 log.go:25] "Validated CRI v1 runtime API" Jun 11 15:32:07.067388 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.067370 2576 log.go:25] "Validated CRI v1 image API" Jun 11 15:32:07.068246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.068230 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 15:32:07.074551 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.074518 2576 fs.go:135] Filesystem UUIDs: map[4948b6c2-f725-4c8d-9093-dc6528667f8c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cc522ac9-3f5d-4d87-8437-897f62ea58d7:/dev/nvme0n1p4] Jun 11 15:32:07.074669 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.074549 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 15:32:07.081392 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.081266 2576 manager.go:216] Machine: {Timestamp:2026-06-11 15:32:07.078383079 +0000 UTC m=+0.352210112 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111368 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c9b1e15737f3990f14b494a1fbe42 SystemUUID:ec2c9b1e-1573-7f39-90f1-4b494a1fbe42 BootID:571c427d-07b4-47e7-bdb7-95a502964c1c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c2:2c:85:fa:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c2:2c:85:fa:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:17:0d:49:06:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 15:32:07.081392 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.081383 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 15:32:07.081541 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.081528 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 15:32:07.083970 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.083935 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 15:32:07.084138 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.083972 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 15:32:07.085231 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.085220 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 15:32:07.085265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.085233 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 15:32:07.085265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.085241 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:32:07.085748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.085737 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:32:07.085804 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.085788 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:32:07.086637 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.086625 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 15:32:07.090371 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090358 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:32:07.090505 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090495 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 15:32:07.090535 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090527 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 11 15:32:07.090571 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090538 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 15:32:07.090571 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090553 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 15:32:07.090571 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090563 2576 kubelet.go:398] "Adding apiserver pod source" Jun 11 15:32:07.090673 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090574 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 15:32:07.090978 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090965 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:32:07.091018 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.090986 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:32:07.093805 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.093783 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 15:32:07.095549 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.095529 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 15:32:07.095636 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.095571 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 15:32:07.096838 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096810 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096848 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096866 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096878 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096896 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096905 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096913 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 15:32:07.096924 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096918 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 15:32:07.097246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096932 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 15:32:07.097246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096937 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 15:32:07.097246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096946 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 15:32:07.097246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.096951 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 15:32:07.097932 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.097919 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 15:32:07.097932 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.097932 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 15:32:07.098996 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.098960 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 15:32:07.098996 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.098973 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 15:32:07.102189 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.102150 2576 server.go:1268] "Started kubelet" Jun 11 15:32:07.102653 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.102598 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 15:32:07.102653 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.102602 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 15:32:07.102791 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.102699 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 15:32:07.102859 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.102839 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 15:32:07.103313 ip-10-0-133-9 systemd[1]: Started Kubernetes Kubelet. Jun 11 15:32:07.104613 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.104597 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 15:32:07.107784 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.107764 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 11 15:32:07.108594 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.108566 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r2rcg" Jun 11 15:32:07.111890 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.111866 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 15:32:07.112348 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.111141 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-9.ec2.internal.18b8109edbb51592 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-9.ec2.internal,UID:ip-10-0-133-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-9.ec2.internal,},FirstTimestamp:2026-06-11 15:32:07.101986194 +0000 UTC m=+0.375813227,LastTimestamp:2026-06-11 15:32:07.101986194 +0000 UTC m=+0.375813227,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-9.ec2.internal,}" Jun 11 15:32:07.113109 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.113089 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 15:32:07.113259 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.113242 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r2rcg" Jun 11 15:32:07.113708 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.113686 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 15:32:07.113869 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.113834 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.114467 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114451 2576 factory.go:55] Registering systemd factory Jun 11 15:32:07.114467 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114459 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 15:32:07.114588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114461 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 15:32:07.114588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114497 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 15:32:07.114588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114467 2576 factory.go:223] Registration of the systemd container factory successfully Jun 11 15:32:07.114588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114583 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 11 15:32:07.114588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114591 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 11 15:32:07.114785 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114766 2576 factory.go:153] Registering CRI-O factory Jun 11 15:32:07.114785 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114786 2576 factory.go:223] Registration of the crio container factory successfully Jun 11 15:32:07.114914 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114843 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 15:32:07.114914 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114868 2576 factory.go:103] Registering Raw factory Jun 11 15:32:07.114914 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.114911 2576 manager.go:1196] Started watching for new ooms in manager Jun 11 15:32:07.115460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.115443 2576 manager.go:349] Starting recovery of all containers Jun 11 15:32:07.119742 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.119716 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:32:07.122823 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.122782 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-9.ec2.internal\" not found" node="ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.125160 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.125089 2576 manager.go:354] Recovery completed Jun 11 15:32:07.130064 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.130045 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.132690 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.132671 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.132763 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.132703 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.132763 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.132717 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.133408 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.133287 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 15:32:07.133408 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.133294 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 15:32:07.133408 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.133298 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.133408 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.133313 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:32:07.134765 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.134750 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.134826 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.134775 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.134826 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.134786 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.134952 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.134941 2576 policy_none.go:49] "None policy: Start" Jun 11 15:32:07.134998 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.134962 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 15:32:07.134998 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.134972 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 15:32:07.136045 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.136035 2576 policy_none.go:47] "Start" Jun 11 15:32:07.171900 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.171878 2576 manager.go:337] "Starting Device Plugin manager" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.171925 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.171938 2576 server.go:87] "Starting device plugin registration server" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.172266 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.172277 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.172391 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.172503 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.172514 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.173087 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.173148 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.187316 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.188539 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.188578 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.188602 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 15:32:07.191489 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.188707 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 15:32:07.192031 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.191759 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:32:07.272701 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.272657 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.273804 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.273787 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.273915 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.273819 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.273915 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.273830 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.273915 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.273854 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.283797 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.283728 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.283797 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.283759 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-9.ec2.internal\": node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.289558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.289532 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal"] Jun 11 15:32:07.289733 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.289597 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.290605 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.290588 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.290698 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.290620 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.290698 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.290633 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.292203 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.292185 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.292311 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.292295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.292369 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.292342 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.293759 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.293739 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.293759 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.293753 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.293880 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.293770 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.293880 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.293775 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.293880 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.293780 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.293880 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.293784 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.294942 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.294924 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.295242 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.295227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.295289 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.295254 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:32:07.296015 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.295998 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:32:07.296109 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.296029 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:32:07.296109 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.296040 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:32:07.315706 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.315667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d761d2d4be781a3e2d274d59106da420-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"d761d2d4be781a3e2d274d59106da420\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.315706 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.315707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d761d2d4be781a3e2d274d59106da420-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"d761d2d4be781a3e2d274d59106da420\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.315892 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.315736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c4691f8359481e5266cae197cdb602c5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-9.ec2.internal\" (UID: \"c4691f8359481e5266cae197cdb602c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.324135 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.324101 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-9.ec2.internal\" not found" node="ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.328824 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.328807 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-9.ec2.internal\" not found" node="ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.395773 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.395741 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.416810 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.416784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c4691f8359481e5266cae197cdb602c5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-9.ec2.internal\" (UID: \"c4691f8359481e5266cae197cdb602c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.416919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.416817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d761d2d4be781a3e2d274d59106da420-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"d761d2d4be781a3e2d274d59106da420\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.416919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.416841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d761d2d4be781a3e2d274d59106da420-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"d761d2d4be781a3e2d274d59106da420\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.416919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.416882 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d761d2d4be781a3e2d274d59106da420-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"d761d2d4be781a3e2d274d59106da420\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.416919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.416909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d761d2d4be781a3e2d274d59106da420-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal\" (UID: \"d761d2d4be781a3e2d274d59106da420\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.417068 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.416909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c4691f8359481e5266cae197cdb602c5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-9.ec2.internal\" (UID: \"c4691f8359481e5266cae197cdb602c5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.496455 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.496403 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.597315 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.597229 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.628807 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.628771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.633206 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:07.632976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" Jun 11 15:32:07.697754 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.697704 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.798269 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.798239 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.898950 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.898855 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:07.999383 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:07.999354 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:08.048851 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.048817 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 15:32:08.049597 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.049008 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:32:08.049597 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.049069 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:32:08.097985 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:08.097943 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd761d2d4be781a3e2d274d59106da420.slice/crio-605e195d5aae031d4e690923c5ff12c222f9691d9a631ba836542c157d9f5b33 WatchSource:0}: Error finding container 605e195d5aae031d4e690923c5ff12c222f9691d9a631ba836542c157d9f5b33: Status 404 returned error can't find the container with id 605e195d5aae031d4e690923c5ff12c222f9691d9a631ba836542c157d9f5b33 Jun 11 15:32:08.098302 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:08.098280 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4691f8359481e5266cae197cdb602c5.slice/crio-5b7f3975f45b53a61e56fca36fc25f65496f6ee2ebbeed0865bb7c62d9db46c5 WatchSource:0}: Error finding container 5b7f3975f45b53a61e56fca36fc25f65496f6ee2ebbeed0865bb7c62d9db46c5: Status 404 returned error can't find the container with id 5b7f3975f45b53a61e56fca36fc25f65496f6ee2ebbeed0865bb7c62d9db46c5 Jun 11 15:32:08.100429 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:08.100404 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-9.ec2.internal\" not found" Jun 11 15:32:08.105250 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.105234 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:32:08.115680 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.115642 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 15:27:07 +0000 UTC" deadline="2028-01-26 02:27:18.783038819 +0000 UTC" Jun 11 15:32:08.115680 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.115676 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14242h55m10.667367004s" Jun 11 15:32:08.162771 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.162653 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:32:08.192385 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.192334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" event={"ID":"d761d2d4be781a3e2d274d59106da420","Type":"ContainerStarted","Data":"605e195d5aae031d4e690923c5ff12c222f9691d9a631ba836542c157d9f5b33"} Jun 11 15:32:08.193380 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.193357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" event={"ID":"c4691f8359481e5266cae197cdb602c5","Type":"ContainerStarted","Data":"5b7f3975f45b53a61e56fca36fc25f65496f6ee2ebbeed0865bb7c62d9db46c5"} Jun 11 15:32:08.214597 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.214556 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" Jun 11 15:32:08.228262 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.228237 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:32:08.230265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.230250 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" Jun 11 15:32:08.240453 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.240432 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:32:08.529604 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.529522 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:32:08.893799 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:08.893647 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:32:09.091934 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.091903 2576 apiserver.go:52] "Watching apiserver" Jun 11 15:32:09.100361 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.100328 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 15:32:09.100720 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.100694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xz527","kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7","openshift-cluster-node-tuning-operator/tuned-rtrr8","openshift-image-registry/node-ca-kl7vv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal","openshift-multus/multus-mq2z5","openshift-dns/node-resolver-jq7wc","openshift-multus/multus-additional-cni-plugins-cknh7","openshift-multus/network-metrics-daemon-bcpbt","openshift-network-diagnostics/network-check-target-d6g69","openshift-network-operator/iptables-alerter-jxchx","openshift-ovn-kubernetes/ovnkube-node-nb2gq","kube-system/global-pull-secret-syncer-tnznf"] Jun 11 15:32:09.102373 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.102350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.103956 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.103934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.105339 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.105316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.105450 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.105399 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.105506 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.105489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 15:32:09.105629 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.105607 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.105698 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.105625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 15:32:09.105698 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.105673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-csjqb\"" Jun 11 15:32:09.106268 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.106250 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 15:32:09.106592 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.106573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.106678 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.106669 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 15:32:09.106734 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.106712 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rfrcl\"" Jun 11 15:32:09.106948 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.106927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 15:32:09.107082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.107023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.107082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.107062 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.107082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.107023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 15:32:09.107931 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.107913 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.108180 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.108115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.108284 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.108180 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 15:32:09.108728 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.108598 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6v85k\"" Jun 11 15:32:09.108728 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.108630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.109238 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.109199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.109238 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.109212 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-84hx5\"" Jun 11 15:32:09.109609 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.109590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.110247 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.109973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.110247 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.110061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:09.111018 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.110426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.111018 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.110644 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 15:32:09.111018 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.110676 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.111018 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.110950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b64qj\"" Jun 11 15:32:09.111977 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.111957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.113529 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.113509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.113846 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.113828 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 15:32:09.114480 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.114422 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 15:32:09.114480 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.114446 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 15:32:09.114480 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.114470 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lv8r7\"" Jun 11 15:32:09.115159 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.115133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.115999 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.115980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 15:32:09.116282 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.116133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-px54d\"" Jun 11 15:32:09.116282 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.116163 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 15:32:09.116948 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.116929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.117038 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.116998 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:09.117762 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.117566 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.117762 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.117582 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.117762 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.117570 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dkbdj\"" Jun 11 15:32:09.118692 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.118673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:09.118782 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.118756 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:09.122977 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.122944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.126026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.126001 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:32:09.126026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.126019 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 15:32:09.126190 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.126085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 15:32:09.126252 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.126199 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-78ndn\"" Jun 11 15:32:09.127530 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovn-node-metrics-cert\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.127616 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-device-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.127616 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.127722 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2mfk\" (UniqueName: \"kubernetes.io/projected/d45ee1f7-41f3-4275-b546-954dbdbb2af1-kube-api-access-l2mfk\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.127722 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-netns\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.127818 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-cni-netd\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.127818 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-env-overrides\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.127910 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-cni-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.127910 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-conf-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.127910 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.128034 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysctl-d\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.128034 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-systemd\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.128034 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f125d5bf-4492-409a-8984-89d873b151bd-etc-tuned\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.128034 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.127980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17def5f2-9bfc-48aa-aed8-9029fb09d8cb-konnectivity-ca\") pod \"konnectivity-agent-xz527\" (UID: \"17def5f2-9bfc-48aa-aed8-9029fb09d8cb\") " pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.128034 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.128290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-sys-fs\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.128290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.128290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-cni-multus\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.128290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-multus-certs\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovnkube-script-lib\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flpg7\" (UniqueName: \"kubernetes.io/projected/0b774e20-f83c-494f-903a-80ab0d32eeb9-kube-api-access-flpg7\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17def5f2-9bfc-48aa-aed8-9029fb09d8cb-agent-certs\") pod \"konnectivity-agent-xz527\" (UID: \"17def5f2-9bfc-48aa-aed8-9029fb09d8cb\") " pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-etc-selinux\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128411 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-run\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-var-lib-kubelet\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-serviceca\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.128479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128475 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfcxv\" (UniqueName: \"kubernetes.io/projected/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-kube-api-access-kfcxv\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-kubelet\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-system-cni-dir\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cnibin\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e5e884f-73ea-48fc-951c-537d741857b6-tmp-dir\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-system-cni-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-log-socket\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-socket-dir-parent\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-daemon-config\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.128795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-hostroot\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7bxr\" (UniqueName: \"kubernetes.io/projected/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-kube-api-access-m7bxr\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-slash\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-etc-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-host\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-cni-binary-copy\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-ovn\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-socket-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.128988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-lib-modules\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-registration-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44135148-b091-45e2-8932-9944572694fc-kubelet-config\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd969\" (UniqueName: \"kubernetes.io/projected/2e5e884f-73ea-48fc-951c-537d741857b6-kube-api-access-vd969\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-cni-bin\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-run-netns\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovnkube-config\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-sys\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-host\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f125d5bf-4492-409a-8984-89d873b151bd-tmp\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-var-lib-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44135148-b091-45e2-8932-9944572694fc-dbus\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-cnibin\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-os-release\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-systemd-units\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-node-log\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-os-release\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-modprobe-d\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k5lz\" (UniqueName: \"kubernetes.io/projected/f125d5bf-4492-409a-8984-89d873b151bd-kube-api-access-2k5lz\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-k8s-cni-cncf-io\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.129844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-kubelet\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-etc-kubernetes\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.129810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-systemd\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130006 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-cni-bin\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4v5t\" (UniqueName: \"kubernetes.io/projected/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-kube-api-access-m4v5t\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysconfig\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-kubernetes\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysctl-conf\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.130578 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.130349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e5e884f-73ea-48fc-951c-537d741857b6-hosts-file\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.150684 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.150657 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lglzl" Jun 11 15:32:09.158339 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.158314 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lglzl" Jun 11 15:32:09.216113 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.216085 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 15:32:09.231347 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-cni-bin\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4v5t\" (UniqueName: \"kubernetes.io/projected/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-kube-api-access-m4v5t\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysconfig\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-cni-bin\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-kubernetes\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231457 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysconfig\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysctl-conf\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231562 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e5e884f-73ea-48fc-951c-537d741857b6-hosts-file\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-kubernetes\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-host-slash\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovn-node-metrics-cert\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-device-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e5e884f-73ea-48fc-951c-537d741857b6-hosts-file\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2mfk\" (UniqueName: \"kubernetes.io/projected/d45ee1f7-41f3-4275-b546-954dbdbb2af1-kube-api-access-l2mfk\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysctl-conf\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-netns\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-device-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-cni-netd\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.231882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-env-overrides\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-cni-netd\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-cni-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.231994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-conf-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-conf-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-netns\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysctl-d\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-systemd\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f125d5bf-4492-409a-8984-89d873b151bd-etc-tuned\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232257 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-systemd\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17def5f2-9bfc-48aa-aed8-9029fb09d8cb-konnectivity-ca\") pod \"konnectivity-agent-xz527\" (UID: \"17def5f2-9bfc-48aa-aed8-9029fb09d8cb\") " pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232286 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-cni-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232434 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-sys-fs\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232441 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-kubelet-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.232664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cni-binary-copy\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-sys-fs\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-env-overrides\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-sysctl-d\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-cni-multus\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-multus-certs\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovnkube-script-lib\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flpg7\" (UniqueName: \"kubernetes.io/projected/0b774e20-f83c-494f-903a-80ab0d32eeb9-kube-api-access-flpg7\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232851 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17def5f2-9bfc-48aa-aed8-9029fb09d8cb-konnectivity-ca\") pod \"konnectivity-agent-xz527\" (UID: \"17def5f2-9bfc-48aa-aed8-9029fb09d8cb\") " pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17def5f2-9bfc-48aa-aed8-9029fb09d8cb-agent-certs\") pod \"konnectivity-agent-xz527\" (UID: \"17def5f2-9bfc-48aa-aed8-9029fb09d8cb\") " pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-etc-selinux\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232895 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-cni-multus\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-run\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232868 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-multus-certs\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-var-lib-kubelet\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.232985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-var-lib-kubelet\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.233460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-etc-selinux\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-run\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-serviceca\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfcxv\" (UniqueName: \"kubernetes.io/projected/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-kube-api-access-kfcxv\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233112 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d45ee1f7-41f3-4275-b546-954dbdbb2af1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-kubelet\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-system-cni-dir\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cnibin\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e5e884f-73ea-48fc-951c-537d741857b6-tmp-dir\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-system-cni-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-kubelet\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-log-socket\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-socket-dir-parent\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-daemon-config\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.233391 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233397 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovnkube-script-lib\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.234331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tcx4\" (UniqueName: \"kubernetes.io/projected/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-kube-api-access-2tcx4\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.233471 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:32:09.733435981 +0000 UTC m=+3.007263000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-hostroot\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-system-cni-dir\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-serviceca\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-cnibin\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233581 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-system-cni-dir\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233619 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-hostroot\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-socket-dir-parent\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-log-socket\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7bxr\" (UniqueName: \"kubernetes.io/projected/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-kube-api-access-m7bxr\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-slash\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-etc-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233763 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-host\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-cni-binary-copy\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-ovn\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-socket-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.235199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-slash\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e5e884f-73ea-48fc-951c-537d741857b6-tmp-dir\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-host\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-etc-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-lib-modules\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-registration-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44135148-b091-45e2-8932-9944572694fc-kubelet-config\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.233998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd969\" (UniqueName: \"kubernetes.io/projected/2e5e884f-73ea-48fc-951c-537d741857b6-kube-api-access-vd969\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-multus-daemon-config\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-cni-bin\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-cni-bin\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44135148-b091-45e2-8932-9944572694fc-kubelet-config\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-run-netns\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234143 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-ovn\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovnkube-config\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-sys\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.235941 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-host\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f125d5bf-4492-409a-8984-89d873b151bd-tmp\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-socket-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-var-lib-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44135148-b091-45e2-8932-9944572694fc-dbus\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-run-netns\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-cni-binary-copy\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snt5j\" (UniqueName: \"kubernetes.io/projected/4bb63b58-a475-4a33-9dce-5252f70f5b92-kube-api-access-snt5j\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-registration-dir\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-iptables-alerter-script\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-cnibin\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-lib-modules\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-os-release\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-sys\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-os-release\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.236860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44135148-b091-45e2-8932-9944572694fc-dbus\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-systemd-units\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-node-log\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-cnibin\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-os-release\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-host\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-modprobe-d\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k5lz\" (UniqueName: \"kubernetes.io/projected/f125d5bf-4492-409a-8984-89d873b151bd-kube-api-access-2k5lz\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-node-log\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-var-lib-openvswitch\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234724 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d45ee1f7-41f3-4275-b546-954dbdbb2af1-os-release\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f125d5bf-4492-409a-8984-89d873b151bd-etc-modprobe-d\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-k8s-cni-cncf-io\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovnkube-config\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-systemd-units\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-run-k8s-cni-cncf-io\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-kubelet\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.237694 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-etc-kubernetes\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-systemd\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-etc-kubernetes\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.234961 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-host-var-lib-kubelet\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.235022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b774e20-f83c-494f-903a-80ab0d32eeb9-run-systemd\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.236197 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f125d5bf-4492-409a-8984-89d873b151bd-etc-tuned\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.236252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b774e20-f83c-494f-903a-80ab0d32eeb9-ovn-node-metrics-cert\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.236432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17def5f2-9bfc-48aa-aed8-9029fb09d8cb-agent-certs\") pod \"konnectivity-agent-xz527\" (UID: \"17def5f2-9bfc-48aa-aed8-9029fb09d8cb\") " pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.238612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.237208 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f125d5bf-4492-409a-8984-89d873b151bd-tmp\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.244623 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.244540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flpg7\" (UniqueName: \"kubernetes.io/projected/0b774e20-f83c-494f-903a-80ab0d32eeb9-kube-api-access-flpg7\") pod \"ovnkube-node-nb2gq\" (UID: \"0b774e20-f83c-494f-903a-80ab0d32eeb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.245291 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.245241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2mfk\" (UniqueName: \"kubernetes.io/projected/d45ee1f7-41f3-4275-b546-954dbdbb2af1-kube-api-access-l2mfk\") pod \"multus-additional-cni-plugins-cknh7\" (UID: \"d45ee1f7-41f3-4275-b546-954dbdbb2af1\") " pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.245396 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.245357 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4v5t\" (UniqueName: \"kubernetes.io/projected/4c36e9be-0b69-41d4-ac7d-ad9f2b86b385-kube-api-access-m4v5t\") pod \"aws-ebs-csi-driver-node-95vm7\" (UID: \"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.245396 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.245372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfcxv\" (UniqueName: \"kubernetes.io/projected/243e0a04-0fb5-4cab-b57f-d27a5c4c52cb-kube-api-access-kfcxv\") pod \"node-ca-kl7vv\" (UID: \"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb\") " pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.245734 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.245710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd969\" (UniqueName: \"kubernetes.io/projected/2e5e884f-73ea-48fc-951c-537d741857b6-kube-api-access-vd969\") pod \"node-resolver-jq7wc\" (UID: \"2e5e884f-73ea-48fc-951c-537d741857b6\") " pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.245881 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.245852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k5lz\" (UniqueName: \"kubernetes.io/projected/f125d5bf-4492-409a-8984-89d873b151bd-kube-api-access-2k5lz\") pod \"tuned-rtrr8\" (UID: \"f125d5bf-4492-409a-8984-89d873b151bd\") " pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.246265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.246244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7bxr\" (UniqueName: \"kubernetes.io/projected/08290e24-8fb4-4e32-bd5a-6b51ecf7ad49-kube-api-access-m7bxr\") pod \"multus-mq2z5\" (UID: \"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49\") " pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.336039 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.336039 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snt5j\" (UniqueName: \"kubernetes.io/projected/4bb63b58-a475-4a33-9dce-5252f70f5b92-kube-api-access-snt5j\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.336270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-iptables-alerter-script\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.336270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-host-slash\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.336270 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.336197 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:09.336270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:09.336270 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.336268 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:09.836245709 +0000 UTC m=+3.110072751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:09.336538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tcx4\" (UniqueName: \"kubernetes.io/projected/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-kube-api-access-2tcx4\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.336538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-host-slash\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.336662 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.336645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-iptables-alerter-script\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.344630 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.344598 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:09.344630 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.344626 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:09.344630 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.344640 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:09.344886 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.344725 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:09.844705013 +0000 UTC m=+3.118532041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:09.347397 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.347365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tcx4\" (UniqueName: \"kubernetes.io/projected/1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8-kube-api-access-2tcx4\") pod \"iptables-alerter-jxchx\" (UID: \"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8\") " pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.347534 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.347512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snt5j\" (UniqueName: \"kubernetes.io/projected/4bb63b58-a475-4a33-9dce-5252f70f5b92-kube-api-access-snt5j\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.414391 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.414313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mq2z5" Jun 11 15:32:09.421947 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.421912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:09.430678 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.430638 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" Jun 11 15:32:09.436703 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.436675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" Jun 11 15:32:09.442714 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.442687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kl7vv" Jun 11 15:32:09.450149 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.450109 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cknh7" Jun 11 15:32:09.456297 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.456270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:09.462852 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.462825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jq7wc" Jun 11 15:32:09.469921 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.469891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxchx" Jun 11 15:32:09.567628 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.567590 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:32:09.738764 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.738684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:09.738929 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.738807 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:09.738929 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.738873 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:32:10.738859552 +0000 UTC m=+4.012686571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:09.839882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.839851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:09.840070 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.840029 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:09.840151 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.840112 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:10.840091009 +0000 UTC m=+4.113918032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:09.940727 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:09.940687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:09.941268 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.941246 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:09.941268 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.941270 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:09.941405 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.941282 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:09.941405 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:09.941339 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:10.941324694 +0000 UTC m=+4.215151726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:09.990179 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:09.990146 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf125d5bf_4492_409a_8984_89d873b151bd.slice/crio-84aeb7d6187d130302cd6f54b221b5be7862564a87c13a68b761436278d157ae WatchSource:0}: Error finding container 84aeb7d6187d130302cd6f54b221b5be7862564a87c13a68b761436278d157ae: Status 404 returned error can't find the container with id 84aeb7d6187d130302cd6f54b221b5be7862564a87c13a68b761436278d157ae Jun 11 15:32:09.991661 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:09.991566 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45ee1f7_41f3_4275_b546_954dbdbb2af1.slice/crio-b2580cab2157430135ea3c154091c81464177a5d47b07b17f07664122e3f0412 WatchSource:0}: Error finding container b2580cab2157430135ea3c154091c81464177a5d47b07b17f07664122e3f0412: Status 404 returned error can't find the container with id b2580cab2157430135ea3c154091c81464177a5d47b07b17f07664122e3f0412 Jun 11 15:32:09.992508 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:09.992487 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17def5f2_9bfc_48aa_aed8_9029fb09d8cb.slice/crio-4e5445cb0d7090d06d88c2bf4dfbe928a98dae685261b7ac395b0222ce8652fc WatchSource:0}: Error finding container 4e5445cb0d7090d06d88c2bf4dfbe928a98dae685261b7ac395b0222ce8652fc: Status 404 returned error can't find the container with id 4e5445cb0d7090d06d88c2bf4dfbe928a98dae685261b7ac395b0222ce8652fc Jun 11 15:32:09.994635 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:09.994472 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5e884f_73ea_48fc_951c_537d741857b6.slice/crio-e7b80002b77e5b5f6288ac5ab2b675413a7651658ca64d3bdf4b71e5fd27ab67 WatchSource:0}: Error finding container e7b80002b77e5b5f6288ac5ab2b675413a7651658ca64d3bdf4b71e5fd27ab67: Status 404 returned error can't find the container with id e7b80002b77e5b5f6288ac5ab2b675413a7651658ca64d3bdf4b71e5fd27ab67 Jun 11 15:32:09.997906 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:09.997890 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b774e20_f83c_494f_903a_80ab0d32eeb9.slice/crio-52019d91f4cc3f39ee6177aa676d6db931d54cc92c3af6b2499802fe9395370a WatchSource:0}: Error finding container 52019d91f4cc3f39ee6177aa676d6db931d54cc92c3af6b2499802fe9395370a: Status 404 returned error can't find the container with id 52019d91f4cc3f39ee6177aa676d6db931d54cc92c3af6b2499802fe9395370a Jun 11 15:32:09.999317 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:09.999293 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243e0a04_0fb5_4cab_b57f_d27a5c4c52cb.slice/crio-b9878f820542ab5aaf140da4fc7853fbbb0ede2c56f6a4c6c8ffa2e3d8b8df01 WatchSource:0}: Error finding container b9878f820542ab5aaf140da4fc7853fbbb0ede2c56f6a4c6c8ffa2e3d8b8df01: Status 404 returned error can't find the container with id b9878f820542ab5aaf140da4fc7853fbbb0ede2c56f6a4c6c8ffa2e3d8b8df01 Jun 11 15:32:10.000064 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:10.000041 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c36e9be_0b69_41d4_ac7d_ad9f2b86b385.slice/crio-f44d6b9f988b6e1b8e2a8fbcb317c8b1525a39d9ae3c352b214a8f0639a3131f WatchSource:0}: Error finding container f44d6b9f988b6e1b8e2a8fbcb317c8b1525a39d9ae3c352b214a8f0639a3131f: Status 404 returned error can't find the container with id f44d6b9f988b6e1b8e2a8fbcb317c8b1525a39d9ae3c352b214a8f0639a3131f Jun 11 15:32:10.001366 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:10.001164 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca7f7c7_1dc8_4ddf_bb77_4173d4420fb8.slice/crio-5beefc5f93a42d3ebc87e1ff3444dadb8653b324693b01ae9806eea5f85ab721 WatchSource:0}: Error finding container 5beefc5f93a42d3ebc87e1ff3444dadb8653b324693b01ae9806eea5f85ab721: Status 404 returned error can't find the container with id 5beefc5f93a42d3ebc87e1ff3444dadb8653b324693b01ae9806eea5f85ab721 Jun 11 15:32:10.005574 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:10.002903 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08290e24_8fb4_4e32_bd5a_6b51ecf7ad49.slice/crio-a69aad4ab4e68b776bf1d28e3c94852c67e61d3bf6975f7b03465b0fdf2fa885 WatchSource:0}: Error finding container a69aad4ab4e68b776bf1d28e3c94852c67e61d3bf6975f7b03465b0fdf2fa885: Status 404 returned error can't find the container with id a69aad4ab4e68b776bf1d28e3c94852c67e61d3bf6975f7b03465b0fdf2fa885 Jun 11 15:32:10.161180 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.161101 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:27:09 +0000 UTC" deadline="2027-11-15 11:59:41.105193764 +0000 UTC" Jun 11 15:32:10.161180 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.161173 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12524h27m30.94402454s" Jun 11 15:32:10.189530 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.189495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:10.189691 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.189634 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:10.199241 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.198894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" event={"ID":"c4691f8359481e5266cae197cdb602c5","Type":"ContainerStarted","Data":"e8fb89a9044183fc71045f83f1841eb80cc1d69feb23321e84be021fdc17022b"} Jun 11 15:32:10.200269 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.200236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" event={"ID":"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385","Type":"ContainerStarted","Data":"f44d6b9f988b6e1b8e2a8fbcb317c8b1525a39d9ae3c352b214a8f0639a3131f"} Jun 11 15:32:10.201922 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.201891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"52019d91f4cc3f39ee6177aa676d6db931d54cc92c3af6b2499802fe9395370a"} Jun 11 15:32:10.203313 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.203284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jq7wc" event={"ID":"2e5e884f-73ea-48fc-951c-537d741857b6","Type":"ContainerStarted","Data":"e7b80002b77e5b5f6288ac5ab2b675413a7651658ca64d3bdf4b71e5fd27ab67"} Jun 11 15:32:10.204376 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.204345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mq2z5" event={"ID":"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49","Type":"ContainerStarted","Data":"a69aad4ab4e68b776bf1d28e3c94852c67e61d3bf6975f7b03465b0fdf2fa885"} Jun 11 15:32:10.205868 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.205847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxchx" event={"ID":"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8","Type":"ContainerStarted","Data":"5beefc5f93a42d3ebc87e1ff3444dadb8653b324693b01ae9806eea5f85ab721"} Jun 11 15:32:10.207030 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.207001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kl7vv" event={"ID":"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb","Type":"ContainerStarted","Data":"b9878f820542ab5aaf140da4fc7853fbbb0ede2c56f6a4c6c8ffa2e3d8b8df01"} Jun 11 15:32:10.208237 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.208190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xz527" event={"ID":"17def5f2-9bfc-48aa-aed8-9029fb09d8cb","Type":"ContainerStarted","Data":"4e5445cb0d7090d06d88c2bf4dfbe928a98dae685261b7ac395b0222ce8652fc"} Jun 11 15:32:10.209435 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.209414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerStarted","Data":"b2580cab2157430135ea3c154091c81464177a5d47b07b17f07664122e3f0412"} Jun 11 15:32:10.210877 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.210853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" event={"ID":"f125d5bf-4492-409a-8984-89d873b151bd","Type":"ContainerStarted","Data":"84aeb7d6187d130302cd6f54b221b5be7862564a87c13a68b761436278d157ae"} Jun 11 15:32:10.213266 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.213224 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-9.ec2.internal" podStartSLOduration=2.213212567 podStartE2EDuration="2.213212567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:10.212856847 +0000 UTC m=+3.486683900" watchObservedRunningTime="2026-06-11 15:32:10.213212567 +0000 UTC m=+3.487039607" Jun 11 15:32:10.748471 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.748376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:10.748641 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.748525 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:10.748641 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.748593 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:32:12.748575043 +0000 UTC m=+6.022402077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:10.849319 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.849223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:10.849512 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.849374 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:10.849512 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.849438 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:12.849418944 +0000 UTC m=+6.123245977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:10.950191 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:10.950151 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:10.950378 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.950347 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:10.950378 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.950374 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:10.950478 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.950388 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:10.950478 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:10.950455 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:12.950435231 +0000 UTC m=+6.224262284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:11.162046 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:11.161953 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:27:09 +0000 UTC" deadline="2027-12-02 23:07:53.242722905 +0000 UTC" Jun 11 15:32:11.162046 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:11.161997 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12943h35m42.080730974s" Jun 11 15:32:11.190066 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:11.190039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:11.190279 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:11.190202 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:11.190432 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:11.190411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:11.190537 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:11.190516 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:11.231733 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:11.230995 2576 generic.go:356] "Generic (PLEG): container finished" podID="d761d2d4be781a3e2d274d59106da420" containerID="85f007631bd350687583ef7dd10685394b38a263fbc0a61248d78995ae04ed5f" exitCode=0 Jun 11 15:32:11.231733 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:11.231156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" event={"ID":"d761d2d4be781a3e2d274d59106da420","Type":"ContainerDied","Data":"85f007631bd350687583ef7dd10685394b38a263fbc0a61248d78995ae04ed5f"} Jun 11 15:32:12.189276 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:12.189244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:12.189755 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.189377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:12.257868 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:12.257826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" event={"ID":"d761d2d4be781a3e2d274d59106da420","Type":"ContainerStarted","Data":"7089b71bb4b22fdaf90e190c7f6bc02506a114f1395242cb4e91c4caff4e6b53"} Jun 11 15:32:12.276427 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:12.276363 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-9.ec2.internal" podStartSLOduration=4.276324005 podStartE2EDuration="4.276324005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:12.275144822 +0000 UTC m=+5.548971864" watchObservedRunningTime="2026-06-11 15:32:12.276324005 +0000 UTC m=+5.550151047" Jun 11 15:32:12.768249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:12.767673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:12.768249 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.767820 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:12.768249 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.767890 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:32:16.767870883 +0000 UTC m=+10.041697923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:12.869053 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:12.868421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:12.869053 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.868612 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:12.869053 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.868680 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:16.86866068 +0000 UTC m=+10.142487704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:12.970533 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:12.969827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:12.970533 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.970003 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:12.970533 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.970026 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:12.970533 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.970039 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:12.970533 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:12.970099 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:16.970080123 +0000 UTC m=+10.243907165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:13.189472 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:13.188841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:13.189472 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:13.188994 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:13.189472 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:13.189227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:13.189472 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:13.189363 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:14.188997 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:14.188956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:14.189250 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:14.189108 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:15.189659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:15.189624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:15.190133 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:15.189635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:15.190133 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:15.189780 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:15.190133 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:15.189871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:16.189407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:16.189365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:16.189589 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:16.189518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:16.802542 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:16.802498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:16.803063 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:16.802699 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:16.803063 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:16.802798 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:32:24.802768432 +0000 UTC m=+18.076595474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:16.903732 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:16.903683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:16.903929 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:16.903853 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:16.903929 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:16.903918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:24.903900202 +0000 UTC m=+18.177727244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:17.005093 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:17.005053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:17.005284 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:17.005242 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:17.005284 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:17.005269 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:17.005284 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:17.005283 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:17.005490 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:17.005352 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:25.0053319 +0000 UTC m=+18.279158946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:17.190587 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:17.189940 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:17.190587 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:17.190068 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:17.190587 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:17.190448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:17.190587 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:17.190541 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:18.189571 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:18.189418 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:18.190026 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:18.189561 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:19.190141 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:19.190098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:19.190604 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:19.190116 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:19.190604 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:19.190251 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:19.190604 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:19.190355 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:20.189225 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:20.189188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:20.189363 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:20.189334 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:21.189622 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:21.189587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:21.190261 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:21.189589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:21.190261 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:21.189710 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:21.190261 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:21.189799 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:22.189391 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:22.189358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:22.189568 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:22.189489 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:23.189386 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:23.189344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:23.189835 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:23.189493 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:23.189835 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:23.189551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:23.189835 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:23.189674 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:24.189736 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:24.189656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:24.190114 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:24.189772 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:24.867012 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:24.866969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:24.867223 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:24.867159 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:24.867285 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:24.867243 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:32:40.867221275 +0000 UTC m=+34.141048299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:24.968239 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:24.968201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:24.968420 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:24.968354 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:24.968489 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:24.968435 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:40.96841361 +0000 UTC m=+34.242240648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:25.069557 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:25.069511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:25.069743 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:25.069698 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:25.069743 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:25.069728 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:25.069743 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:25.069741 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:25.069877 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:25.069799 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:41.069784284 +0000 UTC m=+34.343611323 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:25.189017 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:25.188931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:25.189210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:25.188939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:25.189210 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:25.189094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:25.189210 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:25.189158 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:26.189533 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:26.189499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:26.189946 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:26.189640 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:27.189821 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:27.189788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:27.190504 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:27.189865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:27.190504 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:27.190417 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:27.191553 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:27.191514 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:28.189756 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:28.189718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:28.189923 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:28.189830 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:29.189931 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.189750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:29.190435 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:29.190063 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:29.190435 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.189830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:29.190542 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:29.190499 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:29.294312 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.294280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jq7wc" event={"ID":"2e5e884f-73ea-48fc-951c-537d741857b6","Type":"ContainerStarted","Data":"f7b9145f3a1b1710ee4c71e785077994497860ff902888375d74875173dcf28b"} Jun 11 15:32:29.295739 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.295709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mq2z5" event={"ID":"08290e24-8fb4-4e32-bd5a-6b51ecf7ad49","Type":"ContainerStarted","Data":"4c26d1196f041d20a4f4a6d2e3f757b1663a3e396c942c576ff71737180bad6e"} Jun 11 15:32:29.297207 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.297180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kl7vv" event={"ID":"243e0a04-0fb5-4cab-b57f-d27a5c4c52cb","Type":"ContainerStarted","Data":"4cd32fe9a9e4b4ec1a47a0066e3d0ae7ea3308e96bafa9cbc110c61132f94d1b"} Jun 11 15:32:29.298584 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.298563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xz527" event={"ID":"17def5f2-9bfc-48aa-aed8-9029fb09d8cb","Type":"ContainerStarted","Data":"9f46194f042500e94c716802169964935a657d0b2be50f06420e44ee513589aa"} Jun 11 15:32:29.300052 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.300023 2576 generic.go:356] "Generic (PLEG): container finished" podID="d45ee1f7-41f3-4275-b546-954dbdbb2af1" containerID="4ebcb487e0046bdf0525d7cbed491c307008535c50285c555b5af96e423f6ca8" exitCode=0 Jun 11 15:32:29.300162 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.300115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerDied","Data":"4ebcb487e0046bdf0525d7cbed491c307008535c50285c555b5af96e423f6ca8"} Jun 11 15:32:29.302727 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.302657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" event={"ID":"f125d5bf-4492-409a-8984-89d873b151bd","Type":"ContainerStarted","Data":"724089b81b0106106ebac0620f291431c2df9f49e0e7471a622cab4201203bb0"} Jun 11 15:32:29.304546 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.304525 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" event={"ID":"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385","Type":"ContainerStarted","Data":"cb8cda8c21606f5fbcdf03f508f9a923e0dda12e6983275f8d81c17e41c23a7e"} Jun 11 15:32:29.306584 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.306567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:32:29.306907 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.306888 2576 generic.go:356] "Generic (PLEG): container finished" podID="0b774e20-f83c-494f-903a-80ab0d32eeb9" containerID="0b6084052b9fb609339ed261a4b72287ccb9f4e12a4ccf11de4eb1876917c707" exitCode=1 Jun 11 15:32:29.307009 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.306916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"f3e6385515c304febf43ffe53353f68a12d367877beb890bad489d4afc6fb05f"} Jun 11 15:32:29.307009 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.306957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"376e22947504442b8dcf02833071d9e20ce563a1b29f0463c2256c04ee1505a0"} Jun 11 15:32:29.307009 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.306989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerDied","Data":"0b6084052b9fb609339ed261a4b72287ccb9f4e12a4ccf11de4eb1876917c707"} Jun 11 15:32:29.307107 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.307018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"5b2e7eacbfb2e40274206e0fcc2191cd8650e46c27b2ca1cf43b876f9f67a63b"} Jun 11 15:32:29.310136 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.310085 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jq7wc" podStartSLOduration=3.779087352 podStartE2EDuration="22.310074414s" totalImagesPullingTime="18.530987062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:29.309497784 +0000 UTC m=+22.583324825" watchObservedRunningTime="2026-06-11 15:32:29.310074414 +0000 UTC m=+22.583901454" Jun 11 15:32:29.323707 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.323646 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kl7vv" podStartSLOduration=3.794840679 podStartE2EDuration="22.323627955s" totalImagesPullingTime="18.528787276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:29.323521603 +0000 UTC m=+22.597348664" watchObservedRunningTime="2026-06-11 15:32:29.323627955 +0000 UTC m=+22.597454996" Jun 11 15:32:29.384000 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.383949 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xz527" podStartSLOduration=8.505047985000001 podStartE2EDuration="22.383935674s" totalImagesPullingTime="13.878887689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:29.366460404 +0000 UTC m=+22.640287445" watchObservedRunningTime="2026-06-11 15:32:29.383935674 +0000 UTC m=+22.657762714" Jun 11 15:32:29.384274 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.384249 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mq2z5" podStartSLOduration=3.846990561 podStartE2EDuration="22.384241641s" totalImagesPullingTime="18.53725108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:29.383625982 +0000 UTC m=+22.657453029" watchObservedRunningTime="2026-06-11 15:32:29.384241641 +0000 UTC m=+22.658068683" Jun 11 15:32:29.402947 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.402752 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rtrr8" podStartSLOduration=3.866059901 podStartE2EDuration="22.402737322s" totalImagesPullingTime="18.536677421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:29.402407404 +0000 UTC m=+22.676234446" watchObservedRunningTime="2026-06-11 15:32:29.402737322 +0000 UTC m=+22.676564363" Jun 11 15:32:29.505786 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.505757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:29.506277 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.506260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:29.923895 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:29.923869 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 15:32:30.187455 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.187350 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T15:32:29.923891237Z","UUID":"29148e36-bb88-4d77-95a2-f3afe4424746","Handler":null,"Name":"","Endpoint":""} Jun 11 15:32:30.188834 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.188806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:30.188955 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:30.188934 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:30.189339 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.189316 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 15:32:30.189466 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.189360 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 15:32:30.311111 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.310931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxchx" event={"ID":"1ca7f7c7-1dc8-4ddf-bb77-4173d4420fb8","Type":"ContainerStarted","Data":"695ad29d571ee4e12f5adfcefbb7c5f8e707fc71886569e86f1ebb8340d8bfe3"} Jun 11 15:32:30.313270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.313239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" event={"ID":"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385","Type":"ContainerStarted","Data":"7eb0a24222d5d353d21783a435e4c8ecfc1e37d34da6b225aa212255b582d8b6"} Jun 11 15:32:30.316338 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.316317 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:32:30.316760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.316682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"8bd574163fc5c4edd3960397213158b07a354c7d08aba16d1490be1c08458f8f"} Jun 11 15:32:30.316862 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.316785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"ee5af121170bda1b1762e45e10a66cef5e53b301b029128efb9f984f4b57d514"} Jun 11 15:32:30.317064 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.317008 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:30.317478 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.317455 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xz527" Jun 11 15:32:30.327481 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:30.327431 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jxchx" podStartSLOduration=4.805979131 podStartE2EDuration="23.327417671s" totalImagesPullingTime="18.52143854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:30.32683671 +0000 UTC m=+23.600663753" watchObservedRunningTime="2026-06-11 15:32:30.327417671 +0000 UTC m=+23.601244711" Jun 11 15:32:31.190285 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:31.190180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:31.190415 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:31.190322 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:31.190831 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:31.190810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:31.190937 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:31.190908 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:31.321261 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:31.321169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" event={"ID":"4c36e9be-0b69-41d4-ac7d-ad9f2b86b385","Type":"ContainerStarted","Data":"b601aa55ee7ac1df0db3f184c295a5f593e831b8d6921ed4ed23ab3655033b4d"} Jun 11 15:32:31.339814 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:31.339765 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-95vm7" podStartSLOduration=3.625281973 podStartE2EDuration="24.339749726s" totalImagesPullingTime="20.714467753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:31.339297185 +0000 UTC m=+24.613124225" watchObservedRunningTime="2026-06-11 15:32:31.339749726 +0000 UTC m=+24.613576767" Jun 11 15:32:32.189210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:32.189176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:32.189396 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:32.189303 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:33.189191 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:33.189152 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:33.189191 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:33.189191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:33.189873 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:33.189293 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:33.189873 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:33.189398 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:33.329675 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:33.329656 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:32:33.330085 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:33.330051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"eeafb51cb4f178702b9ef0be19e3fe3e9534912789b6d02f389c528bcfe05037"} Jun 11 15:32:34.189085 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:34.188863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:34.189303 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:34.189189 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:34.334076 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:34.334039 2576 generic.go:356] "Generic (PLEG): container finished" podID="d45ee1f7-41f3-4275-b546-954dbdbb2af1" containerID="1493f615bdb731197703bb30028884620902d4cd6856f39ea071c33b24cf2b5e" exitCode=0 Jun 11 15:32:34.334626 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:34.334098 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerDied","Data":"1493f615bdb731197703bb30028884620902d4cd6856f39ea071c33b24cf2b5e"} Jun 11 15:32:35.189246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:35.189194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:35.189246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:35.189235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:35.189672 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:35.189336 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:35.189672 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:35.189447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:35.338646 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:35.338612 2576 generic.go:356] "Generic (PLEG): container finished" podID="d45ee1f7-41f3-4275-b546-954dbdbb2af1" containerID="78790cebb1a4fdec7763d582e1f297b9be092483415c90f3e3e3ae57881ab12d" exitCode=0 Jun 11 15:32:35.338772 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:35.338659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerDied","Data":"78790cebb1a4fdec7763d582e1f297b9be092483415c90f3e3e3ae57881ab12d"} Jun 11 15:32:36.189391 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.189296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:36.189802 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:36.189404 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:36.342540 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.342506 2576 generic.go:356] "Generic (PLEG): container finished" podID="d45ee1f7-41f3-4275-b546-954dbdbb2af1" containerID="677f6cb58e099633b8d6707572e893f9b2803461dd6bdd0ce53c432ab2878d40" exitCode=0 Jun 11 15:32:36.342695 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.342601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerDied","Data":"677f6cb58e099633b8d6707572e893f9b2803461dd6bdd0ce53c432ab2878d40"} Jun 11 15:32:36.346226 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.346208 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:32:36.346566 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.346543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"6c78cdc78de2359ad8f421f9dcf0d4b7e072db81fe2d7a44c5f5516f3c2ad20f"} Jun 11 15:32:36.346786 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.346762 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:36.346937 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.346921 2576 scope.go:117] "RemoveContainer" containerID="0b6084052b9fb609339ed261a4b72287ccb9f4e12a4ccf11de4eb1876917c707" Jun 11 15:32:36.362275 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:36.362257 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:37.190616 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.190417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:37.191139 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.190448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:37.191139 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:37.190695 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:37.191139 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:37.190803 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:37.311887 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.311854 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tnznf"] Jun 11 15:32:37.312058 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.311992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:37.312142 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:37.312096 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:37.316332 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.316298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcpbt"] Jun 11 15:32:37.319503 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.319478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d6g69"] Jun 11 15:32:37.355402 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.355375 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:32:37.356509 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.356481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:37.356707 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.356678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" event={"ID":"0b774e20-f83c-494f-903a-80ab0d32eeb9","Type":"ContainerStarted","Data":"211b894b9f7f32ef0d44acc7f4fed5aae654d7dc030df33ebd6cd74ae8eafc60"} Jun 11 15:32:37.356707 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.356704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:37.356853 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:37.356813 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:37.356905 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:37.356602 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:37.357745 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.357659 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:37.357745 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.357736 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:37.377007 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.376978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:32:37.397781 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:37.397725 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" podStartSLOduration=11.816233606 podStartE2EDuration="30.397708164s" totalImagesPullingTime="18.581474558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:37.396581822 +0000 UTC m=+30.670408864" watchObservedRunningTime="2026-06-11 15:32:37.397708164 +0000 UTC m=+30.671535205" Jun 11 15:32:39.189813 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:39.189781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:39.189813 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:39.189796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:39.189813 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:39.189799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:39.190483 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:39.189916 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:39.190483 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:39.190004 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:39.190483 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:39.190098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:40.886400 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:40.886359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:40.886858 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:40.886487 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:40.886858 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:40.886547 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret podName:44135148-b091-45e2-8932-9944572694fc nodeName:}" failed. No retries permitted until 2026-06-11 15:33:12.886529899 +0000 UTC m=+66.160356933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret") pod "global-pull-secret-syncer-tnznf" (UID: "44135148-b091-45e2-8932-9944572694fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:32:40.986877 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:40.986835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:40.987080 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:40.986995 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:40.987080 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:40.987066 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:33:12.987043586 +0000 UTC m=+66.260870622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:32:41.087795 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:41.087754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:41.087966 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.087948 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:32:41.088024 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.087972 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:32:41.088024 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.087983 2576 projected.go:196] Error preparing data for projected volume kube-api-access-97ts4 for pod openshift-network-diagnostics/network-check-target-d6g69: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:41.088107 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.088045 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4 podName:1db5f1fa-9579-4946-a0eb-6ead3ea3ead2 nodeName:}" failed. No retries permitted until 2026-06-11 15:33:13.088026887 +0000 UTC m=+66.361853925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-97ts4" (UniqueName: "kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4") pod "network-check-target-d6g69" (UID: "1db5f1fa-9579-4946-a0eb-6ead3ea3ead2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:32:41.189384 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:41.189298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:41.189552 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:41.189295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:41.189552 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.189439 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnznf" podUID="44135148-b091-45e2-8932-9944572694fc" Jun 11 15:32:41.189552 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:41.189295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:41.189732 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.189541 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:32:41.189732 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:41.189638 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d6g69" podUID="1db5f1fa-9579-4946-a0eb-6ead3ea3ead2" Jun 11 15:32:42.019202 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.019162 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-9.ec2.internal" event="NodeReady" Jun 11 15:32:42.019670 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.019338 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 15:32:42.064943 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.064881 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qcf5d"] Jun 11 15:32:42.088580 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.088555 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ddgqw"] Jun 11 15:32:42.088739 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.088696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.091600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.091455 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 15:32:42.091722 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.091497 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hkw9v\"" Jun 11 15:32:42.091851 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.091839 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 15:32:42.111048 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.111026 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qcf5d"] Jun 11 15:32:42.111177 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.111059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ddgqw"] Jun 11 15:32:42.111177 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.111156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.113724 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.113704 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 15:32:42.113831 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.113814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 15:32:42.113831 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.113826 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9mxvs\"" Jun 11 15:32:42.113956 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.113846 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 15:32:42.195394 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.195367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be4b80f1-c3eb-4257-a28c-b88b077548b5-cert\") pod \"ingress-canary-ddgqw\" (UID: \"be4b80f1-c3eb-4257-a28c-b88b077548b5\") " pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.195561 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.195405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/999b4fd9-e079-4e6c-a09c-849907af5324-tmp-dir\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.195561 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.195436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/999b4fd9-e079-4e6c-a09c-849907af5324-config-volume\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.195561 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.195521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgjnj\" (UniqueName: \"kubernetes.io/projected/999b4fd9-e079-4e6c-a09c-849907af5324-kube-api-access-vgjnj\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.195718 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.195586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.195718 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.195621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shzcv\" (UniqueName: \"kubernetes.io/projected/be4b80f1-c3eb-4257-a28c-b88b077548b5-kube-api-access-shzcv\") pod \"ingress-canary-ddgqw\" (UID: \"be4b80f1-c3eb-4257-a28c-b88b077548b5\") " pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.296700 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.296622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/999b4fd9-e079-4e6c-a09c-849907af5324-tmp-dir\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.296700 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.296666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/999b4fd9-e079-4e6c-a09c-849907af5324-config-volume\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.296700 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.296694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgjnj\" (UniqueName: \"kubernetes.io/projected/999b4fd9-e079-4e6c-a09c-849907af5324-kube-api-access-vgjnj\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.296957 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.296894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.296957 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.296927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shzcv\" (UniqueName: \"kubernetes.io/projected/be4b80f1-c3eb-4257-a28c-b88b077548b5-kube-api-access-shzcv\") pod \"ingress-canary-ddgqw\" (UID: \"be4b80f1-c3eb-4257-a28c-b88b077548b5\") " pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.297061 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.297003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/999b4fd9-e079-4e6c-a09c-849907af5324-tmp-dir\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.297061 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:42.297027 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:32:42.297192 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.297058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be4b80f1-c3eb-4257-a28c-b88b077548b5-cert\") pod \"ingress-canary-ddgqw\" (UID: \"be4b80f1-c3eb-4257-a28c-b88b077548b5\") " pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.297192 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:42.297094 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:42.797073436 +0000 UTC m=+36.070900471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:32:42.297419 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.297398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/999b4fd9-e079-4e6c-a09c-849907af5324-config-volume\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.301068 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.301050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be4b80f1-c3eb-4257-a28c-b88b077548b5-cert\") pod \"ingress-canary-ddgqw\" (UID: \"be4b80f1-c3eb-4257-a28c-b88b077548b5\") " pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.305673 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.305652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgjnj\" (UniqueName: \"kubernetes.io/projected/999b4fd9-e079-4e6c-a09c-849907af5324-kube-api-access-vgjnj\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.306061 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.306046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shzcv\" (UniqueName: \"kubernetes.io/projected/be4b80f1-c3eb-4257-a28c-b88b077548b5-kube-api-access-shzcv\") pod \"ingress-canary-ddgqw\" (UID: \"be4b80f1-c3eb-4257-a28c-b88b077548b5\") " pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.418745 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.418715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ddgqw" Jun 11 15:32:42.648253 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.648225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ddgqw"] Jun 11 15:32:42.652889 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:32:42.652864 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4b80f1_c3eb_4257_a28c_b88b077548b5.slice/crio-946ed63aaf1a624ec4afed22723be00ee0bd249c1cbb3df58d57a68b0a30186c WatchSource:0}: Error finding container 946ed63aaf1a624ec4afed22723be00ee0bd249c1cbb3df58d57a68b0a30186c: Status 404 returned error can't find the container with id 946ed63aaf1a624ec4afed22723be00ee0bd249c1cbb3df58d57a68b0a30186c Jun 11 15:32:42.801945 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:42.801865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:42.802084 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:42.802024 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:32:42.802152 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:42.802094 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:43.802077889 +0000 UTC m=+37.075904911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:32:43.189342 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.189303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:32:43.189921 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.189303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:32:43.189921 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.189408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:32:43.192850 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.192818 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:32:43.192975 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.192862 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:32:43.194373 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.194102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:32:43.194373 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.194194 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4mx2h\"" Jun 11 15:32:43.194373 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.194202 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kztnl\"" Jun 11 15:32:43.194373 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.194202 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:32:43.375301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.375267 2576 generic.go:356] "Generic (PLEG): container finished" podID="d45ee1f7-41f3-4275-b546-954dbdbb2af1" containerID="f53b35914f79739bd0ce586ae1253f0b5b858ee82b111021fa6042cfc5d3f8ab" exitCode=0 Jun 11 15:32:43.375470 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.375346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerDied","Data":"f53b35914f79739bd0ce586ae1253f0b5b858ee82b111021fa6042cfc5d3f8ab"} Jun 11 15:32:43.376592 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.376564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ddgqw" event={"ID":"be4b80f1-c3eb-4257-a28c-b88b077548b5","Type":"ContainerStarted","Data":"946ed63aaf1a624ec4afed22723be00ee0bd249c1cbb3df58d57a68b0a30186c"} Jun 11 15:32:43.809446 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:43.809229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:43.809446 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:43.809396 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:32:43.809605 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:43.809458 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:45.809443154 +0000 UTC m=+39.083270173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:32:44.383191 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:44.383147 2576 generic.go:356] "Generic (PLEG): container finished" podID="d45ee1f7-41f3-4275-b546-954dbdbb2af1" containerID="d6cf61964ad6b8d93fd8d4f2aaa10cacabce2c2a9d550df23626d807a39ec9aa" exitCode=0 Jun 11 15:32:44.383679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:44.383218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerDied","Data":"d6cf61964ad6b8d93fd8d4f2aaa10cacabce2c2a9d550df23626d807a39ec9aa"} Jun 11 15:32:45.387406 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:45.387367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ddgqw" event={"ID":"be4b80f1-c3eb-4257-a28c-b88b077548b5","Type":"ContainerStarted","Data":"031f9e23de201754f7499b83f4330d4abeb0c728a526e1dc1b60ca1b3394ce0c"} Jun 11 15:32:45.390686 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:45.390660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cknh7" event={"ID":"d45ee1f7-41f3-4275-b546-954dbdbb2af1","Type":"ContainerStarted","Data":"96bb493c821ac6e7004eb3c0fc0ad64ea26e4a32edd851819dd3701ccc5c7c89"} Jun 11 15:32:45.403761 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:45.403715 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ddgqw" podStartSLOduration=1.361234209 podStartE2EDuration="3.403699077s" totalImagesPullingTime="2.042464868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:45.403330002 +0000 UTC m=+38.677157043" watchObservedRunningTime="2026-06-11 15:32:45.403699077 +0000 UTC m=+38.677526118" Jun 11 15:32:45.425587 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:45.425543 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cknh7" podStartSLOduration=8.479439831 podStartE2EDuration="38.425529129s" totalImagesPullingTime="29.946089298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:32:45.424617818 +0000 UTC m=+38.698444858" watchObservedRunningTime="2026-06-11 15:32:45.425529129 +0000 UTC m=+38.699356169" Jun 11 15:32:45.825102 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:45.825017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:45.825276 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:45.825192 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:32:45.825276 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:45.825265 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:49.825245317 +0000 UTC m=+43.099072357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:32:49.853780 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:49.853742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:49.854275 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:49.853865 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:32:49.854275 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:49.853918 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:32:57.853904536 +0000 UTC m=+51.127731555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:32:57.912934 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:32:57.912895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:32:57.913498 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:57.913023 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:32:57.913498 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:32:57.913090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:33:13.913074838 +0000 UTC m=+67.186901857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:33:09.372161 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:09.372115 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nb2gq" Jun 11 15:33:12.917518 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:12.917472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:33:12.920923 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:12.920905 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:33:12.931308 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:12.931279 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44135148-b091-45e2-8932-9944572694fc-original-pull-secret\") pod \"global-pull-secret-syncer-tnznf\" (UID: \"44135148-b091-45e2-8932-9944572694fc\") " pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:33:13.018273 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.018239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:33:13.021104 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.021085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:33:13.028620 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:33:13.028601 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:33:13.028675 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:33:13.028667 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:34:17.028650314 +0000 UTC m=+130.302477333 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : secret "metrics-daemon-secret" not found Jun 11 15:33:13.118683 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.118648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:33:13.121760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.121743 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:33:13.131827 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.131813 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:33:13.142166 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.142137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97ts4\" (UniqueName: \"kubernetes.io/projected/1db5f1fa-9579-4946-a0eb-6ead3ea3ead2-kube-api-access-97ts4\") pod \"network-check-target-d6g69\" (UID: \"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2\") " pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:33:13.201244 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.201177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnznf" Jun 11 15:33:13.211575 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.211556 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kztnl\"" Jun 11 15:33:13.219078 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.219060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:33:13.393601 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.393572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tnznf"] Jun 11 15:33:13.416619 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.416595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d6g69"] Jun 11 15:33:13.419636 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:33:13.419611 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db5f1fa_9579_4946_a0eb_6ead3ea3ead2.slice/crio-f43f7f285bede7b0c55345964bcabe459edec7ec0a078c98a2672c2d05dcfdf1 WatchSource:0}: Error finding container f43f7f285bede7b0c55345964bcabe459edec7ec0a078c98a2672c2d05dcfdf1: Status 404 returned error can't find the container with id f43f7f285bede7b0c55345964bcabe459edec7ec0a078c98a2672c2d05dcfdf1 Jun 11 15:33:13.457289 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.457199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d6g69" event={"ID":"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2","Type":"ContainerStarted","Data":"f43f7f285bede7b0c55345964bcabe459edec7ec0a078c98a2672c2d05dcfdf1"} Jun 11 15:33:13.458262 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.458238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tnznf" event={"ID":"44135148-b091-45e2-8932-9944572694fc","Type":"ContainerStarted","Data":"377d6b7272f2facfc966f8aaadc0e1a19982fc244b505dfe2732faefef4e7196"} Jun 11 15:33:13.923508 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:13.923469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:33:13.923850 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:33:13.923639 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:33:13.923850 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:33:13.923705 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:33:45.923689313 +0000 UTC m=+99.197516333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:33:17.472526 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:17.472463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d6g69" event={"ID":"1db5f1fa-9579-4946-a0eb-6ead3ea3ead2","Type":"ContainerStarted","Data":"1942556fda9fb9dae19093b825b87ae84a2a81ead84d10c8cea7ace88da8b044"} Jun 11 15:33:17.473021 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:17.472610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:33:17.493399 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:17.493328 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d6g69" podStartSLOduration=67.420355685 podStartE2EDuration="1m10.493311729s" totalImagesPullingTime="3.072956044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:33:17.491555645 +0000 UTC m=+70.765382689" watchObservedRunningTime="2026-06-11 15:33:17.493311729 +0000 UTC m=+70.767138770" Jun 11 15:33:18.476497 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:18.476463 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tnznf" event={"ID":"44135148-b091-45e2-8932-9944572694fc","Type":"ContainerStarted","Data":"84c68118cc1f2b7460e39bc9e5f770b40145bfbeb4a546a40238bef9c1a0a396"} Jun 11 15:33:18.492327 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:18.492275 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tnznf" podStartSLOduration=66.825790082 podStartE2EDuration="1m11.492252715s" totalImagesPullingTime="4.666462633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:33:18.492084479 +0000 UTC m=+71.765911520" watchObservedRunningTime="2026-06-11 15:33:18.492252715 +0000 UTC m=+71.766079756" Jun 11 15:33:45.935217 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:45.935074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:33:45.935671 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:33:45.935236 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:33:45.935671 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:33:45.935318 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:34:49.935301291 +0000 UTC m=+163.209128311 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:33:48.479675 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:33:48.479647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d6g69" Jun 11 15:34:17.040383 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:34:17.040338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:34:17.040866 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:34:17.040511 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:34:17.040866 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:34:17.040598 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs podName:4bb63b58-a475-4a33-9dce-5252f70f5b92 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:19.040577166 +0000 UTC m=+252.314404191 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs") pod "network-metrics-daemon-bcpbt" (UID: "4bb63b58-a475-4a33-9dce-5252f70f5b92") : secret "metrics-daemon-secret" not found Jun 11 15:34:45.097767 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:34:45.097721 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qcf5d" podUID="999b4fd9-e079-4e6c-a09c-849907af5324" Jun 11 15:34:45.685745 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:34:45.685710 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcf5d" Jun 11 15:34:46.214511 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:34:46.214453 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bcpbt" podUID="4bb63b58-a475-4a33-9dce-5252f70f5b92" Jun 11 15:34:49.966460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:34:49.966375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:34:49.966838 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:34:49.966528 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:34:49.966838 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:34:49.966598 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls podName:999b4fd9-e079-4e6c-a09c-849907af5324 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:51.966577888 +0000 UTC m=+285.240404924 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls") pod "dns-default-qcf5d" (UID: "999b4fd9-e079-4e6c-a09c-849907af5324") : secret "dns-default-metrics-tls" not found Jun 11 15:34:59.189095 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:34:59.189058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:35:58.871726 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.871694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n"] Jun 11 15:35:58.873965 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.873935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:58.875683 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.875658 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk"] Jun 11 15:35:58.878026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.878007 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-dvqqf"] Jun 11 15:35:58.878167 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.878149 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:58.879724 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.879703 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6cd5cd6bd5-v99b2"] Jun 11 15:35:58.879823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.879722 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kprvz\"" Jun 11 15:35:58.879883 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.879821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:58.880176 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.880051 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 15:35:58.881665 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.881651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:58.888152 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.888133 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 15:35:58.888279 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.888265 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 15:35:58.891576 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.891561 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 15:35:58.893630 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.893613 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:35:58.903296 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.903278 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 15:35:58.904718 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.904702 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:35:58.905465 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vf6lh\"" Jun 11 15:35:58.905588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:35:58.905588 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 15:35:58.905704 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:35:58.905803 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:35:58.905923 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905906 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 15:35:58.905994 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.905980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 15:35:58.906709 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.906690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 15:35:58.906849 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.906719 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n"] Jun 11 15:35:58.906997 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.906980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 15:35:58.907093 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.907011 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 15:35:58.907093 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.907015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:35:58.907224 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.907097 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mf48n\"" Jun 11 15:35:58.907611 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.907591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk"] Jun 11 15:35:58.920038 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.920021 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-477vd\"" Jun 11 15:35:58.921390 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.921371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cd5cd6bd5-v99b2"] Jun 11 15:35:58.922003 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.921987 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-dvqqf"] Jun 11 15:35:58.926080 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.926060 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 15:35:58.948095 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:58.948193 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64e9743-6147-481d-b65f-88e9de035c7c-tmp\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:58.948193 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d64e9743-6147-481d-b65f-88e9de035c7c-serving-cert\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:58.948193 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64e9743-6147-481d-b65f-88e9de035c7c-trusted-ca-bundle\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:58.948193 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/797c23b6-1b05-48af-8835-78a3b0e43b66-config\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:58.948319 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkfvp\" (UniqueName: \"kubernetes.io/projected/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-kube-api-access-jkfvp\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:58.948319 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:58.948319 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb4mz\" (UniqueName: \"kubernetes.io/projected/797c23b6-1b05-48af-8835-78a3b0e43b66-kube-api-access-bb4mz\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:58.948407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:58.948407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/797c23b6-1b05-48af-8835-78a3b0e43b66-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:58.948407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64e9743-6147-481d-b65f-88e9de035c7c-service-ca-bundle\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:58.948407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vj6b\" (UniqueName: \"kubernetes.io/projected/d64e9743-6147-481d-b65f-88e9de035c7c-kube-api-access-2vj6b\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:58.948523 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-default-certificate\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:58.948523 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74ftc\" (UniqueName: \"kubernetes.io/projected/8c46f00c-09d1-4710-acc4-39ddf20e66aa-kube-api-access-74ftc\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:58.948523 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-stats-auth\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:58.948523 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:58.948466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d64e9743-6147-481d-b65f-88e9de035c7c-snapshots\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.015667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.015627 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf"] Jun 11 15:35:59.017934 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.017918 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5"] Jun 11 15:35:59.018059 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.018040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" Jun 11 15:35:59.019609 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.019592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" Jun 11 15:35:59.028283 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.028226 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 15:35:59.028404 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.028381 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8d6lg\"" Jun 11 15:35:59.028492 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.028477 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:35:59.034738 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.034721 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ggrtb\"" Jun 11 15:35:59.041862 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.041838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5"] Jun 11 15:35:59.042529 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.042513 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf"] Jun 11 15:35:59.048935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.048915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkfvp\" (UniqueName: \"kubernetes.io/projected/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-kube-api-access-jkfvp\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.049035 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.048946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.049035 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.048964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb4mz\" (UniqueName: \"kubernetes.io/projected/797c23b6-1b05-48af-8835-78a3b0e43b66-kube-api-access-bb4mz\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.049134 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.049134 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/797c23b6-1b05-48af-8835-78a3b0e43b66-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.049134 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.049097 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:35:59.54907664 +0000 UTC m=+232.822903680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : configmap references non-existent config key: service-ca.crt Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64e9743-6147-481d-b65f-88e9de035c7c-service-ca-bundle\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj6b\" (UniqueName: \"kubernetes.io/projected/d64e9743-6147-481d-b65f-88e9de035c7c-kube-api-access-2vj6b\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-default-certificate\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049262 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74ftc\" (UniqueName: \"kubernetes.io/projected/8c46f00c-09d1-4710-acc4-39ddf20e66aa-kube-api-access-74ftc\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.049284 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-stats-auth\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d64e9743-6147-481d-b65f-88e9de035c7c-snapshots\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.049363 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.049336 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:35:59.549319861 +0000 UTC m=+232.823146885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : secret "router-metrics-certs-default" not found Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64e9743-6147-481d-b65f-88e9de035c7c-tmp\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d64e9743-6147-481d-b65f-88e9de035c7c-serving-cert\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64e9743-6147-481d-b65f-88e9de035c7c-trusted-ca-bundle\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/797c23b6-1b05-48af-8835-78a3b0e43b66-config\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.049681 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:35:59.049760 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.049744 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls podName:8c46f00c-09d1-4710-acc4-39ddf20e66aa nodeName:}" failed. No retries permitted until 2026-06-11 15:35:59.549726412 +0000 UTC m=+232.823553431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n4mtk" (UID: "8c46f00c-09d1-4710-acc4-39ddf20e66aa") : secret "samples-operator-tls" not found Jun 11 15:35:59.050106 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d64e9743-6147-481d-b65f-88e9de035c7c-snapshots\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.050106 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.049988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d64e9743-6147-481d-b65f-88e9de035c7c-tmp\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.050106 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.050027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64e9743-6147-481d-b65f-88e9de035c7c-service-ca-bundle\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.050106 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.050051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/797c23b6-1b05-48af-8835-78a3b0e43b66-config\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.050867 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.050842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d64e9743-6147-481d-b65f-88e9de035c7c-trusted-ca-bundle\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.051605 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.051559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/797c23b6-1b05-48af-8835-78a3b0e43b66-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.052077 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.052048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d64e9743-6147-481d-b65f-88e9de035c7c-serving-cert\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.052428 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.052409 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-stats-auth\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.052582 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.052567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-default-certificate\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.100011 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.099981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb4mz\" (UniqueName: \"kubernetes.io/projected/797c23b6-1b05-48af-8835-78a3b0e43b66-kube-api-access-bb4mz\") pod \"service-ca-operator-6bc5ff68f5-p4c8n\" (UID: \"797c23b6-1b05-48af-8835-78a3b0e43b66\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.105084 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.105013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74ftc\" (UniqueName: \"kubernetes.io/projected/8c46f00c-09d1-4710-acc4-39ddf20e66aa-kube-api-access-74ftc\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:59.105386 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.105362 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkfvp\" (UniqueName: \"kubernetes.io/projected/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-kube-api-access-jkfvp\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.107172 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.107155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vj6b\" (UniqueName: \"kubernetes.io/projected/d64e9743-6147-481d-b65f-88e9de035c7c-kube-api-access-2vj6b\") pod \"insights-operator-896549976-dvqqf\" (UID: \"d64e9743-6147-481d-b65f-88e9de035c7c\") " pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.150916 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.150824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97w2\" (UniqueName: \"kubernetes.io/projected/5568aafd-cf4a-4e1e-b7c6-3d4d324134c3-kube-api-access-l97w2\") pod \"volume-data-source-validator-78dd696465-m4ssf\" (UID: \"5568aafd-cf4a-4e1e-b7c6-3d4d324134c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" Jun 11 15:35:59.150916 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.150877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qflsw\" (UniqueName: \"kubernetes.io/projected/79548775-83b2-4049-a303-323f278788e6-kube-api-access-qflsw\") pod \"network-check-source-dbd9cf844-pm8h5\" (UID: \"79548775-83b2-4049-a303-323f278788e6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" Jun 11 15:35:59.184280 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.184250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" Jun 11 15:35:59.196079 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.196059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-dvqqf" Jun 11 15:35:59.251698 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.251656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97w2\" (UniqueName: \"kubernetes.io/projected/5568aafd-cf4a-4e1e-b7c6-3d4d324134c3-kube-api-access-l97w2\") pod \"volume-data-source-validator-78dd696465-m4ssf\" (UID: \"5568aafd-cf4a-4e1e-b7c6-3d4d324134c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" Jun 11 15:35:59.251820 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.251728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qflsw\" (UniqueName: \"kubernetes.io/projected/79548775-83b2-4049-a303-323f278788e6-kube-api-access-qflsw\") pod \"network-check-source-dbd9cf844-pm8h5\" (UID: \"79548775-83b2-4049-a303-323f278788e6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" Jun 11 15:35:59.270986 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.270917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qflsw\" (UniqueName: \"kubernetes.io/projected/79548775-83b2-4049-a303-323f278788e6-kube-api-access-qflsw\") pod \"network-check-source-dbd9cf844-pm8h5\" (UID: \"79548775-83b2-4049-a303-323f278788e6\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" Jun 11 15:35:59.271378 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.271353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97w2\" (UniqueName: \"kubernetes.io/projected/5568aafd-cf4a-4e1e-b7c6-3d4d324134c3-kube-api-access-l97w2\") pod \"volume-data-source-validator-78dd696465-m4ssf\" (UID: \"5568aafd-cf4a-4e1e-b7c6-3d4d324134c3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" Jun 11 15:35:59.326807 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.326774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" Jun 11 15:35:59.329867 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.329846 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n"] Jun 11 15:35:59.332533 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.332514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" Jun 11 15:35:59.333844 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:35:59.333820 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797c23b6_1b05_48af_8835_78a3b0e43b66.slice/crio-c7e818cad022c477cba0c77a786861a408356f6e1f4ee7790eb38f314b0d7a66 WatchSource:0}: Error finding container c7e818cad022c477cba0c77a786861a408356f6e1f4ee7790eb38f314b0d7a66: Status 404 returned error can't find the container with id c7e818cad022c477cba0c77a786861a408356f6e1f4ee7790eb38f314b0d7a66 Jun 11 15:35:59.348999 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.348973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-dvqqf"] Jun 11 15:35:59.353347 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:35:59.353319 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64e9743_6147_481d_b65f_88e9de035c7c.slice/crio-8ee0828ad184d27bf1abb9ef9179104c22c7a187290067bb877d6b09cd8d3aa4 WatchSource:0}: Error finding container 8ee0828ad184d27bf1abb9ef9179104c22c7a187290067bb877d6b09cd8d3aa4: Status 404 returned error can't find the container with id 8ee0828ad184d27bf1abb9ef9179104c22c7a187290067bb877d6b09cd8d3aa4 Jun 11 15:35:59.467094 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.467059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf"] Jun 11 15:35:59.469765 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:35:59.469742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5568aafd_cf4a_4e1e_b7c6_3d4d324134c3.slice/crio-6b56528c546978812a28856511ec56faea0a701f0bd8096bf17b8727f08e2906 WatchSource:0}: Error finding container 6b56528c546978812a28856511ec56faea0a701f0bd8096bf17b8727f08e2906: Status 404 returned error can't find the container with id 6b56528c546978812a28856511ec56faea0a701f0bd8096bf17b8727f08e2906 Jun 11 15:35:59.488790 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.488767 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5"] Jun 11 15:35:59.491246 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:35:59.491222 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79548775_83b2_4049_a303_323f278788e6.slice/crio-d7bc382967318d8564ac88a101cdc99a1e46b7635e4fcf1d285eab62a5726870 WatchSource:0}: Error finding container d7bc382967318d8564ac88a101cdc99a1e46b7635e4fcf1d285eab62a5726870: Status 404 returned error can't find the container with id d7bc382967318d8564ac88a101cdc99a1e46b7635e4fcf1d285eab62a5726870 Jun 11 15:35:59.553986 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.553960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.554157 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.554005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:35:59.554157 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.554042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:35:59.554280 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.554169 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:00.554144964 +0000 UTC m=+233.827972000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : configmap references non-existent config key: service-ca.crt Jun 11 15:35:59.554280 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.554184 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:35:59.554280 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.554219 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:35:59.554280 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.554234 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls podName:8c46f00c-09d1-4710-acc4-39ddf20e66aa nodeName:}" failed. No retries permitted until 2026-06-11 15:36:00.554218532 +0000 UTC m=+233.828045565 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n4mtk" (UID: "8c46f00c-09d1-4710-acc4-39ddf20e66aa") : secret "samples-operator-tls" not found Jun 11 15:35:59.554280 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:35:59.554273 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:00.554255987 +0000 UTC m=+233.828083023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : secret "router-metrics-certs-default" not found Jun 11 15:35:59.867449 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.867409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" event={"ID":"79548775-83b2-4049-a303-323f278788e6","Type":"ContainerStarted","Data":"33a1b00c47d03d63185fbbdc9821ad001c57e8611380dedf64c642c5f2c3f0e8"} Jun 11 15:35:59.867635 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.867473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" event={"ID":"79548775-83b2-4049-a303-323f278788e6","Type":"ContainerStarted","Data":"d7bc382967318d8564ac88a101cdc99a1e46b7635e4fcf1d285eab62a5726870"} Jun 11 15:35:59.868894 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.868858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvqqf" event={"ID":"d64e9743-6147-481d-b65f-88e9de035c7c","Type":"ContainerStarted","Data":"8ee0828ad184d27bf1abb9ef9179104c22c7a187290067bb877d6b09cd8d3aa4"} Jun 11 15:35:59.870324 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.870299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" event={"ID":"5568aafd-cf4a-4e1e-b7c6-3d4d324134c3","Type":"ContainerStarted","Data":"6b56528c546978812a28856511ec56faea0a701f0bd8096bf17b8727f08e2906"} Jun 11 15:35:59.871703 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.871671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" event={"ID":"797c23b6-1b05-48af-8835-78a3b0e43b66","Type":"ContainerStarted","Data":"c7e818cad022c477cba0c77a786861a408356f6e1f4ee7790eb38f314b0d7a66"} Jun 11 15:35:59.884342 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:35:59.884143 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pm8h5" podStartSLOduration=1.884110217 podStartE2EDuration="1.884110217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:35:59.883399392 +0000 UTC m=+233.157226434" watchObservedRunningTime="2026-06-11 15:35:59.884110217 +0000 UTC m=+233.157937237" Jun 11 15:36:00.563079 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:00.563045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:00.563214 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:00.563102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:00.563214 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:00.563167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:36:00.563407 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:00.563332 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:36:00.563407 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:00.563388 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls podName:8c46f00c-09d1-4710-acc4-39ddf20e66aa nodeName:}" failed. No retries permitted until 2026-06-11 15:36:02.563368474 +0000 UTC m=+235.837195498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n4mtk" (UID: "8c46f00c-09d1-4710-acc4-39ddf20e66aa") : secret "samples-operator-tls" not found Jun 11 15:36:00.563828 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:00.563659 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:36:00.563828 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:00.563717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:02.563700528 +0000 UTC m=+235.837527564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : secret "router-metrics-certs-default" not found Jun 11 15:36:00.563828 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:00.563756 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:02.563740702 +0000 UTC m=+235.837567729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : configmap references non-existent config key: service-ca.crt Jun 11 15:36:00.880205 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:00.880163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" event={"ID":"5568aafd-cf4a-4e1e-b7c6-3d4d324134c3","Type":"ContainerStarted","Data":"88c080250e7a1b32ae1264b378ecf9f5976b168fdcb614e4e4c6066ab2e18006"} Jun 11 15:36:00.896741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:00.896687 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-m4ssf" podStartSLOduration=1.819582813 podStartE2EDuration="2.896669048s" totalImagesPullingTime="1.077086235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:00.896049397 +0000 UTC m=+234.169876440" watchObservedRunningTime="2026-06-11 15:36:00.896669048 +0000 UTC m=+234.170496067" Jun 11 15:36:02.582759 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.582699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.582775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.582820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:02.582869 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:06.582846246 +0000 UTC m=+239.856673269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : configmap references non-existent config key: service-ca.crt Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:02.582924 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:02.582981 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:06.58296587 +0000 UTC m=+239.856792895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : secret "router-metrics-certs-default" not found Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:02.582929 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:36:02.583291 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:02.583022 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls podName:8c46f00c-09d1-4710-acc4-39ddf20e66aa nodeName:}" failed. No retries permitted until 2026-06-11 15:36:06.583012679 +0000 UTC m=+239.856839697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n4mtk" (UID: "8c46f00c-09d1-4710-acc4-39ddf20e66aa") : secret "samples-operator-tls" not found Jun 11 15:36:02.887724 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.887687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" event={"ID":"797c23b6-1b05-48af-8835-78a3b0e43b66","Type":"ContainerStarted","Data":"ff6d01fe9fae8205a4248586578b4621061c8c3cbaf9fc84128aefbc96f72c83"} Jun 11 15:36:02.889284 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.889250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvqqf" event={"ID":"d64e9743-6147-481d-b65f-88e9de035c7c","Type":"ContainerStarted","Data":"543c3371e0d0f501d9ee4501a1c9ce274e632835851aa19b1530451515c5257a"} Jun 11 15:36:02.916696 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.916642 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" podStartSLOduration=2.361888682 podStartE2EDuration="4.916622324s" totalImagesPullingTime="2.554733642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:02.914535507 +0000 UTC m=+236.188362549" watchObservedRunningTime="2026-06-11 15:36:02.916622324 +0000 UTC m=+236.190449357" Jun 11 15:36:02.946656 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:02.946601 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-dvqqf" podStartSLOduration=2.414864794 podStartE2EDuration="4.946579628s" totalImagesPullingTime="2.531714834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:02.945815058 +0000 UTC m=+236.219642099" watchObservedRunningTime="2026-06-11 15:36:02.946579628 +0000 UTC m=+236.220406669" Jun 11 15:36:05.868153 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:05.868106 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jq7wc_2e5e884f-73ea-48fc-951c-537d741857b6/dns-node-resolver/0.log" Jun 11 15:36:06.617662 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:06.617623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:06.617840 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:06.617670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:06.617840 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:06.617701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:36:06.617840 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:06.617808 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:36:06.617947 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:06.617806 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:36:06.617947 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:06.617856 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls podName:8c46f00c-09d1-4710-acc4-39ddf20e66aa nodeName:}" failed. No retries permitted until 2026-06-11 15:36:14.617842335 +0000 UTC m=+247.891669354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-n4mtk" (UID: "8c46f00c-09d1-4710-acc4-39ddf20e66aa") : secret "samples-operator-tls" not found Jun 11 15:36:06.617947 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:06.617922 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:14.617905842 +0000 UTC m=+247.891732864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : configmap references non-existent config key: service-ca.crt Jun 11 15:36:06.617947 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:06.617935 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:14.617928214 +0000 UTC m=+247.891755233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : secret "router-metrics-certs-default" not found Jun 11 15:36:06.866805 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:06.866777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kl7vv_243e0a04-0fb5-4cab-b57f-d27a5c4c52cb/node-ca/0.log" Jun 11 15:36:07.468659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:07.468625 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ddgqw_be4b80f1-c3eb-4257-a28c-b88b077548b5/serve-healthcheck-canary/0.log" Jun 11 15:36:14.684858 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.684819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:36:14.685296 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.684917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:14.685296 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.684955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:14.685296 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:14.685105 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle podName:9ce73f17-2cda-44d4-8452-a7034ec4cdc9 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:30.685080382 +0000 UTC m=+263.958907400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle") pod "router-default-6cd5cd6bd5-v99b2" (UID: "9ce73f17-2cda-44d4-8452-a7034ec4cdc9") : configmap references non-existent config key: service-ca.crt Jun 11 15:36:14.687450 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.687430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c46f00c-09d1-4710-acc4-39ddf20e66aa-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-n4mtk\" (UID: \"8c46f00c-09d1-4710-acc4-39ddf20e66aa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:36:14.687450 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.687444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-metrics-certs\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:14.792872 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.792840 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vf6lh\"" Jun 11 15:36:14.800111 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.800071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" Jun 11 15:36:14.928097 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:14.928063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk"] Jun 11 15:36:15.927140 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:15.927090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" event={"ID":"8c46f00c-09d1-4710-acc4-39ddf20e66aa","Type":"ContainerStarted","Data":"a2fc791ba2a3e6798a9caa38b5a2bec4a904920eda0654d91c718754d55748bc"} Jun 11 15:36:17.935440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:17.935404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" event={"ID":"8c46f00c-09d1-4710-acc4-39ddf20e66aa","Type":"ContainerStarted","Data":"9e66c786d2ccfb61acb9eb2632e854dc1316fba2cfbdc12d13f22bcdf3d11b8a"} Jun 11 15:36:17.935917 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:17.935458 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" event={"ID":"8c46f00c-09d1-4710-acc4-39ddf20e66aa","Type":"ContainerStarted","Data":"a96647acea3adea2b4994209c2439571e030a578fe5b22b0b2ab79b338fcd4b4"} Jun 11 15:36:17.954383 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:17.954328 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-n4mtk" podStartSLOduration=17.763983836 podStartE2EDuration="19.954314067s" totalImagesPullingTime="2.190330231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:17.95289931 +0000 UTC m=+251.226726353" watchObservedRunningTime="2026-06-11 15:36:17.954314067 +0000 UTC m=+251.228141108" Jun 11 15:36:19.116618 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:19.116568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:36:19.118804 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:19.118781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bb63b58-a475-4a33-9dce-5252f70f5b92-metrics-certs\") pod \"network-metrics-daemon-bcpbt\" (UID: \"4bb63b58-a475-4a33-9dce-5252f70f5b92\") " pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:36:19.292874 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:19.292842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4mx2h\"" Jun 11 15:36:19.300270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:19.300252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bcpbt" Jun 11 15:36:19.424304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:19.424269 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bcpbt"] Jun 11 15:36:19.427103 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:19.427076 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb63b58_a475_4a33_9dce_5252f70f5b92.slice/crio-6cc3cbcd9acfe60aa24952cbce0a5d1fe16cc9ae5305783a1c0e1f6e6bef8005 WatchSource:0}: Error finding container 6cc3cbcd9acfe60aa24952cbce0a5d1fe16cc9ae5305783a1c0e1f6e6bef8005: Status 404 returned error can't find the container with id 6cc3cbcd9acfe60aa24952cbce0a5d1fe16cc9ae5305783a1c0e1f6e6bef8005 Jun 11 15:36:19.943191 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:19.943155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcpbt" event={"ID":"4bb63b58-a475-4a33-9dce-5252f70f5b92","Type":"ContainerStarted","Data":"6cc3cbcd9acfe60aa24952cbce0a5d1fe16cc9ae5305783a1c0e1f6e6bef8005"} Jun 11 15:36:20.950996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:20.950961 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcpbt" event={"ID":"4bb63b58-a475-4a33-9dce-5252f70f5b92","Type":"ContainerStarted","Data":"fb8610c5aa6fd85b44ad0dc438fb8f01ced8bd0fcccb71100d4a0ef72b2de7fe"} Jun 11 15:36:20.951484 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:20.951047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bcpbt" event={"ID":"4bb63b58-a475-4a33-9dce-5252f70f5b92","Type":"ContainerStarted","Data":"d0beb67d6e00bd48da9cd7790b7d18f2907e4becedbfe05300f0767f5c0f9c4a"} Jun 11 15:36:28.760140 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.760073 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bcpbt" podStartSLOduration=260.901770517 podStartE2EDuration="4m21.760054226s" totalImagesPullingTime="858.283709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:20.968180654 +0000 UTC m=+254.242007694" watchObservedRunningTime="2026-06-11 15:36:28.760054226 +0000 UTC m=+262.033881267" Jun 11 15:36:28.760724 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.760707 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2fkkq"] Jun 11 15:36:28.763554 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.763538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.767471 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.767442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 15:36:28.767471 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.767460 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 15:36:28.767638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.767461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k8v8g\"" Jun 11 15:36:28.776706 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.776672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2fkkq"] Jun 11 15:36:28.779938 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.779915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b05e87b-bd7c-4687-874b-f3ddc0197682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.780049 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.779977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826t9\" (UniqueName: \"kubernetes.io/projected/8b05e87b-bd7c-4687-874b-f3ddc0197682-kube-api-access-826t9\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.780089 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.780049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b05e87b-bd7c-4687-874b-f3ddc0197682-data-volume\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.780141 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.780094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b05e87b-bd7c-4687-874b-f3ddc0197682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.780141 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.780133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b05e87b-bd7c-4687-874b-f3ddc0197682-crio-socket\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.847935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.847893 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5546969db-cckh5"] Jun 11 15:36:28.849759 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.849744 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.853216 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.853188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 15:36:28.853337 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.853321 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 15:36:28.853606 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.853592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 15:36:28.853800 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.853781 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-knxzw\"" Jun 11 15:36:28.860778 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.860756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 15:36:28.872108 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.872079 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5546969db-cckh5"] Jun 11 15:36:28.881296 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-registry-certificates\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881415 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-installation-pull-secrets\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881415 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-registry-tls\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826t9\" (UniqueName: \"kubernetes.io/projected/8b05e87b-bd7c-4687-874b-f3ddc0197682-kube-api-access-826t9\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.881538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-image-registry-private-configuration\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b05e87b-bd7c-4687-874b-f3ddc0197682-data-volume\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.881679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b05e87b-bd7c-4687-874b-f3ddc0197682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.881679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-bound-sa-token\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b05e87b-bd7c-4687-874b-f3ddc0197682-crio-socket\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.881679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-trusted-ca\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-ca-trust-extracted\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881854 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdfh\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-kube-api-access-ftdfh\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.881854 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b05e87b-bd7c-4687-874b-f3ddc0197682-crio-socket\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.881854 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b05e87b-bd7c-4687-874b-f3ddc0197682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.881948 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.881914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b05e87b-bd7c-4687-874b-f3ddc0197682-data-volume\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.882101 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.882084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b05e87b-bd7c-4687-874b-f3ddc0197682-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.883982 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.883967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b05e87b-bd7c-4687-874b-f3ddc0197682-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.900999 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.900968 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-826t9\" (UniqueName: \"kubernetes.io/projected/8b05e87b-bd7c-4687-874b-f3ddc0197682-kube-api-access-826t9\") pod \"insights-runtime-extractor-2fkkq\" (UID: \"8b05e87b-bd7c-4687-874b-f3ddc0197682\") " pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:28.982388 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-bound-sa-token\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-trusted-ca\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-ca-trust-extracted\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdfh\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-kube-api-access-ftdfh\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-registry-certificates\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-installation-pull-secrets\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-registry-tls\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982930 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-image-registry-private-configuration\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.982930 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.982834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-ca-trust-extracted\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.983420 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.983389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-registry-certificates\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.983629 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.983609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-trusted-ca\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.985293 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.985271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-image-registry-private-configuration\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.985469 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.985451 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-registry-tls\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.985567 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.985545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-installation-pull-secrets\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.997772 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.997752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-bound-sa-token\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:28.999326 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:28.999301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdfh\" (UniqueName: \"kubernetes.io/projected/385e7e94-e0d4-4dba-a8f3-2c4c7fa82518-kube-api-access-ftdfh\") pod \"image-registry-5546969db-cckh5\" (UID: \"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518\") " pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:29.076166 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.076067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2fkkq" Jun 11 15:36:29.158655 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.158624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:29.208770 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.208736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2fkkq"] Jun 11 15:36:29.212827 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:29.212793 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b05e87b_bd7c_4687_874b_f3ddc0197682.slice/crio-7f30739e85189c04038af4d2fbfddc9dc8fe04a833b16775e633dc4892c17f1b WatchSource:0}: Error finding container 7f30739e85189c04038af4d2fbfddc9dc8fe04a833b16775e633dc4892c17f1b: Status 404 returned error can't find the container with id 7f30739e85189c04038af4d2fbfddc9dc8fe04a833b16775e633dc4892c17f1b Jun 11 15:36:29.295311 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.295284 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5546969db-cckh5"] Jun 11 15:36:29.297925 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:29.297901 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385e7e94_e0d4_4dba_a8f3_2c4c7fa82518.slice/crio-c15740c4d50f8a11e337ee9b08c4fa0ef234df89e3832c8891f7f9fa4e87c468 WatchSource:0}: Error finding container c15740c4d50f8a11e337ee9b08c4fa0ef234df89e3832c8891f7f9fa4e87c468: Status 404 returned error can't find the container with id c15740c4d50f8a11e337ee9b08c4fa0ef234df89e3832c8891f7f9fa4e87c468 Jun 11 15:36:29.982016 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.981981 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5546969db-cckh5" event={"ID":"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518","Type":"ContainerStarted","Data":"244fba87e47a5fb0f695c9166aa269e49c16fb56ba1771e9198267082620cbbc"} Jun 11 15:36:29.982512 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.982039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5546969db-cckh5" event={"ID":"385e7e94-e0d4-4dba-a8f3-2c4c7fa82518","Type":"ContainerStarted","Data":"c15740c4d50f8a11e337ee9b08c4fa0ef234df89e3832c8891f7f9fa4e87c468"} Jun 11 15:36:29.982512 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.982067 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:36:29.983720 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.983698 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fkkq" event={"ID":"8b05e87b-bd7c-4687-874b-f3ddc0197682","Type":"ContainerStarted","Data":"58236033ad122d1845805aabb69ca26fe43589f6bf2e3342e61f729fa375a506"} Jun 11 15:36:29.983836 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.983740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fkkq" event={"ID":"8b05e87b-bd7c-4687-874b-f3ddc0197682","Type":"ContainerStarted","Data":"5a2dfda89443a1280bf3227506de5382c392778f7c7128cc3570b632f06a27ac"} Jun 11 15:36:29.983836 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:29.983757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fkkq" event={"ID":"8b05e87b-bd7c-4687-874b-f3ddc0197682","Type":"ContainerStarted","Data":"7f30739e85189c04038af4d2fbfddc9dc8fe04a833b16775e633dc4892c17f1b"} Jun 11 15:36:30.003033 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:30.002947 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5546969db-cckh5" podStartSLOduration=2.002925913 podStartE2EDuration="2.002925913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:30.002362631 +0000 UTC m=+263.276189673" watchObservedRunningTime="2026-06-11 15:36:30.002925913 +0000 UTC m=+263.276752955" Jun 11 15:36:30.696650 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:30.696617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:30.697240 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:30.697215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ce73f17-2cda-44d4-8452-a7034ec4cdc9-service-ca-bundle\") pod \"router-default-6cd5cd6bd5-v99b2\" (UID: \"9ce73f17-2cda-44d4-8452-a7034ec4cdc9\") " pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:30.703764 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:30.703735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-477vd\"" Jun 11 15:36:30.711207 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:30.711178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:31.264521 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:31.264491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6cd5cd6bd5-v99b2"] Jun 11 15:36:31.267721 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:31.267697 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce73f17_2cda_44d4_8452_a7034ec4cdc9.slice/crio-26579b2b0ea7f44c9a28c0a5dee65d2147f339d6ae7d64b8d62a680e5f518f2b WatchSource:0}: Error finding container 26579b2b0ea7f44c9a28c0a5dee65d2147f339d6ae7d64b8d62a680e5f518f2b: Status 404 returned error can't find the container with id 26579b2b0ea7f44c9a28c0a5dee65d2147f339d6ae7d64b8d62a680e5f518f2b Jun 11 15:36:31.993310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:31.993278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fkkq" event={"ID":"8b05e87b-bd7c-4687-874b-f3ddc0197682","Type":"ContainerStarted","Data":"d6ac1eb7e2e513ca9ef38bad4af3490cee2001c29956a9f9071bc17319dfc140"} Jun 11 15:36:31.994732 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:31.994707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" event={"ID":"9ce73f17-2cda-44d4-8452-a7034ec4cdc9","Type":"ContainerStarted","Data":"c506126f9df8740fe3c68a16b5371ece194855fec22a038f482da727e66c7e89"} Jun 11 15:36:31.994863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:31.994744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" event={"ID":"9ce73f17-2cda-44d4-8452-a7034ec4cdc9","Type":"ContainerStarted","Data":"26579b2b0ea7f44c9a28c0a5dee65d2147f339d6ae7d64b8d62a680e5f518f2b"} Jun 11 15:36:32.012787 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:32.012734 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2fkkq" podStartSLOduration=2.187308117 podStartE2EDuration="4.012716417s" totalImagesPullingTime="1.8254083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:36:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:32.011863831 +0000 UTC m=+265.285690874" watchObservedRunningTime="2026-06-11 15:36:32.012716417 +0000 UTC m=+265.286543461" Jun 11 15:36:32.031463 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:32.031413 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" podStartSLOduration=34.03139151 podStartE2EDuration="34.03139151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:32.030990819 +0000 UTC m=+265.304817861" watchObservedRunningTime="2026-06-11 15:36:32.03139151 +0000 UTC m=+265.305218551" Jun 11 15:36:32.711400 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:32.711363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:32.713989 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:32.713967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:32.998258 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:32.998179 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:32.999364 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:32.999345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6cd5cd6bd5-v99b2" Jun 11 15:36:34.138195 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.138151 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk"] Jun 11 15:36:34.140302 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.140286 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:34.143782 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.143755 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 15:36:34.143883 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.143798 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-j47vl\"" Jun 11 15:36:34.153270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.153243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk"] Jun 11 15:36:34.227727 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.227688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-h27lk\" (UID: \"b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:34.328066 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.328031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-h27lk\" (UID: \"b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:34.330512 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.330482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-h27lk\" (UID: \"b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:34.448697 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.448592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:34.580542 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:34.580511 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk"] Jun 11 15:36:34.585569 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:34.585537 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70c8fd1_f869_4a12_bbc1_ad996a2ec1d6.slice/crio-2dc8ab0ee5511b0e67bbf32d72e06b4990d980b52d8decbb66b20440c6045869 WatchSource:0}: Error finding container 2dc8ab0ee5511b0e67bbf32d72e06b4990d980b52d8decbb66b20440c6045869: Status 404 returned error can't find the container with id 2dc8ab0ee5511b0e67bbf32d72e06b4990d980b52d8decbb66b20440c6045869 Jun 11 15:36:35.005136 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:35.005086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" event={"ID":"b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6","Type":"ContainerStarted","Data":"2dc8ab0ee5511b0e67bbf32d72e06b4990d980b52d8decbb66b20440c6045869"} Jun 11 15:36:36.009419 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.009379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" event={"ID":"b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6","Type":"ContainerStarted","Data":"175e0eb618ae3f4c92a57c693fb5ce74d92bf27935eca1ba3fb24d031ad6163b"} Jun 11 15:36:36.009854 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.009539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:36.014359 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.014335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" Jun 11 15:36:36.026848 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.026808 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-h27lk" podStartSLOduration=1.038722246 podStartE2EDuration="2.026793309s" totalImagesPullingTime="988.071063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:36.026547112 +0000 UTC m=+269.300374164" watchObservedRunningTime="2026-06-11 15:36:36.026793309 +0000 UTC m=+269.300620328" Jun 11 15:36:36.199799 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.199765 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5"] Jun 11 15:36:36.215943 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.215908 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5"] Jun 11 15:36:36.216078 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.216019 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.219746 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.219722 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 15:36:36.219896 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.219852 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:36:36.220215 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.220192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b62lr\"" Jun 11 15:36:36.220330 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.220253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:36:36.220330 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.220266 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 15:36:36.220443 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.220361 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:36:36.249784 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.249745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8bbl\" (UniqueName: \"kubernetes.io/projected/a6299d3f-a3f3-4efa-9871-b517ae46d983-kube-api-access-d8bbl\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.249784 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.249788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6299d3f-a3f3-4efa-9871-b517ae46d983-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.249987 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.249878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.249987 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.249909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.350469 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.350442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8bbl\" (UniqueName: \"kubernetes.io/projected/a6299d3f-a3f3-4efa-9871-b517ae46d983-kube-api-access-d8bbl\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.350646 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.350484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6299d3f-a3f3-4efa-9871-b517ae46d983-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.350646 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.350556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.350646 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.350582 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.350800 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:36.350729 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 15:36:36.350800 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:36.350798 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-tls podName:a6299d3f-a3f3-4efa-9871-b517ae46d983 nodeName:}" failed. No retries permitted until 2026-06-11 15:36:36.85077714 +0000 UTC m=+270.124604173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-7qkk5" (UID: "a6299d3f-a3f3-4efa-9871-b517ae46d983") : secret "prometheus-operator-tls" not found Jun 11 15:36:36.351225 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.351205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a6299d3f-a3f3-4efa-9871-b517ae46d983-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.352926 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.352909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.361794 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.361771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8bbl\" (UniqueName: \"kubernetes.io/projected/a6299d3f-a3f3-4efa-9871-b517ae46d983-kube-api-access-d8bbl\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.854340 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.854304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:36.856786 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:36.856760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a6299d3f-a3f3-4efa-9871-b517ae46d983-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-7qkk5\" (UID: \"a6299d3f-a3f3-4efa-9871-b517ae46d983\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:37.126010 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:37.125922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" Jun 11 15:36:37.261355 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:37.261315 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5"] Jun 11 15:36:37.264075 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:37.264046 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6299d3f_a3f3_4efa_9871_b517ae46d983.slice/crio-340b30152d2f533e78af44cd19778a24145ba438d7e05670d3ff360f3a48d813 WatchSource:0}: Error finding container 340b30152d2f533e78af44cd19778a24145ba438d7e05670d3ff360f3a48d813: Status 404 returned error can't find the container with id 340b30152d2f533e78af44cd19778a24145ba438d7e05670d3ff360f3a48d813 Jun 11 15:36:38.017744 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:38.017708 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" event={"ID":"a6299d3f-a3f3-4efa-9871-b517ae46d983","Type":"ContainerStarted","Data":"340b30152d2f533e78af44cd19778a24145ba438d7e05670d3ff360f3a48d813"} Jun 11 15:36:39.023426 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:39.023391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" event={"ID":"a6299d3f-a3f3-4efa-9871-b517ae46d983","Type":"ContainerStarted","Data":"c74f97da05de0935ef72c2e03019bcdebed9710098e8c77a08e3f19fe6ba17f0"} Jun 11 15:36:39.023807 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:39.023444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" event={"ID":"a6299d3f-a3f3-4efa-9871-b517ae46d983","Type":"ContainerStarted","Data":"da878415cf948e11a97c96e7107b0cd4d8e2bf3570b32f92dde58658d80ee225"} Jun 11 15:36:39.048502 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:39.048449 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-7qkk5" podStartSLOduration=1.9528385990000001 podStartE2EDuration="3.04843565s" totalImagesPullingTime="1.095597051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:39.047715515 +0000 UTC m=+272.321542557" watchObservedRunningTime="2026-06-11 15:36:39.04843565 +0000 UTC m=+272.322262690" Jun 11 15:36:40.568883 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.568848 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hd8tb"] Jun 11 15:36:40.572326 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.572310 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.575456 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.575434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6prd4\"" Jun 11 15:36:40.575631 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.575606 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:36:40.575746 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.575731 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:36:40.576419 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.576404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:36:40.685073 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-textfile\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685073 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-sys\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685300 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wlfw\" (UniqueName: \"kubernetes.io/projected/bd3959eb-d674-414e-89e3-36ace97d390e-kube-api-access-5wlfw\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685300 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-wtmp\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685300 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685300 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-tls\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685421 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd3959eb-d674-414e-89e3-36ace97d390e-metrics-client-ca\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685421 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.685421 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.685358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-root\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786673 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786673 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-tls\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd3959eb-d674-414e-89e3-36ace97d390e-metrics-client-ca\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-root\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-textfile\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-sys\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:40.786816 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-root\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.786913 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:40.786911 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-tls podName:bd3959eb-d674-414e-89e3-36ace97d390e nodeName:}" failed. No retries permitted until 2026-06-11 15:36:41.286882547 +0000 UTC m=+274.560709571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-tls") pod "node-exporter-hd8tb" (UID: "bd3959eb-d674-414e-89e3-36ace97d390e") : secret "node-exporter-tls" not found Jun 11 15:36:40.787304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-sys\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.787304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wlfw\" (UniqueName: \"kubernetes.io/projected/bd3959eb-d674-414e-89e3-36ace97d390e-kube-api-access-5wlfw\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.787304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.786978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-wtmp\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.787304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.787198 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-wtmp\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.787440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.787344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-textfile\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.787440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.787402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd3959eb-d674-414e-89e3-36ace97d390e-metrics-client-ca\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.787440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.787402 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.789176 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.789159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:40.797905 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:40.797878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wlfw\" (UniqueName: \"kubernetes.io/projected/bd3959eb-d674-414e-89e3-36ace97d390e-kube-api-access-5wlfw\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:41.291908 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:41.291869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-tls\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:41.294219 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:41.294200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bd3959eb-d674-414e-89e3-36ace97d390e-node-exporter-tls\") pod \"node-exporter-hd8tb\" (UID: \"bd3959eb-d674-414e-89e3-36ace97d390e\") " pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:41.480633 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:41.480603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hd8tb" Jun 11 15:36:41.494231 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:41.494198 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3959eb_d674_414e_89e3_36ace97d390e.slice/crio-9b366f928a5100b8bef579244cafddd81c376f1c8c3d7f4277b6e60db9516322 WatchSource:0}: Error finding container 9b366f928a5100b8bef579244cafddd81c376f1c8c3d7f4277b6e60db9516322: Status 404 returned error can't find the container with id 9b366f928a5100b8bef579244cafddd81c376f1c8c3d7f4277b6e60db9516322 Jun 11 15:36:42.035740 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.035692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd8tb" event={"ID":"bd3959eb-d674-414e-89e3-36ace97d390e","Type":"ContainerStarted","Data":"9b366f928a5100b8bef579244cafddd81c376f1c8c3d7f4277b6e60db9516322"} Jun 11 15:36:42.522255 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.522219 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd"] Jun 11 15:36:42.524748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.524733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.529098 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.529074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-j8rkm\"" Jun 11 15:36:42.529235 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.529143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 15:36:42.529360 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.529342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-nv2kr99j9v85\"" Jun 11 15:36:42.529456 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.529441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 15:36:42.529802 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.529787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 15:36:42.529971 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.529958 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 15:36:42.530419 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.530406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 15:36:42.542747 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.542722 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd"] Jun 11 15:36:42.604531 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-tls\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604531 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604531 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-grpc-tls\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-metrics-client-ca\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.604823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.604741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmmpx\" (UniqueName: \"kubernetes.io/projected/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-kube-api-access-qmmpx\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.705892 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.705853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-tls\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.705892 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.705895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706145 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.705913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-grpc-tls\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706145 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.705941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706145 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.706060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706145 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.706095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-metrics-client-ca\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706145 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.706139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706362 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.706163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmmpx\" (UniqueName: \"kubernetes.io/projected/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-kube-api-access-qmmpx\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.706982 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.706951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-metrics-client-ca\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.708696 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.708650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.708788 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.708765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-grpc-tls\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.708865 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.708845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.708919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.708898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-tls\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.709251 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.709237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.709377 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.709359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.715222 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.715205 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmmpx\" (UniqueName: \"kubernetes.io/projected/82cd1d2f-eef4-4432-bc2f-4187ad3139cf-kube-api-access-qmmpx\") pod \"thanos-querier-59bc5b66f7-l5pdd\" (UID: \"82cd1d2f-eef4-4432-bc2f-4187ad3139cf\") " pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.855456 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.855354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:42.992062 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:42.992010 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd"] Jun 11 15:36:42.994587 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:42.994555 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cd1d2f_eef4_4432_bc2f_4187ad3139cf.slice/crio-2b1d18154961cfd67fd0f99fe33348e1a1876c03dea8a4a27417d7fc17f5efbf WatchSource:0}: Error finding container 2b1d18154961cfd67fd0f99fe33348e1a1876c03dea8a4a27417d7fc17f5efbf: Status 404 returned error can't find the container with id 2b1d18154961cfd67fd0f99fe33348e1a1876c03dea8a4a27417d7fc17f5efbf Jun 11 15:36:43.042751 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:43.042711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"2b1d18154961cfd67fd0f99fe33348e1a1876c03dea8a4a27417d7fc17f5efbf"} Jun 11 15:36:43.044208 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:43.044184 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd3959eb-d674-414e-89e3-36ace97d390e" containerID="dd8d22d25473721df1b244c66ecf41d2f746e2f527d7d16cbb2edf0ab1182892" exitCode=0 Jun 11 15:36:43.044335 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:43.044228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd8tb" event={"ID":"bd3959eb-d674-414e-89e3-36ace97d390e","Type":"ContainerDied","Data":"dd8d22d25473721df1b244c66ecf41d2f746e2f527d7d16cbb2edf0ab1182892"} Jun 11 15:36:44.050559 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.050519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd8tb" event={"ID":"bd3959eb-d674-414e-89e3-36ace97d390e","Type":"ContainerStarted","Data":"a68f12d90707852ec693a47182d561858f80fa6db5d4f84c4d8ff77920e1539d"} Jun 11 15:36:44.051042 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.050582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hd8tb" event={"ID":"bd3959eb-d674-414e-89e3-36ace97d390e","Type":"ContainerStarted","Data":"28db9f28e547c008c4f5400cc9d31a237b7397302f6966994d493bd04924f521"} Jun 11 15:36:44.072905 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.072844 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hd8tb" podStartSLOduration=3.152637464 podStartE2EDuration="4.072821945s" totalImagesPullingTime="853.077892ms" totalInitContainerRuntime="67.106589ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:44.071180134 +0000 UTC m=+277.345007176" watchObservedRunningTime="2026-06-11 15:36:44.072821945 +0000 UTC m=+277.346648989" Jun 11 15:36:44.884269 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.884230 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d6f4f997b-t8mqf"] Jun 11 15:36:44.886862 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.886838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:44.891181 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.890814 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:36:44.891181 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.890871 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 15:36:44.891181 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.890876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6habtot8e1q6c\"" Jun 11 15:36:44.891181 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.890894 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tk7n2\"" Jun 11 15:36:44.891181 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.890981 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 15:36:44.891443 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.891238 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 15:36:44.898508 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:44.898483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d6f4f997b-t8mqf"] Jun 11 15:36:45.027112 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e1492e-5cbc-430d-9b08-f7849c09ec17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.027230 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-secret-metrics-server-client-certs\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.027230 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38e1492e-5cbc-430d-9b08-f7849c09ec17-metrics-server-audit-profiles\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.027230 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smts\" (UniqueName: \"kubernetes.io/projected/38e1492e-5cbc-430d-9b08-f7849c09ec17-kube-api-access-4smts\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.027336 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-client-ca-bundle\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.027336 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38e1492e-5cbc-430d-9b08-f7849c09ec17-audit-log\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.027417 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.027398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-secret-metrics-server-tls\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.055730 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.055706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"fdedea9e2e3a9a9aade6a7539690d958ab8a55adfccdf9d8b90d0dfc3366cddc"} Jun 11 15:36:45.128425 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-secret-metrics-server-tls\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.128597 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e1492e-5cbc-430d-9b08-f7849c09ec17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.128792 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-secret-metrics-server-client-certs\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.128885 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38e1492e-5cbc-430d-9b08-f7849c09ec17-metrics-server-audit-profiles\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.128885 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smts\" (UniqueName: \"kubernetes.io/projected/38e1492e-5cbc-430d-9b08-f7849c09ec17-kube-api-access-4smts\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.128996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-client-ca-bundle\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.128996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.128934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38e1492e-5cbc-430d-9b08-f7849c09ec17-audit-log\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.129404 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.129346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38e1492e-5cbc-430d-9b08-f7849c09ec17-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.129518 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.129401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38e1492e-5cbc-430d-9b08-f7849c09ec17-audit-log\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.130270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.130244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38e1492e-5cbc-430d-9b08-f7849c09ec17-metrics-server-audit-profiles\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.131907 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.131884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-client-ca-bundle\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.132013 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.131884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-secret-metrics-server-tls\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.132065 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.132049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38e1492e-5cbc-430d-9b08-f7849c09ec17-secret-metrics-server-client-certs\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.136498 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.136452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smts\" (UniqueName: \"kubernetes.io/projected/38e1492e-5cbc-430d-9b08-f7849c09ec17-kube-api-access-4smts\") pod \"metrics-server-7d6f4f997b-t8mqf\" (UID: \"38e1492e-5cbc-430d-9b08-f7849c09ec17\") " pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.199669 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.199639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:36:45.299759 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.298335 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-87tc6"] Jun 11 15:36:45.304515 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.304486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.307493 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.307254 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 15:36:45.309103 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.308431 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dpdpm\"" Jun 11 15:36:45.310809 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.310710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-87tc6"] Jun 11 15:36:45.345192 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.345161 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d6f4f997b-t8mqf"] Jun 11 15:36:45.348050 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:45.348026 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e1492e_5cbc_430d_9b08_f7849c09ec17.slice/crio-a2545f4e15117e414ed37563d80b35c618c850968c6cf47b43cd0fee439e82f7 WatchSource:0}: Error finding container a2545f4e15117e414ed37563d80b35c618c850968c6cf47b43cd0fee439e82f7: Status 404 returned error can't find the container with id a2545f4e15117e414ed37563d80b35c618c850968c6cf47b43cd0fee439e82f7 Jun 11 15:36:45.431246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.431155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d4br\" (UniqueName: \"kubernetes.io/projected/59cfd4f5-bce8-4e36-aa4e-be08150ce21f-kube-api-access-4d4br\") pod \"monitoring-plugin-76b68cc874-87tc6\" (UID: \"59cfd4f5-bce8-4e36-aa4e-be08150ce21f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.431246 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.431220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59cfd4f5-bce8-4e36-aa4e-be08150ce21f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-87tc6\" (UID: \"59cfd4f5-bce8-4e36-aa4e-be08150ce21f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.532228 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.532194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d4br\" (UniqueName: \"kubernetes.io/projected/59cfd4f5-bce8-4e36-aa4e-be08150ce21f-kube-api-access-4d4br\") pod \"monitoring-plugin-76b68cc874-87tc6\" (UID: \"59cfd4f5-bce8-4e36-aa4e-be08150ce21f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.532394 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.532248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59cfd4f5-bce8-4e36-aa4e-be08150ce21f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-87tc6\" (UID: \"59cfd4f5-bce8-4e36-aa4e-be08150ce21f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.534657 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.534633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59cfd4f5-bce8-4e36-aa4e-be08150ce21f-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-87tc6\" (UID: \"59cfd4f5-bce8-4e36-aa4e-be08150ce21f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.540631 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.540603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d4br\" (UniqueName: \"kubernetes.io/projected/59cfd4f5-bce8-4e36-aa4e-be08150ce21f-kube-api-access-4d4br\") pod \"monitoring-plugin-76b68cc874-87tc6\" (UID: \"59cfd4f5-bce8-4e36-aa4e-be08150ce21f\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.617370 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.617340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:45.758824 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:45.758799 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-87tc6"] Jun 11 15:36:45.761283 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:45.761249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cfd4f5_bce8_4e36_aa4e_be08150ce21f.slice/crio-ebd9ab3835ad723e34a9d5295f95bc4d952a1bc41c0b124959468075803faec7 WatchSource:0}: Error finding container ebd9ab3835ad723e34a9d5295f95bc4d952a1bc41c0b124959468075803faec7: Status 404 returned error can't find the container with id ebd9ab3835ad723e34a9d5295f95bc4d952a1bc41c0b124959468075803faec7 Jun 11 15:36:46.062677 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.062625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" event={"ID":"38e1492e-5cbc-430d-9b08-f7849c09ec17","Type":"ContainerStarted","Data":"a2545f4e15117e414ed37563d80b35c618c850968c6cf47b43cd0fee439e82f7"} Jun 11 15:36:46.064986 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.064958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"84eaadc4c982267856ca5a59980de509614eb1d3810ea0cf20c15f2cfaa8c875"} Jun 11 15:36:46.065108 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.065034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"1f204e9e730744fbd442e4034ee069a00492e451841424adaa187e5ff097aa7e"} Jun 11 15:36:46.066245 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.066218 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" event={"ID":"59cfd4f5-bce8-4e36-aa4e-be08150ce21f","Type":"ContainerStarted","Data":"ebd9ab3835ad723e34a9d5295f95bc4d952a1bc41c0b124959468075803faec7"} Jun 11 15:36:46.795445 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.794187 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:36:46.804977 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.804906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.812392 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:36:46.812572 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812530 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812349 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812978 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.812978 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.813039 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.813072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dc54\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.813195 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.813211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.813328 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8so9cbhu7qpoc\"" Jun 11 15:36:46.813589 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.813390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:36:46.815363 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.815343 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:36:46.823188 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.821867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:36:46.823912 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.823495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbdxt\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-kube-api-access-cbdxt\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.947749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:46.949151 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:46.947975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049168 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049168 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049168 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbdxt\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-kube-api-access-cbdxt\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.049863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.050279 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.050279 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.049947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.050279 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.050080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.050514 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.050488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.051600 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.051533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.052827 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.052798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.054346 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.053572 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.054346 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.053737 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.054346 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.053979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.054817 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.054731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.054927 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.054839 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-web-config\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.055153 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.055110 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.055270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.055249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.055440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.055380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.055873 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.055846 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.056038 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.056017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.057037 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.056981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.057442 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.057287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.057637 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.057613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config-out\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.061335 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.061292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbdxt\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-kube-api-access-cbdxt\") pod \"prometheus-k8s-0\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.079607 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.078264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"669898e3a83e3451cbf3c83226b129b5f3f3f975874b714159e9ffe72687d255"} Jun 11 15:36:47.079607 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.078349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"6aa60c3cad861f82dced5e488f4ded919365598f3bd21a0ca6575cbe6b1a2370"} Jun 11 15:36:47.079607 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.078390 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" event={"ID":"82cd1d2f-eef4-4432-bc2f-4187ad3139cf","Type":"ContainerStarted","Data":"0366dd35a72b162b3aef31f7d70dee076e75907e04426d8a654bb88e64ff4bdf"} Jun 11 15:36:47.079607 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.079530 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:47.108799 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.108739 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" podStartSLOduration=2.302072924 podStartE2EDuration="5.108715508s" totalImagesPullingTime="2.806642584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:47.105592381 +0000 UTC m=+280.379419432" watchObservedRunningTime="2026-06-11 15:36:47.108715508 +0000 UTC m=+280.382542550" Jun 11 15:36:47.118732 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.118698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:47.460984 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:47.460957 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:36:47.463836 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:47.463804 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac69ca9_06f8_4c38_84fb_b6c4bbea6a32.slice/crio-2f4e914519eec72d44f044293151c2f2d916d865511131a7ef2854971d0d6517 WatchSource:0}: Error finding container 2f4e914519eec72d44f044293151c2f2d916d865511131a7ef2854971d0d6517: Status 404 returned error can't find the container with id 2f4e914519eec72d44f044293151c2f2d916d865511131a7ef2854971d0d6517 Jun 11 15:36:48.084640 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.084595 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" event={"ID":"38e1492e-5cbc-430d-9b08-f7849c09ec17","Type":"ContainerStarted","Data":"bb9ff40bce43bd66b651d159e3243b0184d93a407e9868e1418291e57544ddde"} Jun 11 15:36:48.086216 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.086183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" event={"ID":"59cfd4f5-bce8-4e36-aa4e-be08150ce21f","Type":"ContainerStarted","Data":"9c0bc95e265e36e5b548c01dde7765003d4fb350afaa05f7d3b12fc6c8791bc9"} Jun 11 15:36:48.086393 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.086373 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:48.087493 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.087462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"2f4e914519eec72d44f044293151c2f2d916d865511131a7ef2854971d0d6517"} Jun 11 15:36:48.091748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.091722 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" Jun 11 15:36:48.106729 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.106674 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" podStartSLOduration=2.1527737 podStartE2EDuration="4.106658419s" totalImagesPullingTime="1.953884719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:48.105073838 +0000 UTC m=+281.378900877" watchObservedRunningTime="2026-06-11 15:36:48.106658419 +0000 UTC m=+281.380485460" Jun 11 15:36:48.123667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:48.123475 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-87tc6" podStartSLOduration=1.580674602 podStartE2EDuration="3.123452985s" totalImagesPullingTime="1.542778383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:48.122828261 +0000 UTC m=+281.396655303" watchObservedRunningTime="2026-06-11 15:36:48.123452985 +0000 UTC m=+281.397280030" Jun 11 15:36:48.686851 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:36:48.686799 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qcf5d" podUID="999b4fd9-e079-4e6c-a09c-849907af5324" Jun 11 15:36:49.093280 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:49.093244 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0" exitCode=0 Jun 11 15:36:49.093735 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:49.093344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0"} Jun 11 15:36:49.093735 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:49.093487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcf5d" Jun 11 15:36:49.163568 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:49.163530 2576 patch_prober.go:28] interesting pod/image-registry-5546969db-cckh5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 15:36:49.163715 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:49.163596 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5546969db-cckh5" podUID="385e7e94-e0d4-4dba-a8f3-2c4c7fa82518" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:36:50.992622 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:50.992587 2576 patch_prober.go:28] interesting pod/image-registry-5546969db-cckh5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 15:36:50.993082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:50.992639 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5546969db-cckh5" podUID="385e7e94-e0d4-4dba-a8f3-2c4c7fa82518" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:36:52.001010 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:52.000968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:36:52.003340 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:52.003313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/999b4fd9-e079-4e6c-a09c-849907af5324-metrics-tls\") pod \"dns-default-qcf5d\" (UID: \"999b4fd9-e079-4e6c-a09c-849907af5324\") " pod="openshift-dns/dns-default-qcf5d" Jun 11 15:36:52.098892 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:52.098757 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hkw9v\"" Jun 11 15:36:52.105849 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:52.105825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcf5d" Jun 11 15:36:52.250301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:52.250275 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qcf5d"] Jun 11 15:36:52.253239 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:36:52.253103 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999b4fd9_e079_4e6c_a09c_849907af5324.slice/crio-364a085b108fdb4583bf087ed89c8133f9056bd3e518c0f7d7c3328603066b59 WatchSource:0}: Error finding container 364a085b108fdb4583bf087ed89c8133f9056bd3e518c0f7d7c3328603066b59: Status 404 returned error can't find the container with id 364a085b108fdb4583bf087ed89c8133f9056bd3e518c0f7d7c3328603066b59 Jun 11 15:36:53.110086 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.110043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qcf5d" event={"ID":"999b4fd9-e079-4e6c-a09c-849907af5324","Type":"ContainerStarted","Data":"364a085b108fdb4583bf087ed89c8133f9056bd3e518c0f7d7c3328603066b59"} Jun 11 15:36:53.114049 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.114023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4"} Jun 11 15:36:53.114217 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.114087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b"} Jun 11 15:36:53.114217 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.114113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a"} Jun 11 15:36:53.114217 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.114171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409"} Jun 11 15:36:53.114217 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.114197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61"} Jun 11 15:36:53.114411 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.114229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerStarted","Data":"2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d"} Jun 11 15:36:53.148486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:53.148423 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.155922637 podStartE2EDuration="7.148402662s" totalImagesPullingTime="3.974111856s" totalInitContainerRuntime="18.368169ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:53.145368195 +0000 UTC m=+286.419195260" watchObservedRunningTime="2026-06-11 15:36:53.148402662 +0000 UTC m=+286.422229703" Jun 11 15:36:54.100399 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:54.100372 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59bc5b66f7-l5pdd" Jun 11 15:36:54.119910 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:54.119875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qcf5d" event={"ID":"999b4fd9-e079-4e6c-a09c-849907af5324","Type":"ContainerStarted","Data":"444d469e303c3ad51de89fe13dee6bd2ff7ba627806351a85a34eb7f48a67ce0"} Jun 11 15:36:54.120303 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:54.119935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qcf5d" event={"ID":"999b4fd9-e079-4e6c-a09c-849907af5324","Type":"ContainerStarted","Data":"a5f9c4440e6fb814f3bee706fc5050735515c6c069e161970fd42dc28af3ab01"} Jun 11 15:36:54.120303 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:54.120236 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qcf5d" Jun 11 15:36:54.149955 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:54.149908 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qcf5d" podStartSLOduration=250.739574499 podStartE2EDuration="4m12.149891502s" totalImagesPullingTime="1.410317003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:54.148821191 +0000 UTC m=+287.422648233" watchObservedRunningTime="2026-06-11 15:36:54.149891502 +0000 UTC m=+287.423718544" Jun 11 15:36:57.119412 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:57.119373 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:36:59.163038 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:59.163000 2576 patch_prober.go:28] interesting pod/image-registry-5546969db-cckh5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 15:36:59.163526 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:36:59.163053 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5546969db-cckh5" podUID="385e7e94-e0d4-4dba-a8f3-2c4c7fa82518" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:37:00.992443 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:00.992414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5546969db-cckh5" Jun 11 15:37:05.130571 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:05.130537 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qcf5d" Jun 11 15:37:05.199782 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:05.199748 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:37:05.199967 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:05.199804 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:37:07.148162 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:07.148109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:37:07.151358 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:07.151336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:37:07.154032 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:07.154011 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 15:37:08.185052 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:08.185019 2576 generic.go:356] "Generic (PLEG): container finished" podID="797c23b6-1b05-48af-8835-78a3b0e43b66" containerID="ff6d01fe9fae8205a4248586578b4621061c8c3cbaf9fc84128aefbc96f72c83" exitCode=0 Jun 11 15:37:08.185464 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:08.185094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" event={"ID":"797c23b6-1b05-48af-8835-78a3b0e43b66","Type":"ContainerDied","Data":"ff6d01fe9fae8205a4248586578b4621061c8c3cbaf9fc84128aefbc96f72c83"} Jun 11 15:37:08.185464 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:08.185406 2576 scope.go:117] "RemoveContainer" containerID="ff6d01fe9fae8205a4248586578b4621061c8c3cbaf9fc84128aefbc96f72c83" Jun 11 15:37:09.194455 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:09.194376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-p4c8n" event={"ID":"797c23b6-1b05-48af-8835-78a3b0e43b66","Type":"ContainerStarted","Data":"e665540ba9be4a0b7b198c4b54f25180af3ad442246734a9527fc8e11245a51a"} Jun 11 15:37:25.205877 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:25.205844 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:37:25.209748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:25.209720 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d6f4f997b-t8mqf" Jun 11 15:37:33.284853 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:33.284816 2576 generic.go:356] "Generic (PLEG): container finished" podID="d64e9743-6147-481d-b65f-88e9de035c7c" containerID="543c3371e0d0f501d9ee4501a1c9ce274e632835851aa19b1530451515c5257a" exitCode=0 Jun 11 15:37:33.285276 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:33.284872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvqqf" event={"ID":"d64e9743-6147-481d-b65f-88e9de035c7c","Type":"ContainerDied","Data":"543c3371e0d0f501d9ee4501a1c9ce274e632835851aa19b1530451515c5257a"} Jun 11 15:37:33.285276 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:33.285198 2576 scope.go:117] "RemoveContainer" containerID="543c3371e0d0f501d9ee4501a1c9ce274e632835851aa19b1530451515c5257a" Jun 11 15:37:34.290594 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:34.290559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-dvqqf" event={"ID":"d64e9743-6147-481d-b65f-88e9de035c7c","Type":"ContainerStarted","Data":"974d8a89bfa474b81000034615ff1d66b43cf9844b0815ae51d6bb4db951a49c"} Jun 11 15:37:47.121453 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:47.119570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:37:47.139277 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:47.139249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:37:47.376429 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:37:47.376334 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:05.156652 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156565 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:38:05.157210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156909 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="thanos-sidecar" containerID="cri-o://9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409" gracePeriod=600 Jun 11 15:38:05.157210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156918 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="prometheus" containerID="cri-o://2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d" gracePeriod=600 Jun 11 15:38:05.157210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156941 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-thanos" containerID="cri-o://674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4" gracePeriod=600 Jun 11 15:38:05.157210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156952 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="config-reloader" containerID="cri-o://d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61" gracePeriod=600 Jun 11 15:38:05.157210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156893 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-web" containerID="cri-o://3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a" gracePeriod=600 Jun 11 15:38:05.157210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.156893 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy" containerID="cri-o://e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b" gracePeriod=600 Jun 11 15:38:05.428486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428374 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4" exitCode=0 Jun 11 15:38:05.428486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428405 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b" exitCode=0 Jun 11 15:38:05.428486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428411 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409" exitCode=0 Jun 11 15:38:05.428486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428417 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61" exitCode=0 Jun 11 15:38:05.428486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428422 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d" exitCode=0 Jun 11 15:38:05.428486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4"} Jun 11 15:38:05.428959 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b"} Jun 11 15:38:05.428959 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409"} Jun 11 15:38:05.428959 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61"} Jun 11 15:38:05.428959 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:05.428673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d"} Jun 11 15:38:06.406966 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.406936 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.435238 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.435205 2576 generic.go:356] "Generic (PLEG): container finished" podID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerID="3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a" exitCode=0 Jun 11 15:38:06.435432 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.435292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a"} Jun 11 15:38:06.435432 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.435361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32","Type":"ContainerDied","Data":"2f4e914519eec72d44f044293151c2f2d916d865511131a7ef2854971d0d6517"} Jun 11 15:38:06.435432 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.435302 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.436083 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.436070 2576 scope.go:117] "RemoveContainer" containerID="674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4" Jun 11 15:38:06.444075 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444052 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-trusted-ca-bundle\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444100 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444146 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-metrics-client-certs\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444179 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-1\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444207 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-grpc-tls\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444230 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444505 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config-out\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444505 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-web-config\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444505 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444316 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-kube-rbac-proxy\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444505 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444340 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-serving-certs-ca-bundle\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444513 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-2\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444558 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbdxt\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-kube-api-access-cbdxt\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.444687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444588 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.444887 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.444868 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445187 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-tls-assets\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-thanos-prometheus-http-client-file\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-tls\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445294 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-kubelet-serving-ca-bundle\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445528 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-0\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445528 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445348 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-db\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445528 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445404 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-metrics-client-ca\") pod \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\" (UID: \"2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32\") " Jun 11 15:38:06.445683 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445148 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.446015 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.445986 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.446439 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.446410 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.446613 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.446591 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.447481 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.447456 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.449261 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.448953 2576 scope.go:117] "RemoveContainer" containerID="e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b" Jun 11 15:38:06.449261 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.448986 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:38:06.449416 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.449311 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.449416 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.449333 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.449416 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.449348 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.449646 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.449556 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:38:06.454787 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.454765 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-kube-api-access-cbdxt" (OuterVolumeSpecName: "kube-api-access-cbdxt") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "kube-api-access-cbdxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:38:06.455476 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.455206 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.455476 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.455286 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.455476 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.455348 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.455476 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.455376 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.455807 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.455772 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.455937 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.455910 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.456282 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.456257 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:38:06.456621 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.456576 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.456621 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.456581 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config-out" (OuterVolumeSpecName: "config-out") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:38:06.457024 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.457001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config" (OuterVolumeSpecName: "config") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.468490 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.468453 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-web-config" (OuterVolumeSpecName: "web-config") pod "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" (UID: "2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:38:06.476074 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.476053 2576 scope.go:117] "RemoveContainer" containerID="3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a" Jun 11 15:38:06.484276 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.484255 2576 scope.go:117] "RemoveContainer" containerID="9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409" Jun 11 15:38:06.492188 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.492167 2576 scope.go:117] "RemoveContainer" containerID="d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61" Jun 11 15:38:06.500413 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.500389 2576 scope.go:117] "RemoveContainer" containerID="2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d" Jun 11 15:38:06.507881 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.507865 2576 scope.go:117] "RemoveContainer" containerID="22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0" Jun 11 15:38:06.514705 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.514683 2576 scope.go:117] "RemoveContainer" containerID="674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4" Jun 11 15:38:06.514995 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.514972 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4\": container with ID starting with 674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4 not found: ID does not exist" containerID="674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4" Jun 11 15:38:06.515070 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515011 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4"} err="failed to get container status \"674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4\": rpc error: code = NotFound desc = could not find container \"674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4\": container with ID starting with 674fd7206ccac04ff3b641de0f4508f0e98825d8c7db2d9029f7a62bb92aa6b4 not found: ID does not exist" Jun 11 15:38:06.515169 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515075 2576 scope.go:117] "RemoveContainer" containerID="e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b" Jun 11 15:38:06.515357 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.515338 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b\": container with ID starting with e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b not found: ID does not exist" containerID="e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b" Jun 11 15:38:06.515405 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515366 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b"} err="failed to get container status \"e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b\": rpc error: code = NotFound desc = could not find container \"e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b\": container with ID starting with e9915daf16aa4cac1af75b334d40ab34e47a4699d13e0090ce36d5cf4ad5ff1b not found: ID does not exist" Jun 11 15:38:06.515405 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515391 2576 scope.go:117] "RemoveContainer" containerID="3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a" Jun 11 15:38:06.515621 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.515603 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a\": container with ID starting with 3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a not found: ID does not exist" containerID="3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a" Jun 11 15:38:06.515684 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515630 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a"} err="failed to get container status \"3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a\": rpc error: code = NotFound desc = could not find container \"3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a\": container with ID starting with 3d3d04c07d2506993b3731f6be5761e7b3fbaa89ed3ff8c4ae2c47dba45bf42a not found: ID does not exist" Jun 11 15:38:06.515684 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515651 2576 scope.go:117] "RemoveContainer" containerID="9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409" Jun 11 15:38:06.515900 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.515883 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409\": container with ID starting with 9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409 not found: ID does not exist" containerID="9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409" Jun 11 15:38:06.515939 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515905 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409"} err="failed to get container status \"9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409\": rpc error: code = NotFound desc = could not find container \"9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409\": container with ID starting with 9b5fe52d8707c6ea467fb7ed7988c8d4278ebda7eb2f81db719a3914d3d3e409 not found: ID does not exist" Jun 11 15:38:06.515939 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.515920 2576 scope.go:117] "RemoveContainer" containerID="d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61" Jun 11 15:38:06.516150 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.516111 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61\": container with ID starting with d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61 not found: ID does not exist" containerID="d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61" Jun 11 15:38:06.516224 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.516157 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61"} err="failed to get container status \"d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61\": rpc error: code = NotFound desc = could not find container \"d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61\": container with ID starting with d76fecf107ae6880996db0c4612ceb0dfa989892dcd80d7c55b1af7873430f61 not found: ID does not exist" Jun 11 15:38:06.516224 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.516178 2576 scope.go:117] "RemoveContainer" containerID="2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d" Jun 11 15:38:06.516434 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.516418 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d\": container with ID starting with 2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d not found: ID does not exist" containerID="2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d" Jun 11 15:38:06.516473 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.516437 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d"} err="failed to get container status \"2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d\": rpc error: code = NotFound desc = could not find container \"2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d\": container with ID starting with 2623a038e9b4e49413a99e7886f394e188857e4a61fdd90bf7866a54d696225d not found: ID does not exist" Jun 11 15:38:06.516473 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.516450 2576 scope.go:117] "RemoveContainer" containerID="22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0" Jun 11 15:38:06.516662 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:38:06.516646 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0\": container with ID starting with 22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0 not found: ID does not exist" containerID="22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0" Jun 11 15:38:06.516700 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.516666 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0"} err="failed to get container status \"22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0\": rpc error: code = NotFound desc = could not find container \"22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0\": container with ID starting with 22906827787a079d8c28bacdd7bd043a82f71a9d33236d44c95d4a28485389b0 not found: ID does not exist" Jun 11 15:38:06.549894 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549848 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.549894 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549884 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.549894 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549898 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549910 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-db\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549922 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-metrics-client-ca\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549934 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549946 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-metrics-client-certs\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549957 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-grpc-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549969 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549981 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-config-out\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.549992 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-web-config\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.550003 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-kube-rbac-proxy\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.550014 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.550025 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.550037 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbdxt\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-kube-api-access-cbdxt\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.550049 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.550212 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.550064 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32-tls-assets\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:38:06.762713 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.762677 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:38:06.767103 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.767074 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:38:06.798622 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.798582 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:38:06.798957 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.798940 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="config-reloader" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.798961 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="config-reloader" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.798986 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="prometheus" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.798995 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="prometheus" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799012 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="thanos-sidecar" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799020 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="thanos-sidecar" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799034 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="init-config-reloader" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799044 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="init-config-reloader" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799054 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-web" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799062 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-web" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799072 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799080 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799088 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-thanos" Jun 11 15:38:06.799099 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799096 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-thanos" Jun 11 15:38:06.799741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799199 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="config-reloader" Jun 11 15:38:06.799741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799216 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-web" Jun 11 15:38:06.799741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799227 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy-thanos" Jun 11 15:38:06.799741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799235 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="thanos-sidecar" Jun 11 15:38:06.799741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799246 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="kube-rbac-proxy" Jun 11 15:38:06.799741 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.799255 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" containerName="prometheus" Jun 11 15:38:06.802784 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.802757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.808574 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808546 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:38:06.808711 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:38:06.808711 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808631 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:38:06.808711 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:38:06.809062 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:38:06.809062 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:38:06.809062 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.808997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:38:06.809272 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.809089 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:38:06.809395 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.809369 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:38:06.809457 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.809420 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dc54\"" Jun 11 15:38:06.809516 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.809378 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:38:06.809572 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.809513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:38:06.809809 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.809770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:38:06.811179 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.811162 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8so9cbhu7qpoc\"" Jun 11 15:38:06.818025 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.817984 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:38:06.822667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.820836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:38:06.832987 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.832957 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:38:06.852203 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852352 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852352 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852352 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852463 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwh7c\" (UniqueName: \"kubernetes.io/projected/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-kube-api-access-hwh7c\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852463 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852463 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852551 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852551 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-config\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852551 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852551 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852667 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852783 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852783 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852783 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852783 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.852893 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.852794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.953961 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.953918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.953961 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.953962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954245 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.953989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954245 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954245 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwh7c\" (UniqueName: \"kubernetes.io/projected/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-kube-api-access-hwh7c\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.954687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.955026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.955026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.955026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-config\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.955026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.955026 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.955015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.955842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.955915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.954832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.957672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.957732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.957928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.958593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958530 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.959079 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.959079 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.959079 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.959079 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.958796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.959233 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.959210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.960229 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.960211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.960321 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.960305 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-config\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.960565 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.960544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:06.965856 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:06.965833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwh7c\" (UniqueName: \"kubernetes.io/projected/e45a2fe1-6ce5-4cb0-b83e-db824169aa2f-kube-api-access-hwh7c\") pod \"prometheus-k8s-0\" (UID: \"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:07.116172 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.116112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4dc54\"" Jun 11 15:38:07.123414 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.123389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:38:07.196489 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.196453 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32" path="/var/lib/kubelet/pods/2ac69ca9-06f8-4c38-84fb-b6c4bbea6a32/volumes" Jun 11 15:38:07.280990 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.280952 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:38:07.284205 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:38:07.284177 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45a2fe1_6ce5_4cb0_b83e_db824169aa2f.slice/crio-297f935b6b10230468896cdf86be6f24d419d3af02e31bf2e84e658368489446 WatchSource:0}: Error finding container 297f935b6b10230468896cdf86be6f24d419d3af02e31bf2e84e658368489446: Status 404 returned error can't find the container with id 297f935b6b10230468896cdf86be6f24d419d3af02e31bf2e84e658368489446 Jun 11 15:38:07.441301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.441261 2576 generic.go:356] "Generic (PLEG): container finished" podID="e45a2fe1-6ce5-4cb0-b83e-db824169aa2f" containerID="b69072cb665a71f2f2c7716879bc13ce53b00765115154fa99eff01b504f88ac" exitCode=0 Jun 11 15:38:07.441673 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.441342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerDied","Data":"b69072cb665a71f2f2c7716879bc13ce53b00765115154fa99eff01b504f88ac"} Jun 11 15:38:07.441673 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:07.441417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"297f935b6b10230468896cdf86be6f24d419d3af02e31bf2e84e658368489446"} Jun 11 15:38:08.449514 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.449477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"c3e23473a7440b36b8367d7f7a94afdce625e094bf13b1b8e58c89507d55cbbf"} Jun 11 15:38:08.449996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.449545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"612f77663359d8d6ed1f97476692f43f8374ad8e0afd4ad6b4c59f22aa90d142"} Jun 11 15:38:08.449996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.449572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"14436bde0b548616abb2d20bfad6eb5f6b7ac5b71e7b7aa30c34d42bcb4d9e54"} Jun 11 15:38:08.449996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.449597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"3dbd5ab93b6efb730fb7e9e1b172c92c838af02a534781e5085d181c4b712e66"} Jun 11 15:38:08.449996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.449620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"ef7021cbaecce140d2121ec2e763f909178429e8515ae1e96d08e20fcdc20f61"} Jun 11 15:38:08.449996 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.449644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e45a2fe1-6ce5-4cb0-b83e-db824169aa2f","Type":"ContainerStarted","Data":"88ebef045527579f8cf4112806c513c05d499638fe7163d540274dd444db66f5"} Jun 11 15:38:08.480171 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:08.480047 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.460789911 podStartE2EDuration="2.480032813s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.242902ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:38:08.478431171 +0000 UTC m=+361.752258212" watchObservedRunningTime="2026-06-11 15:38:08.480032813 +0000 UTC m=+361.753859903" Jun 11 15:38:12.124020 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:38:12.123963 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:39:07.124400 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:39:07.124362 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:39:07.140838 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:39:07.140814 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:39:07.711929 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:39:07.711898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:41:32.328844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.328804 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k"] Jun 11 15:41:32.332337 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.332318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.336938 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.336914 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:41:32.337138 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.337106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:41:32.337260 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.337107 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:41:32.337260 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.337107 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w5kxl\"" Jun 11 15:41:32.337376 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.337291 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:41:32.353992 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.353963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k"] Jun 11 15:41:32.417467 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.417432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.417659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.417498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2jkw\" (UniqueName: \"kubernetes.io/projected/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-kube-api-access-s2jkw\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.417659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.417572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.417659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.417616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-manifests\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.417659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.417640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-tmp\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.519057 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.519015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2jkw\" (UniqueName: \"kubernetes.io/projected/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-kube-api-access-s2jkw\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.519257 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.519075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.519257 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.519110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-manifests\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.519257 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.519161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-tmp\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.519257 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.519216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.519562 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.519540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-manifests\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.521498 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.521469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-tmp\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.521850 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.521828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.521899 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.521828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.527477 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.527458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2jkw\" (UniqueName: \"kubernetes.io/projected/8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3-kube-api-access-s2jkw\") pod \"opendatahub-operator-controller-manager-77ff979667-nmw8k\" (UID: \"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3\") " pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.642934 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.642898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:32.814336 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.814302 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k"] Jun 11 15:41:32.818084 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:41:32.818057 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6b3d26_5ed7_4214_bbe7_c5b14b7b94f3.slice/crio-1811631fa0ac217669e49f47029af3446fab209c37aa8a53fb341241ae229d51 WatchSource:0}: Error finding container 1811631fa0ac217669e49f47029af3446fab209c37aa8a53fb341241ae229d51: Status 404 returned error can't find the container with id 1811631fa0ac217669e49f47029af3446fab209c37aa8a53fb341241ae229d51 Jun 11 15:41:32.819915 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:32.819896 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:41:33.269031 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:33.268991 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" event={"ID":"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3","Type":"ContainerStarted","Data":"1811631fa0ac217669e49f47029af3446fab209c37aa8a53fb341241ae229d51"} Jun 11 15:41:36.288554 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:36.288519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" event={"ID":"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3","Type":"ContainerStarted","Data":"bb0891d600a5da5e466e6d8e23461ff259e99fe3b22b42aea981574b1abaa51e"} Jun 11 15:41:37.294303 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:37.294264 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3" containerID="bb0891d600a5da5e466e6d8e23461ff259e99fe3b22b42aea981574b1abaa51e" exitCode=0 Jun 11 15:41:37.294748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:37.294311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" event={"ID":"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3","Type":"ContainerDied","Data":"bb0891d600a5da5e466e6d8e23461ff259e99fe3b22b42aea981574b1abaa51e"} Jun 11 15:41:38.300531 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:38.300498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" event={"ID":"8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3","Type":"ContainerStarted","Data":"f62442763206a47851eff1d2bbaf8d70d86d9433cd9f7d7bfd270b09dffda611"} Jun 11 15:41:38.300933 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:38.300624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:38.326021 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:38.325970 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" podStartSLOduration=1.575958697 podStartE2EDuration="6.3259553s" totalImagesPullingTime="3.740971157s" totalInitContainerRuntime="1.009025446s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:41:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:41:38.324163593 +0000 UTC m=+571.597990637" watchObservedRunningTime="2026-06-11 15:41:38.3259553 +0000 UTC m=+571.599782341" Jun 11 15:41:49.307903 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:49.307868 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77ff979667-nmw8k" Jun 11 15:41:50.488779 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.488749 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr"] Jun 11 15:41:50.492057 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.492040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.496019 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.495995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p8ldf\"" Jun 11 15:41:50.496157 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.496022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:41:50.496157 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.495998 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:41:50.496157 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.495997 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:41:50.496157 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.495997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:41:50.496369 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.496355 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:41:50.504853 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.504830 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr"] Jun 11 15:41:50.581456 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.581422 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8w9n\" (UniqueName: \"kubernetes.io/projected/45639935-1e85-4422-8eb7-f7b153d61fda-kube-api-access-s8w9n\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.581456 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.581460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45639935-1e85-4422-8eb7-f7b153d61fda-manager-config\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.581684 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.581492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45639935-1e85-4422-8eb7-f7b153d61fda-metrics-cert\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.581684 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.581564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45639935-1e85-4422-8eb7-f7b153d61fda-cert\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.682405 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.682371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8w9n\" (UniqueName: \"kubernetes.io/projected/45639935-1e85-4422-8eb7-f7b153d61fda-kube-api-access-s8w9n\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.682405 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.682409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45639935-1e85-4422-8eb7-f7b153d61fda-manager-config\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.682574 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.682437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45639935-1e85-4422-8eb7-f7b153d61fda-metrics-cert\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.682626 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.682605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45639935-1e85-4422-8eb7-f7b153d61fda-cert\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.683174 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.683147 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/45639935-1e85-4422-8eb7-f7b153d61fda-manager-config\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.684935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.684916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45639935-1e85-4422-8eb7-f7b153d61fda-cert\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.685030 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.684965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/45639935-1e85-4422-8eb7-f7b153d61fda-metrics-cert\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.708937 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.708908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8w9n\" (UniqueName: \"kubernetes.io/projected/45639935-1e85-4422-8eb7-f7b153d61fda-kube-api-access-s8w9n\") pod \"lws-controller-manager-6f9d6f9b9f-qr2sr\" (UID: \"45639935-1e85-4422-8eb7-f7b153d61fda\") " pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.801751 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.801658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:50.948925 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:50.948893 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr"] Jun 11 15:41:50.951820 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:41:50.951790 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45639935_1e85_4422_8eb7_f7b153d61fda.slice/crio-6ae624a880a87ef35f63aa95cccfcc912efdd8e7a258d72ea019ba3c95325af0 WatchSource:0}: Error finding container 6ae624a880a87ef35f63aa95cccfcc912efdd8e7a258d72ea019ba3c95325af0: Status 404 returned error can't find the container with id 6ae624a880a87ef35f63aa95cccfcc912efdd8e7a258d72ea019ba3c95325af0 Jun 11 15:41:51.360599 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:51.360561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" event={"ID":"45639935-1e85-4422-8eb7-f7b153d61fda","Type":"ContainerStarted","Data":"6ae624a880a87ef35f63aa95cccfcc912efdd8e7a258d72ea019ba3c95325af0"} Jun 11 15:41:54.376476 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:54.376440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" event={"ID":"45639935-1e85-4422-8eb7-f7b153d61fda","Type":"ContainerStarted","Data":"04baf24cba9f9d27e182d56ffa0e747235aa335b7f46632d5a937c68111b1b32"} Jun 11 15:41:54.376966 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:54.376570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:41:54.397356 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:41:54.397303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" podStartSLOduration=1.852744655 podStartE2EDuration="4.397285311s" totalImagesPullingTime="2.544540656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:41:54.395808046 +0000 UTC m=+587.669635087" watchObservedRunningTime="2026-06-11 15:41:54.397285311 +0000 UTC m=+587.671112351" Jun 11 15:42:05.383396 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:05.383358 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f9d6f9b9f-qr2sr" Jun 11 15:42:07.177938 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:07.177911 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:42:07.178426 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:07.178336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:42:09.981542 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:09.981505 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5c744446f8-24hwn"] Jun 11 15:42:09.984822 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:09.984799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:09.988954 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:09.988930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 15:42:09.989115 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:09.989095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7jkcj\"" Jun 11 15:42:10.008845 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.008817 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c744446f8-24hwn"] Jun 11 15:42:10.050590 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.050557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fggbn\" (UniqueName: \"kubernetes.io/projected/43f36b10-4255-4d74-81cf-769263e5d362-kube-api-access-fggbn\") pod \"dashboard-redirect-5c744446f8-24hwn\" (UID: \"43f36b10-4255-4d74-81cf-769263e5d362\") " pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.050753 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.050607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43f36b10-4255-4d74-81cf-769263e5d362-redirect-config\") pod \"dashboard-redirect-5c744446f8-24hwn\" (UID: \"43f36b10-4255-4d74-81cf-769263e5d362\") " pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.151739 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.151696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fggbn\" (UniqueName: \"kubernetes.io/projected/43f36b10-4255-4d74-81cf-769263e5d362-kube-api-access-fggbn\") pod \"dashboard-redirect-5c744446f8-24hwn\" (UID: \"43f36b10-4255-4d74-81cf-769263e5d362\") " pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.151932 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.151753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43f36b10-4255-4d74-81cf-769263e5d362-redirect-config\") pod \"dashboard-redirect-5c744446f8-24hwn\" (UID: \"43f36b10-4255-4d74-81cf-769263e5d362\") " pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.152511 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.152489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/43f36b10-4255-4d74-81cf-769263e5d362-redirect-config\") pod \"dashboard-redirect-5c744446f8-24hwn\" (UID: \"43f36b10-4255-4d74-81cf-769263e5d362\") " pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.161743 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.161723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fggbn\" (UniqueName: \"kubernetes.io/projected/43f36b10-4255-4d74-81cf-769263e5d362-kube-api-access-fggbn\") pod \"dashboard-redirect-5c744446f8-24hwn\" (UID: \"43f36b10-4255-4d74-81cf-769263e5d362\") " pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.295342 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.295238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" Jun 11 15:42:10.655458 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:42:10.655430 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f36b10_4255_4d74_81cf_769263e5d362.slice/crio-6902e57fb1eb236053a1482637d551a337ce3394fef708dbbefb1256a5629faf WatchSource:0}: Error finding container 6902e57fb1eb236053a1482637d551a337ce3394fef708dbbefb1256a5629faf: Status 404 returned error can't find the container with id 6902e57fb1eb236053a1482637d551a337ce3394fef708dbbefb1256a5629faf Jun 11 15:42:10.656365 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:10.656341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c744446f8-24hwn"] Jun 11 15:42:11.462291 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:11.462251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" event={"ID":"43f36b10-4255-4d74-81cf-769263e5d362","Type":"ContainerStarted","Data":"6902e57fb1eb236053a1482637d551a337ce3394fef708dbbefb1256a5629faf"} Jun 11 15:42:15.486891 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:15.486851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" event={"ID":"43f36b10-4255-4d74-81cf-769263e5d362","Type":"ContainerStarted","Data":"97f89e77f76bc90371fe8b719355f0ffd9e082e88e4c1080c46ce53550825d87"} Jun 11 15:42:15.504384 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:15.504335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5c744446f8-24hwn" podStartSLOduration=2.080365181 podStartE2EDuration="6.504320622s" totalImagesPullingTime="4.423955441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:42:15.50319598 +0000 UTC m=+608.777023021" watchObservedRunningTime="2026-06-11 15:42:15.504320622 +0000 UTC m=+608.778147698" Jun 11 15:42:26.028367 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.028287 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh"] Jun 11 15:42:26.031638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.031619 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.034300 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.034266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 15:42:26.034445 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.034325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2n4x5\"" Jun 11 15:42:26.047725 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.047696 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh"] Jun 11 15:42:26.093593 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093806 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093806 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093806 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmlq7\" (UniqueName: \"kubernetes.io/projected/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-kube-api-access-wmlq7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093806 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093806 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093999 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093999 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.093999 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.093889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.194804 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.194758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.194804 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.194804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.194859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.194910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195082 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195273 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmlq7\" (UniqueName: \"kubernetes.io/projected/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-kube-api-access-wmlq7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195273 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195273 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195273 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195470 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195470 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195659 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195768 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.195809 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.195793 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.197532 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.197503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.197653 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.197551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.203406 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.203376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.203594 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.203571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmlq7\" (UniqueName: \"kubernetes.io/projected/f1b159ae-1734-4e00-90a2-5c4cb1e93d04-kube-api-access-wmlq7\") pod \"data-science-gateway-data-science-gateway-class-74759f9795s9zjh\" (UID: \"f1b159ae-1734-4e00-90a2-5c4cb1e93d04\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.342727 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.342638 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:26.493951 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.493912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh"] Jun 11 15:42:26.499308 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:42:26.499274 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b159ae_1734_4e00_90a2_5c4cb1e93d04.slice/crio-3c1e2eb2ab6a56b669c3d4ea84df59dd67be750257b1db901d6b0b712a8aef64 WatchSource:0}: Error finding container 3c1e2eb2ab6a56b669c3d4ea84df59dd67be750257b1db901d6b0b712a8aef64: Status 404 returned error can't find the container with id 3c1e2eb2ab6a56b669c3d4ea84df59dd67be750257b1db901d6b0b712a8aef64 Jun 11 15:42:26.532131 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:26.532084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" event={"ID":"f1b159ae-1734-4e00-90a2-5c4cb1e93d04","Type":"ContainerStarted","Data":"3c1e2eb2ab6a56b669c3d4ea84df59dd67be750257b1db901d6b0b712a8aef64"} Jun 11 15:42:29.681058 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:29.681021 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:42:29.681335 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:29.681096 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:42:29.681335 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:29.681144 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:42:30.552906 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:30.552868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" event={"ID":"f1b159ae-1734-4e00-90a2-5c4cb1e93d04","Type":"ContainerStarted","Data":"194167ace2ced483f94cff479b2c0691313e00bb76469d776d8b032a8fe6e2a5"} Jun 11 15:42:30.575774 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:30.575708 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" podStartSLOduration=1.3962294769999999 podStartE2EDuration="4.575686141s" totalImagesPullingTime="3.179456664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:42:30.574908879 +0000 UTC m=+623.848735945" watchObservedRunningTime="2026-06-11 15:42:30.575686141 +0000 UTC m=+623.849513184" Jun 11 15:42:31.343851 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:31.343813 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:31.348675 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:31.348652 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:31.557854 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:31.557824 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:31.558693 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:31.558677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795s9zjh" Jun 11 15:42:52.912421 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.912387 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4ttxq"] Jun 11 15:42:52.915792 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.915772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:52.919931 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.919906 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:42:52.921073 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.921018 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:42:52.921073 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.921034 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w4q5m\"" Jun 11 15:42:52.938581 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.938551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4ttxq"] Jun 11 15:42:52.940644 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:52.940620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvnh\" (UniqueName: \"kubernetes.io/projected/e261afab-3609-4ea6-98f6-e77bc6495ca3-kube-api-access-cvvnh\") pod \"kuadrant-operator-catalog-4ttxq\" (UID: \"e261afab-3609-4ea6-98f6-e77bc6495ca3\") " pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:53.041546 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.041514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvnh\" (UniqueName: \"kubernetes.io/projected/e261afab-3609-4ea6-98f6-e77bc6495ca3-kube-api-access-cvvnh\") pod \"kuadrant-operator-catalog-4ttxq\" (UID: \"e261afab-3609-4ea6-98f6-e77bc6495ca3\") " pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:53.050267 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.050235 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvnh\" (UniqueName: \"kubernetes.io/projected/e261afab-3609-4ea6-98f6-e77bc6495ca3-kube-api-access-cvvnh\") pod \"kuadrant-operator-catalog-4ttxq\" (UID: \"e261afab-3609-4ea6-98f6-e77bc6495ca3\") " pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:53.226194 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.226092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:53.279910 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.279874 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4ttxq"] Jun 11 15:42:53.357011 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.356977 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4ttxq"] Jun 11 15:42:53.360616 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:42:53.360590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode261afab_3609_4ea6_98f6_e77bc6495ca3.slice/crio-ed0055fb76bf68ee362b8c8a05c0abd4adcf1528eed06e8229f807be5f1dfec1 WatchSource:0}: Error finding container ed0055fb76bf68ee362b8c8a05c0abd4adcf1528eed06e8229f807be5f1dfec1: Status 404 returned error can't find the container with id ed0055fb76bf68ee362b8c8a05c0abd4adcf1528eed06e8229f807be5f1dfec1 Jun 11 15:42:53.487586 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.487504 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fn7xm"] Jun 11 15:42:53.492207 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.492191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:42:53.500480 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.500455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fn7xm"] Jun 11 15:42:53.545426 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.545396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6fxz\" (UniqueName: \"kubernetes.io/projected/d96dd480-45c3-4cc8-81fa-51bf6d7d72df-kube-api-access-c6fxz\") pod \"kuadrant-operator-catalog-fn7xm\" (UID: \"d96dd480-45c3-4cc8-81fa-51bf6d7d72df\") " pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:42:53.646310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.646279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fxz\" (UniqueName: \"kubernetes.io/projected/d96dd480-45c3-4cc8-81fa-51bf6d7d72df-kube-api-access-c6fxz\") pod \"kuadrant-operator-catalog-fn7xm\" (UID: \"d96dd480-45c3-4cc8-81fa-51bf6d7d72df\") " pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:42:53.655622 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.655595 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fxz\" (UniqueName: \"kubernetes.io/projected/d96dd480-45c3-4cc8-81fa-51bf6d7d72df-kube-api-access-c6fxz\") pod \"kuadrant-operator-catalog-fn7xm\" (UID: \"d96dd480-45c3-4cc8-81fa-51bf6d7d72df\") " pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:42:53.658446 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.658412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" event={"ID":"e261afab-3609-4ea6-98f6-e77bc6495ca3","Type":"ContainerStarted","Data":"ed0055fb76bf68ee362b8c8a05c0abd4adcf1528eed06e8229f807be5f1dfec1"} Jun 11 15:42:53.802353 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.802273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:42:53.932779 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:53.932755 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fn7xm"] Jun 11 15:42:53.935094 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:42:53.935062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96dd480_45c3_4cc8_81fa_51bf6d7d72df.slice/crio-e40b6bfff8ddda5d1c0b6d12172b5384f8ce2f62a4902ab4ae7fd68f870e7672 WatchSource:0}: Error finding container e40b6bfff8ddda5d1c0b6d12172b5384f8ce2f62a4902ab4ae7fd68f870e7672: Status 404 returned error can't find the container with id e40b6bfff8ddda5d1c0b6d12172b5384f8ce2f62a4902ab4ae7fd68f870e7672 Jun 11 15:42:54.666906 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:54.666831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" event={"ID":"d96dd480-45c3-4cc8-81fa-51bf6d7d72df","Type":"ContainerStarted","Data":"e40b6bfff8ddda5d1c0b6d12172b5384f8ce2f62a4902ab4ae7fd68f870e7672"} Jun 11 15:42:56.678485 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.678447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" event={"ID":"e261afab-3609-4ea6-98f6-e77bc6495ca3","Type":"ContainerStarted","Data":"cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25"} Jun 11 15:42:56.678990 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.678534 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" podUID="e261afab-3609-4ea6-98f6-e77bc6495ca3" containerName="registry-server" containerID="cri-o://cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25" gracePeriod=2 Jun 11 15:42:56.680053 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.680031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" event={"ID":"d96dd480-45c3-4cc8-81fa-51bf6d7d72df","Type":"ContainerStarted","Data":"e338986b1f00dd6a2ab6c89308cd8f8f1f2e0c961321596638ee5e2f00947d60"} Jun 11 15:42:56.696796 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.696752 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" podStartSLOduration=2.412659086 podStartE2EDuration="4.69673693s" totalImagesPullingTime="2.284077844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:42:56.696187813 +0000 UTC m=+649.970014854" watchObservedRunningTime="2026-06-11 15:42:56.69673693 +0000 UTC m=+649.970563971" Jun 11 15:42:56.712267 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.712230 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" podStartSLOduration=2.000167503 podStartE2EDuration="3.71221643s" totalImagesPullingTime="1.712048927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:42:56.710669188 +0000 UTC m=+649.984496228" watchObservedRunningTime="2026-06-11 15:42:56.71221643 +0000 UTC m=+649.986043471" Jun 11 15:42:56.933226 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.933170 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:56.978172 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.978137 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvnh\" (UniqueName: \"kubernetes.io/projected/e261afab-3609-4ea6-98f6-e77bc6495ca3-kube-api-access-cvvnh\") pod \"e261afab-3609-4ea6-98f6-e77bc6495ca3\" (UID: \"e261afab-3609-4ea6-98f6-e77bc6495ca3\") " Jun 11 15:42:56.980568 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:56.980536 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e261afab-3609-4ea6-98f6-e77bc6495ca3-kube-api-access-cvvnh" (OuterVolumeSpecName: "kube-api-access-cvvnh") pod "e261afab-3609-4ea6-98f6-e77bc6495ca3" (UID: "e261afab-3609-4ea6-98f6-e77bc6495ca3"). InnerVolumeSpecName "kube-api-access-cvvnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:42:57.079251 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.079208 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvnh\" (UniqueName: \"kubernetes.io/projected/e261afab-3609-4ea6-98f6-e77bc6495ca3-kube-api-access-cvvnh\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:42:57.690904 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.690871 2576 generic.go:356] "Generic (PLEG): container finished" podID="e261afab-3609-4ea6-98f6-e77bc6495ca3" containerID="cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25" exitCode=0 Jun 11 15:42:57.691376 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.690924 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" Jun 11 15:42:57.691376 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.690966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" event={"ID":"e261afab-3609-4ea6-98f6-e77bc6495ca3","Type":"ContainerDied","Data":"cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25"} Jun 11 15:42:57.691376 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.691044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4ttxq" event={"ID":"e261afab-3609-4ea6-98f6-e77bc6495ca3","Type":"ContainerDied","Data":"ed0055fb76bf68ee362b8c8a05c0abd4adcf1528eed06e8229f807be5f1dfec1"} Jun 11 15:42:57.691376 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.691071 2576 scope.go:117] "RemoveContainer" containerID="cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25" Jun 11 15:42:57.699765 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.699743 2576 scope.go:117] "RemoveContainer" containerID="cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25" Jun 11 15:42:57.700043 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:42:57.700025 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25\": container with ID starting with cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25 not found: ID does not exist" containerID="cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25" Jun 11 15:42:57.700093 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.700052 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25"} err="failed to get container status \"cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25\": rpc error: code = NotFound desc = could not find container \"cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25\": container with ID starting with cf733265bb5c44dd5c75bda02eb994b981359f7d1c63719d9f97eb2db803ce25 not found: ID does not exist" Jun 11 15:42:57.707887 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.707859 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4ttxq"] Jun 11 15:42:57.711966 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:57.711942 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4ttxq"] Jun 11 15:42:59.197321 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:42:59.197292 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e261afab-3609-4ea6-98f6-e77bc6495ca3" path="/var/lib/kubelet/pods/e261afab-3609-4ea6-98f6-e77bc6495ca3/volumes" Jun 11 15:43:03.802447 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:03.802412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:43:03.802867 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:03.802479 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:43:03.824282 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:03.824257 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:43:04.744809 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:04.744783 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fn7xm" Jun 11 15:43:24.357938 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.357904 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx"] Jun 11 15:43:24.358407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.358256 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e261afab-3609-4ea6-98f6-e77bc6495ca3" containerName="registry-server" Jun 11 15:43:24.358407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.358267 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e261afab-3609-4ea6-98f6-e77bc6495ca3" containerName="registry-server" Jun 11 15:43:24.358407 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.358325 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e261afab-3609-4ea6-98f6-e77bc6495ca3" containerName="registry-server" Jun 11 15:43:24.360583 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.360569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:24.363510 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.363492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8g9d6\"" Jun 11 15:43:24.372612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.372589 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx"] Jun 11 15:43:24.534182 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.534145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l854\" (UniqueName: \"kubernetes.io/projected/52a582de-1e90-43b1-a0ee-7823abe51e04-kube-api-access-6l854\") pod \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" (UID: \"52a582de-1e90-43b1-a0ee-7823abe51e04\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:24.635642 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.635547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l854\" (UniqueName: \"kubernetes.io/projected/52a582de-1e90-43b1-a0ee-7823abe51e04-kube-api-access-6l854\") pod \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" (UID: \"52a582de-1e90-43b1-a0ee-7823abe51e04\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:24.661324 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.661290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l854\" (UniqueName: \"kubernetes.io/projected/52a582de-1e90-43b1-a0ee-7823abe51e04-kube-api-access-6l854\") pod \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" (UID: \"52a582de-1e90-43b1-a0ee-7823abe51e04\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:24.669971 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.669949 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:24.805101 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:24.805077 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx"] Jun 11 15:43:24.807339 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:43:24.807311 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a582de_1e90_43b1_a0ee_7823abe51e04.slice/crio-1200a672c44acba169c2d3c9053bf0e28d6c8c72976954669b816f1bff26f563 WatchSource:0}: Error finding container 1200a672c44acba169c2d3c9053bf0e28d6c8c72976954669b816f1bff26f563: Status 404 returned error can't find the container with id 1200a672c44acba169c2d3c9053bf0e28d6c8c72976954669b816f1bff26f563 Jun 11 15:43:25.816209 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:25.816177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" event={"ID":"52a582de-1e90-43b1-a0ee-7823abe51e04","Type":"ContainerStarted","Data":"1200a672c44acba169c2d3c9053bf0e28d6c8c72976954669b816f1bff26f563"} Jun 11 15:43:27.827495 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:27.827455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" event={"ID":"52a582de-1e90-43b1-a0ee-7823abe51e04","Type":"ContainerStarted","Data":"9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f"} Jun 11 15:43:27.827882 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:27.827595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:32.132177 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.132096 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" podStartSLOduration=6.14004715 podStartE2EDuration="8.132073202s" totalImagesPullingTime="1.992026052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:43:27.882716902 +0000 UTC m=+681.156543969" watchObservedRunningTime="2026-06-11 15:43:32.132073202 +0000 UTC m=+685.405900245" Jun 11 15:43:32.134560 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.134535 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q"] Jun 11 15:43:32.138074 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.138057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:32.140485 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.140463 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gw9hx\"" Jun 11 15:43:32.148133 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.148098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q"] Jun 11 15:43:32.196707 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.196679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8frwc\" (UniqueName: \"kubernetes.io/projected/4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43-kube-api-access-8frwc\") pod \"authorino-operator-75cc8d5cb7-b2q5q\" (UID: \"4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:32.297691 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.297655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8frwc\" (UniqueName: \"kubernetes.io/projected/4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43-kube-api-access-8frwc\") pod \"authorino-operator-75cc8d5cb7-b2q5q\" (UID: \"4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:32.315614 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.315585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8frwc\" (UniqueName: \"kubernetes.io/projected/4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43-kube-api-access-8frwc\") pod \"authorino-operator-75cc8d5cb7-b2q5q\" (UID: \"4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:32.448904 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.448800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:32.590494 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.590469 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q"] Jun 11 15:43:32.593339 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:43:32.593304 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2a4ae1_b01a_4d35_a7ee_e291ddf7bf43.slice/crio-d54631a09f086d97a3073882c5b6c1a99e962a4393376112375fac37f02e137a WatchSource:0}: Error finding container d54631a09f086d97a3073882c5b6c1a99e962a4393376112375fac37f02e137a: Status 404 returned error can't find the container with id d54631a09f086d97a3073882c5b6c1a99e962a4393376112375fac37f02e137a Jun 11 15:43:32.851093 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:32.851059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" event={"ID":"4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43","Type":"ContainerStarted","Data":"d54631a09f086d97a3073882c5b6c1a99e962a4393376112375fac37f02e137a"} Jun 11 15:43:35.871825 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:35.871788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" event={"ID":"4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43","Type":"ContainerStarted","Data":"f6959f07785f60241f9e255dcd8a0142446a70bbb740b911ac9ac44421b3fff1"} Jun 11 15:43:35.872209 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:35.871852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:35.892374 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:35.892325 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" podStartSLOduration=1.681897607 podStartE2EDuration="3.892310568s" totalImagesPullingTime="2.210412961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:43:35.890786951 +0000 UTC m=+689.164613993" watchObservedRunningTime="2026-06-11 15:43:35.892310568 +0000 UTC m=+689.166137636" Jun 11 15:43:38.833583 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:38.833545 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:46.880521 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:46.880490 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-b2q5q" Jun 11 15:43:50.660769 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.660681 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx"] Jun 11 15:43:50.661203 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.660905 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" containerName="manager" containerID="cri-o://9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f" gracePeriod=2 Jun 11 15:43:50.667761 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.667735 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx"] Jun 11 15:43:50.667946 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:43:50.667915 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:50.701839 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.701805 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb"] Jun 11 15:43:50.702201 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.702176 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" containerName="manager" Jun 11 15:43:50.702201 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.702193 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" containerName="manager" Jun 11 15:43:50.702387 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.702267 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" containerName="manager" Jun 11 15:43:50.705393 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.705364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:43:50.715343 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:43:50.715305 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:50.731756 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.731725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb"] Jun 11 15:43:50.757175 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.757110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7phm\" (UniqueName: \"kubernetes.io/projected/42303550-c605-4173-81c0-b83f218f41bb-kube-api-access-h7phm\") pod \"limitador-operator-controller-manager-859d7b78bd-2pnvb\" (UID: \"42303550-c605-4173-81c0-b83f218f41bb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:43:50.857687 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.857649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7phm\" (UniqueName: \"kubernetes.io/projected/42303550-c605-4173-81c0-b83f218f41bb-kube-api-access-h7phm\") pod \"limitador-operator-controller-manager-859d7b78bd-2pnvb\" (UID: \"42303550-c605-4173-81c0-b83f218f41bb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:43:50.868867 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.868830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7phm\" (UniqueName: \"kubernetes.io/projected/42303550-c605-4173-81c0-b83f218f41bb-kube-api-access-h7phm\") pod \"limitador-operator-controller-manager-859d7b78bd-2pnvb\" (UID: \"42303550-c605-4173-81c0-b83f218f41bb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:43:50.921994 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.921908 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:50.925243 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:43:50.925204 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:50.955982 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.955949 2576 generic.go:356] "Generic (PLEG): container finished" podID="52a582de-1e90-43b1-a0ee-7823abe51e04" containerID="9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f" exitCode=0 Jun 11 15:43:50.956162 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.955992 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:50.956162 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.956054 2576 scope.go:117] "RemoveContainer" containerID="9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f" Jun 11 15:43:50.958255 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.958238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l854\" (UniqueName: \"kubernetes.io/projected/52a582de-1e90-43b1-a0ee-7823abe51e04-kube-api-access-6l854\") pod \"52a582de-1e90-43b1-a0ee-7823abe51e04\" (UID: \"52a582de-1e90-43b1-a0ee-7823abe51e04\") " Jun 11 15:43:50.960278 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.960248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a582de-1e90-43b1-a0ee-7823abe51e04-kube-api-access-6l854" (OuterVolumeSpecName: "kube-api-access-6l854") pod "52a582de-1e90-43b1-a0ee-7823abe51e04" (UID: "52a582de-1e90-43b1-a0ee-7823abe51e04"). InnerVolumeSpecName "kube-api-access-6l854". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:43:50.965385 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:43:50.965359 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vw5fx\" is forbidden: User \"system:node:ip-10-0-133-9.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-9.ec2.internal' and this object" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vw5fx" Jun 11 15:43:50.972218 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.972173 2576 scope.go:117] "RemoveContainer" containerID="9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f" Jun 11 15:43:50.972581 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:43:50.972560 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f\": container with ID starting with 9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f not found: ID does not exist" containerID="9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f" Jun 11 15:43:50.972633 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:50.972595 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f"} err="failed to get container status \"9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f\": rpc error: code = NotFound desc = could not find container \"9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f\": container with ID starting with 9d4c457f5ab29dc3cdac8697b32f6542ebbcdf1a40d514648beee499cea00d2f not found: ID does not exist" Jun 11 15:43:51.041917 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.041875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:43:51.059297 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.059265 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l854\" (UniqueName: \"kubernetes.io/projected/52a582de-1e90-43b1-a0ee-7823abe51e04-kube-api-access-6l854\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:43:51.195669 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.195584 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a582de-1e90-43b1-a0ee-7823abe51e04" path="/var/lib/kubelet/pods/52a582de-1e90-43b1-a0ee-7823abe51e04/volumes" Jun 11 15:43:51.207032 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.207008 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb"] Jun 11 15:43:51.963320 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.963287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" event={"ID":"42303550-c605-4173-81c0-b83f218f41bb","Type":"ContainerStarted","Data":"dda801ab6cd97d3b4f1d50804e1fc812dfed3cf525ec0ec7321508c0ccfb6d86"} Jun 11 15:43:51.963702 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.963362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" event={"ID":"42303550-c605-4173-81c0-b83f218f41bb","Type":"ContainerStarted","Data":"6288f8f4b24c985c434b8cc24d9041d76fed5607cfc289315909f2472fe62a3b"} Jun 11 15:43:51.963702 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.963401 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:43:51.987823 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:43:51.987771 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" podStartSLOduration=1.987755664 podStartE2EDuration="1.987755664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:43:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:43:51.986654197 +0000 UTC m=+705.260481249" watchObservedRunningTime="2026-06-11 15:43:51.987755664 +0000 UTC m=+705.261582705" Jun 11 15:44:02.970449 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:02.970416 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2pnvb" Jun 11 15:44:19.350699 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.350665 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj"] Jun 11 15:44:19.357523 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.357502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.360495 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.360471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-c5wsq\"" Jun 11 15:44:19.367210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.367189 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj"] Jun 11 15:44:19.420350 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420494 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420494 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420494 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns4px\" (UniqueName: \"kubernetes.io/projected/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-kube-api-access-ns4px\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420637 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420637 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420637 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420637 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.420758 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.420653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521023 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.520991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521023 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521029 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns4px\" (UniqueName: \"kubernetes.io/projected/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-kube-api-access-ns4px\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521629 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.521957 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.522033 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.521955 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.522093 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.522060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.523404 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.523381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.523682 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.523664 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.530165 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.530101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.530316 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.530294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns4px\" (UniqueName: \"kubernetes.io/projected/f54fa715-0ad2-43a0-bc7a-750bc9c2525c-kube-api-access-ns4px\") pod \"maas-default-gateway-openshift-default-687ff6996-nfngj\" (UID: \"f54fa715-0ad2-43a0-bc7a-750bc9c2525c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.668664 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.668580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:19.813983 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.813883 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj"] Jun 11 15:44:19.816310 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:44:19.816284 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54fa715_0ad2_43a0_bc7a_750bc9c2525c.slice/crio-5280c70a78b00098c4e73ef1b1259b13841540e58d49f0f0799f1f6e02880139 WatchSource:0}: Error finding container 5280c70a78b00098c4e73ef1b1259b13841540e58d49f0f0799f1f6e02880139: Status 404 returned error can't find the container with id 5280c70a78b00098c4e73ef1b1259b13841540e58d49f0f0799f1f6e02880139 Jun 11 15:44:19.818342 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.818308 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:44:19.818423 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.818371 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:44:19.818423 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:19.818401 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:44:20.098537 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:20.098503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" event={"ID":"f54fa715-0ad2-43a0-bc7a-750bc9c2525c","Type":"ContainerStarted","Data":"bed9621a0124c7a80dfeb044d6790f525d535d62cb3515d97a680b1b4255f0fe"} Jun 11 15:44:20.098728 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:20.098573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" event={"ID":"f54fa715-0ad2-43a0-bc7a-750bc9c2525c","Type":"ContainerStarted","Data":"5280c70a78b00098c4e73ef1b1259b13841540e58d49f0f0799f1f6e02880139"} Jun 11 15:44:20.123679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:20.123609 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" podStartSLOduration=1.123588176 podStartE2EDuration="1.123588176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:44:20.122930745 +0000 UTC m=+733.396757785" watchObservedRunningTime="2026-06-11 15:44:20.123588176 +0000 UTC m=+733.397415217" Jun 11 15:44:20.669037 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:20.669002 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:20.673674 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:20.673650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:21.104188 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:21.104161 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:21.105197 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:21.105181 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:44:22.060810 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.060776 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqqmv"] Jun 11 15:44:22.064270 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.064250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:44:22.067018 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.066995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l96hq\"" Jun 11 15:44:22.073964 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.073937 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqqmv"] Jun 11 15:44:22.142545 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.142515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lbbf\" (UniqueName: \"kubernetes.io/projected/4badc096-abde-4303-86d6-fe99b0474c8a-kube-api-access-9lbbf\") pod \"authorino-75d556bd77-sqqmv\" (UID: \"4badc096-abde-4303-86d6-fe99b0474c8a\") " pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:44:22.243703 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.243663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lbbf\" (UniqueName: \"kubernetes.io/projected/4badc096-abde-4303-86d6-fe99b0474c8a-kube-api-access-9lbbf\") pod \"authorino-75d556bd77-sqqmv\" (UID: \"4badc096-abde-4303-86d6-fe99b0474c8a\") " pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:44:22.252440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.252416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lbbf\" (UniqueName: \"kubernetes.io/projected/4badc096-abde-4303-86d6-fe99b0474c8a-kube-api-access-9lbbf\") pod \"authorino-75d556bd77-sqqmv\" (UID: \"4badc096-abde-4303-86d6-fe99b0474c8a\") " pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:44:22.392621 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.392590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:44:22.530208 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:22.530176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqqmv"] Jun 11 15:44:22.533903 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:44:22.533871 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4badc096_abde_4303_86d6_fe99b0474c8a.slice/crio-dc058ddba40f39c6250ab450bf753507b8cc1e231c5424f9358bec4fc94157b0 WatchSource:0}: Error finding container dc058ddba40f39c6250ab450bf753507b8cc1e231c5424f9358bec4fc94157b0: Status 404 returned error can't find the container with id dc058ddba40f39c6250ab450bf753507b8cc1e231c5424f9358bec4fc94157b0 Jun 11 15:44:23.116660 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:23.116620 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqqmv" event={"ID":"4badc096-abde-4303-86d6-fe99b0474c8a","Type":"ContainerStarted","Data":"dc058ddba40f39c6250ab450bf753507b8cc1e231c5424f9358bec4fc94157b0"} Jun 11 15:44:26.136614 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:26.136578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqqmv" event={"ID":"4badc096-abde-4303-86d6-fe99b0474c8a","Type":"ContainerStarted","Data":"d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd"} Jun 11 15:44:26.153938 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:44:26.153887 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sqqmv" podStartSLOduration=1.032857227 podStartE2EDuration="4.153869517s" totalImagesPullingTime="3.12101229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:44:26.152275994 +0000 UTC m=+739.426103036" watchObservedRunningTime="2026-06-11 15:44:26.153869517 +0000 UTC m=+739.427696557" Jun 11 15:45:17.815783 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.815743 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:45:17.822710 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.822687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:17.825540 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.825513 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:45:17.825699 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.825678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:45:17.825764 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.825736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:45:17.826947 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.826928 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-th8v7\"" Jun 11 15:45:17.829229 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.829207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:45:17.871149 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.871078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz5xg\" (UniqueName: \"kubernetes.io/projected/3daa9f4b-6d31-4490-88d6-14a4f38bfb11-kube-api-access-mz5xg\") pod \"maas-keycloak-0\" (UID: \"3daa9f4b-6d31-4490-88d6-14a4f38bfb11\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:17.972009 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.971969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz5xg\" (UniqueName: \"kubernetes.io/projected/3daa9f4b-6d31-4490-88d6-14a4f38bfb11-kube-api-access-mz5xg\") pod \"maas-keycloak-0\" (UID: \"3daa9f4b-6d31-4490-88d6-14a4f38bfb11\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:17.981413 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:17.981387 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz5xg\" (UniqueName: \"kubernetes.io/projected/3daa9f4b-6d31-4490-88d6-14a4f38bfb11-kube-api-access-mz5xg\") pod \"maas-keycloak-0\" (UID: \"3daa9f4b-6d31-4490-88d6-14a4f38bfb11\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:18.133495 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:18.133452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:18.272935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:18.272888 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:45:18.275700 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:45:18.275669 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3daa9f4b_6d31_4490_88d6_14a4f38bfb11.slice/crio-6070c7210fdcd5d8556d9ae238ba5dc0588c33709834f88336501ba3a53fefe7 WatchSource:0}: Error finding container 6070c7210fdcd5d8556d9ae238ba5dc0588c33709834f88336501ba3a53fefe7: Status 404 returned error can't find the container with id 6070c7210fdcd5d8556d9ae238ba5dc0588c33709834f88336501ba3a53fefe7 Jun 11 15:45:18.409908 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:18.409822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3daa9f4b-6d31-4490-88d6-14a4f38bfb11","Type":"ContainerStarted","Data":"6070c7210fdcd5d8556d9ae238ba5dc0588c33709834f88336501ba3a53fefe7"} Jun 11 15:45:23.440810 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:23.440741 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3daa9f4b-6d31-4490-88d6-14a4f38bfb11","Type":"ContainerStarted","Data":"3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea"} Jun 11 15:45:23.460555 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:23.460505 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.510685447 podStartE2EDuration="6.460488763s" totalImagesPullingTime="4.949803316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:45:23.458055754 +0000 UTC m=+796.731882795" watchObservedRunningTime="2026-06-11 15:45:23.460488763 +0000 UTC m=+796.734315803" Jun 11 15:45:24.134753 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:24.134698 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:24.136919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:24.136879 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:25.134960 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:25.134892 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:26.134852 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:26.134808 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:27.134658 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:27.134609 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:28.134993 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:28.134279 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:28.134993 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:28.134630 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:29.134646 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:29.134600 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:30.135159 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:30.135096 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:31.134921 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:31.134862 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:32.134113 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:32.134045 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:33.134682 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:33.134631 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:34.134504 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:34.134453 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:35.134630 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:35.134589 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:36.134302 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:36.134252 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 11 15:45:37.269010 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:37.268968 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:37.285888 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:37.285851 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:45:47.276296 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:47.276253 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:45:50.181101 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.181067 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqqmv"] Jun 11 15:45:50.181634 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.181256 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sqqmv" podUID="4badc096-abde-4303-86d6-fe99b0474c8a" containerName="authorino" containerID="cri-o://d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd" gracePeriod=30 Jun 11 15:45:50.438415 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.438352 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:45:50.503331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.503301 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lbbf\" (UniqueName: \"kubernetes.io/projected/4badc096-abde-4303-86d6-fe99b0474c8a-kube-api-access-9lbbf\") pod \"4badc096-abde-4303-86d6-fe99b0474c8a\" (UID: \"4badc096-abde-4303-86d6-fe99b0474c8a\") " Jun 11 15:45:50.505441 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.505409 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4badc096-abde-4303-86d6-fe99b0474c8a-kube-api-access-9lbbf" (OuterVolumeSpecName: "kube-api-access-9lbbf") pod "4badc096-abde-4303-86d6-fe99b0474c8a" (UID: "4badc096-abde-4303-86d6-fe99b0474c8a"). InnerVolumeSpecName "kube-api-access-9lbbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:45:50.604288 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.604247 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lbbf\" (UniqueName: \"kubernetes.io/projected/4badc096-abde-4303-86d6-fe99b0474c8a-kube-api-access-9lbbf\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:45:50.618331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.618295 2576 generic.go:356] "Generic (PLEG): container finished" podID="4badc096-abde-4303-86d6-fe99b0474c8a" containerID="d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd" exitCode=0 Jun 11 15:45:50.618331 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.618334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqqmv" event={"ID":"4badc096-abde-4303-86d6-fe99b0474c8a","Type":"ContainerDied","Data":"d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd"} Jun 11 15:45:50.618525 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.618337 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sqqmv" Jun 11 15:45:50.618525 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.618360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sqqmv" event={"ID":"4badc096-abde-4303-86d6-fe99b0474c8a","Type":"ContainerDied","Data":"dc058ddba40f39c6250ab450bf753507b8cc1e231c5424f9358bec4fc94157b0"} Jun 11 15:45:50.618525 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.618377 2576 scope.go:117] "RemoveContainer" containerID="d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd" Jun 11 15:45:50.627129 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.627094 2576 scope.go:117] "RemoveContainer" containerID="d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd" Jun 11 15:45:50.627427 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:45:50.627408 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd\": container with ID starting with d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd not found: ID does not exist" containerID="d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd" Jun 11 15:45:50.627481 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.627436 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd"} err="failed to get container status \"d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd\": rpc error: code = NotFound desc = could not find container \"d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd\": container with ID starting with d3d5e51736ec4a99e88d5eb90348d477bded0bd2bd27586a9b7ff5ce0a7b1fbd not found: ID does not exist" Jun 11 15:45:50.639283 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.639255 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqqmv"] Jun 11 15:45:50.643364 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:50.643342 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sqqmv"] Jun 11 15:45:51.195216 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:51.195183 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4badc096-abde-4303-86d6-fe99b0474c8a" path="/var/lib/kubelet/pods/4badc096-abde-4303-86d6-fe99b0474c8a/volumes" Jun 11 15:45:53.646175 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.646148 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57f6cfdc47-2zc7f"] Jun 11 15:45:53.646538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.646524 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4badc096-abde-4303-86d6-fe99b0474c8a" containerName="authorino" Jun 11 15:45:53.646538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.646536 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4badc096-abde-4303-86d6-fe99b0474c8a" containerName="authorino" Jun 11 15:45:53.646612 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.646595 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4badc096-abde-4303-86d6-fe99b0474c8a" containerName="authorino" Jun 11 15:45:53.648900 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.648882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.651792 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.651770 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 15:45:53.651960 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.651941 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d465r\"" Jun 11 15:45:53.652015 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.651973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 15:45:53.664514 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.664490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f6cfdc47-2zc7f"] Jun 11 15:45:53.732866 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.732834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/377bffa8-781b-4e97-9147-075f3a11a8e9-webhook-cert\") pod \"maas-controller-57f6cfdc47-2zc7f\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.732866 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.732866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmtb\" (UniqueName: \"kubernetes.io/projected/377bffa8-781b-4e97-9147-075f3a11a8e9-kube-api-access-ggmtb\") pod \"maas-controller-57f6cfdc47-2zc7f\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.830254 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.830223 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56657c54b7-mgzr2"] Jun 11 15:45:53.832864 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.832843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:53.833373 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.833350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/377bffa8-781b-4e97-9147-075f3a11a8e9-webhook-cert\") pod \"maas-controller-57f6cfdc47-2zc7f\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.833447 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.833380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmtb\" (UniqueName: \"kubernetes.io/projected/377bffa8-781b-4e97-9147-075f3a11a8e9-kube-api-access-ggmtb\") pod \"maas-controller-57f6cfdc47-2zc7f\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.835877 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.835855 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/377bffa8-781b-4e97-9147-075f3a11a8e9-webhook-cert\") pod \"maas-controller-57f6cfdc47-2zc7f\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.843622 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.843595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56657c54b7-mgzr2"] Jun 11 15:45:53.845856 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.845833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmtb\" (UniqueName: \"kubernetes.io/projected/377bffa8-781b-4e97-9147-075f3a11a8e9-kube-api-access-ggmtb\") pod \"maas-controller-57f6cfdc47-2zc7f\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:53.934841 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.934747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs25c\" (UniqueName: \"kubernetes.io/projected/89d83449-9a11-4802-93ac-9654e345232e-kube-api-access-vs25c\") pod \"maas-controller-56657c54b7-mgzr2\" (UID: \"89d83449-9a11-4802-93ac-9654e345232e\") " pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:53.934841 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.934820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89d83449-9a11-4802-93ac-9654e345232e-webhook-cert\") pod \"maas-controller-56657c54b7-mgzr2\" (UID: \"89d83449-9a11-4802-93ac-9654e345232e\") " pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:53.959310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:53.959277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:54.036379 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.036342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs25c\" (UniqueName: \"kubernetes.io/projected/89d83449-9a11-4802-93ac-9654e345232e-kube-api-access-vs25c\") pod \"maas-controller-56657c54b7-mgzr2\" (UID: \"89d83449-9a11-4802-93ac-9654e345232e\") " pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:54.036528 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.036395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89d83449-9a11-4802-93ac-9654e345232e-webhook-cert\") pod \"maas-controller-56657c54b7-mgzr2\" (UID: \"89d83449-9a11-4802-93ac-9654e345232e\") " pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:54.038737 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.038716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89d83449-9a11-4802-93ac-9654e345232e-webhook-cert\") pod \"maas-controller-56657c54b7-mgzr2\" (UID: \"89d83449-9a11-4802-93ac-9654e345232e\") " pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:54.045867 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.045761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs25c\" (UniqueName: \"kubernetes.io/projected/89d83449-9a11-4802-93ac-9654e345232e-kube-api-access-vs25c\") pod \"maas-controller-56657c54b7-mgzr2\" (UID: \"89d83449-9a11-4802-93ac-9654e345232e\") " pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:54.095547 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.095519 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f6cfdc47-2zc7f"] Jun 11 15:45:54.098018 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:45:54.097981 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377bffa8_781b_4e97_9147_075f3a11a8e9.slice/crio-e29812007142f0110794c38a2c03254ef6f4bb1ae857f3f49fcfa6e42f96a622 WatchSource:0}: Error finding container e29812007142f0110794c38a2c03254ef6f4bb1ae857f3f49fcfa6e42f96a622: Status 404 returned error can't find the container with id e29812007142f0110794c38a2c03254ef6f4bb1ae857f3f49fcfa6e42f96a622 Jun 11 15:45:54.163582 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.163538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:54.296175 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.296144 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56657c54b7-mgzr2"] Jun 11 15:45:54.298278 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:45:54.298255 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d83449_9a11_4802_93ac_9654e345232e.slice/crio-98acbc32bb88e05e30659f38d9dd18eac527c1ade10a4833ab9cc9e6c98a60e5 WatchSource:0}: Error finding container 98acbc32bb88e05e30659f38d9dd18eac527c1ade10a4833ab9cc9e6c98a60e5: Status 404 returned error can't find the container with id 98acbc32bb88e05e30659f38d9dd18eac527c1ade10a4833ab9cc9e6c98a60e5 Jun 11 15:45:54.640492 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.640446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56657c54b7-mgzr2" event={"ID":"89d83449-9a11-4802-93ac-9654e345232e","Type":"ContainerStarted","Data":"98acbc32bb88e05e30659f38d9dd18eac527c1ade10a4833ab9cc9e6c98a60e5"} Jun 11 15:45:54.641957 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:54.641923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" event={"ID":"377bffa8-781b-4e97-9147-075f3a11a8e9","Type":"ContainerStarted","Data":"e29812007142f0110794c38a2c03254ef6f4bb1ae857f3f49fcfa6e42f96a622"} Jun 11 15:45:57.661265 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:57.661229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56657c54b7-mgzr2" event={"ID":"89d83449-9a11-4802-93ac-9654e345232e","Type":"ContainerStarted","Data":"088193ba96cc3339a4f3176bc1398d65d2a9d9b512d434940bbcfde89d10c1ff"} Jun 11 15:45:57.661748 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:57.661333 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:45:57.662818 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:57.662794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" event={"ID":"377bffa8-781b-4e97-9147-075f3a11a8e9","Type":"ContainerStarted","Data":"6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c"} Jun 11 15:45:57.662937 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:57.662835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:45:57.681272 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:57.681228 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56657c54b7-mgzr2" podStartSLOduration=2.228907815 podStartE2EDuration="4.681212815s" totalImagesPullingTime="2.452305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:45:57.680358647 +0000 UTC m=+830.954185688" watchObservedRunningTime="2026-06-11 15:45:57.681212815 +0000 UTC m=+830.955039895" Jun 11 15:45:57.700091 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:45:57.700045 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" podStartSLOduration=2.053871396 podStartE2EDuration="4.700029607s" totalImagesPullingTime="2.646158211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:45:57.699668094 +0000 UTC m=+830.973495135" watchObservedRunningTime="2026-06-11 15:45:57.700029607 +0000 UTC m=+830.973856648" Jun 11 15:46:08.675821 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:08.675787 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56657c54b7-mgzr2" Jun 11 15:46:08.676356 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:08.675859 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:46:08.740944 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:08.740907 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57f6cfdc47-2zc7f"] Jun 11 15:46:08.741199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:08.741171 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" podUID="377bffa8-781b-4e97-9147-075f3a11a8e9" containerName="manager" containerID="cri-o://6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c" gracePeriod=30 Jun 11 15:46:08.985060 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:08.985038 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:46:09.076511 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.076483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/377bffa8-781b-4e97-9147-075f3a11a8e9-webhook-cert\") pod \"377bffa8-781b-4e97-9147-075f3a11a8e9\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " Jun 11 15:46:09.076713 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.076548 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggmtb\" (UniqueName: \"kubernetes.io/projected/377bffa8-781b-4e97-9147-075f3a11a8e9-kube-api-access-ggmtb\") pod \"377bffa8-781b-4e97-9147-075f3a11a8e9\" (UID: \"377bffa8-781b-4e97-9147-075f3a11a8e9\") " Jun 11 15:46:09.078850 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.078808 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/377bffa8-781b-4e97-9147-075f3a11a8e9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "377bffa8-781b-4e97-9147-075f3a11a8e9" (UID: "377bffa8-781b-4e97-9147-075f3a11a8e9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:46:09.078981 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.078864 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377bffa8-781b-4e97-9147-075f3a11a8e9-kube-api-access-ggmtb" (OuterVolumeSpecName: "kube-api-access-ggmtb") pod "377bffa8-781b-4e97-9147-075f3a11a8e9" (UID: "377bffa8-781b-4e97-9147-075f3a11a8e9"). InnerVolumeSpecName "kube-api-access-ggmtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:46:09.177674 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.177639 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/377bffa8-781b-4e97-9147-075f3a11a8e9-webhook-cert\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:46:09.177674 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.177667 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggmtb\" (UniqueName: \"kubernetes.io/projected/377bffa8-781b-4e97-9147-075f3a11a8e9-kube-api-access-ggmtb\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:46:09.724825 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.724782 2576 generic.go:356] "Generic (PLEG): container finished" podID="377bffa8-781b-4e97-9147-075f3a11a8e9" containerID="6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c" exitCode=0 Jun 11 15:46:09.725301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.724841 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" Jun 11 15:46:09.725301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.724868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" event={"ID":"377bffa8-781b-4e97-9147-075f3a11a8e9","Type":"ContainerDied","Data":"6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c"} Jun 11 15:46:09.725301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.724965 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f6cfdc47-2zc7f" event={"ID":"377bffa8-781b-4e97-9147-075f3a11a8e9","Type":"ContainerDied","Data":"e29812007142f0110794c38a2c03254ef6f4bb1ae857f3f49fcfa6e42f96a622"} Jun 11 15:46:09.725301 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.724994 2576 scope.go:117] "RemoveContainer" containerID="6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c" Jun 11 15:46:09.734829 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.734811 2576 scope.go:117] "RemoveContainer" containerID="6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c" Jun 11 15:46:09.735104 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:46:09.735084 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c\": container with ID starting with 6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c not found: ID does not exist" containerID="6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c" Jun 11 15:46:09.735205 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.735112 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c"} err="failed to get container status \"6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c\": rpc error: code = NotFound desc = could not find container \"6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c\": container with ID starting with 6194a29e6eb3b82d5a65136e7d45fc6f90d6eb2833305e95b0e12d3d3fb8f90c not found: ID does not exist" Jun 11 15:46:09.743934 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.743908 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57f6cfdc47-2zc7f"] Jun 11 15:46:09.748057 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:09.748021 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57f6cfdc47-2zc7f"] Jun 11 15:46:11.195400 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:11.195368 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377bffa8-781b-4e97-9147-075f3a11a8e9" path="/var/lib/kubelet/pods/377bffa8-781b-4e97-9147-075f3a11a8e9/volumes" Jun 11 15:46:30.254285 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.254251 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d78b8fd58-l6bbc"] Jun 11 15:46:30.254749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.254653 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377bffa8-781b-4e97-9147-075f3a11a8e9" containerName="manager" Jun 11 15:46:30.254749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.254664 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="377bffa8-781b-4e97-9147-075f3a11a8e9" containerName="manager" Jun 11 15:46:30.254749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.254720 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="377bffa8-781b-4e97-9147-075f3a11a8e9" containerName="manager" Jun 11 15:46:30.259358 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.259339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.262188 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.262158 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 15:46:30.262327 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.262212 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-b7cpn\"" Jun 11 15:46:30.267959 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.267934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d78b8fd58-l6bbc"] Jun 11 15:46:30.376669 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.376638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a37d0c98-55e8-4bad-b98b-68376d38e085-maas-api-tls\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.376844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.376674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a37d0c98-55e8-4bad-b98b-68376d38e085-openshift-service-ca\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.376844 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.376746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-555vx\" (UniqueName: \"kubernetes.io/projected/a37d0c98-55e8-4bad-b98b-68376d38e085-kube-api-access-555vx\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.477553 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.477518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a37d0c98-55e8-4bad-b98b-68376d38e085-maas-api-tls\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.477553 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.477557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a37d0c98-55e8-4bad-b98b-68376d38e085-openshift-service-ca\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.477761 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.477593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-555vx\" (UniqueName: \"kubernetes.io/projected/a37d0c98-55e8-4bad-b98b-68376d38e085-kube-api-access-555vx\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.478285 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.478263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a37d0c98-55e8-4bad-b98b-68376d38e085-openshift-service-ca\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.480096 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.480069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a37d0c98-55e8-4bad-b98b-68376d38e085-maas-api-tls\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.485747 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.485723 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-555vx\" (UniqueName: \"kubernetes.io/projected/a37d0c98-55e8-4bad-b98b-68376d38e085-kube-api-access-555vx\") pod \"maas-api-5d78b8fd58-l6bbc\" (UID: \"a37d0c98-55e8-4bad-b98b-68376d38e085\") " pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.571012 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.570917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:30.645199 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.645173 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-9vpmr"] Jun 11 15:46:30.648592 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.648574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:46:30.651329 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.651303 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 15:46:30.659428 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.659349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-9vpmr"] Jun 11 15:46:30.680203 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.680174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8fv\" (UniqueName: \"kubernetes.io/projected/cab4b2ca-3bd7-4fcb-9148-cf534b044976-kube-api-access-dx8fv\") pod \"payload-pre-processing-579785bc64-9vpmr\" (UID: \"cab4b2ca-3bd7-4fcb-9148-cf534b044976\") " pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:46:30.701210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.701151 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-27bz5"] Jun 11 15:46:30.704064 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.704048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:30.706696 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.706673 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n7gkm\"" Jun 11 15:46:30.714993 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.714958 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-27bz5"] Jun 11 15:46:30.717495 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.717471 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d78b8fd58-l6bbc"] Jun 11 15:46:30.720735 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:46:30.720712 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37d0c98_55e8_4bad_b98b_68376d38e085.slice/crio-58f7c54d7b7376343a6975185a1e317f8c6f3aabdb87a806e79a7bc76188b301 WatchSource:0}: Error finding container 58f7c54d7b7376343a6975185a1e317f8c6f3aabdb87a806e79a7bc76188b301: Status 404 returned error can't find the container with id 58f7c54d7b7376343a6975185a1e317f8c6f3aabdb87a806e79a7bc76188b301 Jun 11 15:46:30.781503 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.781464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrh2\" (UniqueName: \"kubernetes.io/projected/8097c86c-fcca-4411-9d0b-805eb6285a51-kube-api-access-9hrh2\") pod \"payload-processing-699b6cd6c-27bz5\" (UID: \"8097c86c-fcca-4411-9d0b-805eb6285a51\") " pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:30.781672 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.781541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8fv\" (UniqueName: \"kubernetes.io/projected/cab4b2ca-3bd7-4fcb-9148-cf534b044976-kube-api-access-dx8fv\") pod \"payload-pre-processing-579785bc64-9vpmr\" (UID: \"cab4b2ca-3bd7-4fcb-9148-cf534b044976\") " pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:46:30.792679 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.792645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8fv\" (UniqueName: \"kubernetes.io/projected/cab4b2ca-3bd7-4fcb-9148-cf534b044976-kube-api-access-dx8fv\") pod \"payload-pre-processing-579785bc64-9vpmr\" (UID: \"cab4b2ca-3bd7-4fcb-9148-cf534b044976\") " pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:46:30.831975 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.831884 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" event={"ID":"a37d0c98-55e8-4bad-b98b-68376d38e085","Type":"ContainerStarted","Data":"58f7c54d7b7376343a6975185a1e317f8c6f3aabdb87a806e79a7bc76188b301"} Jun 11 15:46:30.882226 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.882194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrh2\" (UniqueName: \"kubernetes.io/projected/8097c86c-fcca-4411-9d0b-805eb6285a51-kube-api-access-9hrh2\") pod \"payload-processing-699b6cd6c-27bz5\" (UID: \"8097c86c-fcca-4411-9d0b-805eb6285a51\") " pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:30.890761 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.890734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrh2\" (UniqueName: \"kubernetes.io/projected/8097c86c-fcca-4411-9d0b-805eb6285a51-kube-api-access-9hrh2\") pod \"payload-processing-699b6cd6c-27bz5\" (UID: \"8097c86c-fcca-4411-9d0b-805eb6285a51\") " pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:30.963622 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:30.963588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:46:31.015572 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:31.015542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:31.110320 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:31.110296 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-9vpmr"] Jun 11 15:46:31.113217 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:46:31.113174 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab4b2ca_3bd7_4fcb_9148_cf534b044976.slice/crio-4b537ce8c39f68f1c4044a9967a5b6af12f12f15f132b0355c0e9ed73c3341ee WatchSource:0}: Error finding container 4b537ce8c39f68f1c4044a9967a5b6af12f12f15f132b0355c0e9ed73c3341ee: Status 404 returned error can't find the container with id 4b537ce8c39f68f1c4044a9967a5b6af12f12f15f132b0355c0e9ed73c3341ee Jun 11 15:46:31.172440 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:31.172416 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-27bz5"] Jun 11 15:46:31.174750 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:46:31.174710 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8097c86c_fcca_4411_9d0b_805eb6285a51.slice/crio-9346d91e07343e14b6c17377ee44907ce89a88020eb7958c4d3adeaf6495c205 WatchSource:0}: Error finding container 9346d91e07343e14b6c17377ee44907ce89a88020eb7958c4d3adeaf6495c205: Status 404 returned error can't find the container with id 9346d91e07343e14b6c17377ee44907ce89a88020eb7958c4d3adeaf6495c205 Jun 11 15:46:31.860628 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:31.860536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" event={"ID":"8097c86c-fcca-4411-9d0b-805eb6285a51","Type":"ContainerStarted","Data":"9346d91e07343e14b6c17377ee44907ce89a88020eb7958c4d3adeaf6495c205"} Jun 11 15:46:31.869909 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:31.869838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" event={"ID":"cab4b2ca-3bd7-4fcb-9148-cf534b044976","Type":"ContainerStarted","Data":"4b537ce8c39f68f1c4044a9967a5b6af12f12f15f132b0355c0e9ed73c3341ee"} Jun 11 15:46:33.884148 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:33.884093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" event={"ID":"a37d0c98-55e8-4bad-b98b-68376d38e085","Type":"ContainerStarted","Data":"dd88d968611d8e4eaed4aee1258e26fd21306e75fddd25d612a4cb14134f58ca"} Jun 11 15:46:33.884579 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:33.884281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:33.901461 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:33.901407 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" podStartSLOduration=1.7164386870000001 podStartE2EDuration="3.901388697s" totalImagesPullingTime="2.18495001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:46:33.899519556 +0000 UTC m=+867.173346635" watchObservedRunningTime="2026-06-11 15:46:33.901388697 +0000 UTC m=+867.175215739" Jun 11 15:46:34.890918 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:34.890882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" event={"ID":"8097c86c-fcca-4411-9d0b-805eb6285a51","Type":"ContainerStarted","Data":"dae4d6a8b7431e2f2544aeccf2edfb619e89f5653a3245dac31722ed28ef2393"} Jun 11 15:46:34.891452 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:34.891019 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:34.892536 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:34.892509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" event={"ID":"cab4b2ca-3bd7-4fcb-9148-cf534b044976","Type":"ContainerStarted","Data":"fdccc22288551b45ced4f4c1a1cf972ff367bb264156e7101652c7971798ab40"} Jun 11 15:46:34.892657 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:34.892552 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:46:34.911953 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:34.911896 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" podStartSLOduration=1.5942250759999999 podStartE2EDuration="4.911883999s" totalImagesPullingTime="3.317658923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:46:34.911334039 +0000 UTC m=+868.185161080" watchObservedRunningTime="2026-06-11 15:46:34.911883999 +0000 UTC m=+868.185711039" Jun 11 15:46:34.926324 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:34.926265 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" podStartSLOduration=1.541502521 podStartE2EDuration="4.926247067s" totalImagesPullingTime="3.384744546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:46:34.925689874 +0000 UTC m=+868.199516916" watchObservedRunningTime="2026-06-11 15:46:34.926247067 +0000 UTC m=+868.200074112" Jun 11 15:46:37.147304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:37.147268 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nfngj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 11 15:46:37.147709 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:37.147338 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" podUID="f54fa715-0ad2-43a0-bc7a-750bc9c2525c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 15:46:38.916222 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:38.916189 2576 generic.go:356] "Generic (PLEG): container finished" podID="f54fa715-0ad2-43a0-bc7a-750bc9c2525c" containerID="bed9621a0124c7a80dfeb044d6790f525d535d62cb3515d97a680b1b4255f0fe" exitCode=0 Jun 11 15:46:38.916662 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:38.916230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" event={"ID":"f54fa715-0ad2-43a0-bc7a-750bc9c2525c","Type":"ContainerDied","Data":"bed9621a0124c7a80dfeb044d6790f525d535d62cb3515d97a680b1b4255f0fe"} Jun 11 15:46:38.916662 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:38.916628 2576 scope.go:117] "RemoveContainer" containerID="bed9621a0124c7a80dfeb044d6790f525d535d62cb3515d97a680b1b4255f0fe" Jun 11 15:46:38.917631 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:38.917597 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:46:38.917733 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:38.917669 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:46:38.917733 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:38.917703 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 15:46:39.898526 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:39.898494 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d78b8fd58-l6bbc" Jun 11 15:46:39.924866 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:39.924821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" event={"ID":"f54fa715-0ad2-43a0-bc7a-750bc9c2525c","Type":"ContainerStarted","Data":"fc288c6b004ed89fe4bf695637e099092019b7276a9cc530f79364fbb319a623"} Jun 11 15:46:40.669223 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:40.669181 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:46:40.669435 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:40.669409 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nfngj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 11 15:46:40.669516 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:40.669473 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" podUID="f54fa715-0ad2-43a0-bc7a-750bc9c2525c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 11 15:46:41.669944 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:41.669905 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nfngj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 11 15:46:41.670369 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:41.669963 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" podUID="f54fa715-0ad2-43a0-bc7a-750bc9c2525c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 11 15:46:42.669513 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:42.669469 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nfngj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 11 15:46:42.669704 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:42.669563 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" podUID="f54fa715-0ad2-43a0-bc7a-750bc9c2525c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 11 15:46:43.669416 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:43.669375 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-nfngj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 11 15:46:43.669797 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:43.669432 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" podUID="f54fa715-0ad2-43a0-bc7a-750bc9c2525c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 11 15:46:44.672802 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:44.672770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:46:44.673209 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:44.673044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:46:44.673686 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:44.673669 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-nfngj" Jun 11 15:46:45.899715 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:45.899682 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-27bz5" Jun 11 15:46:45.900102 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:46:45.899805 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-9vpmr" Jun 11 15:47:07.208668 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:47:07.208588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:47:07.209228 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:47:07.209015 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:48:43.995260 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:43.995181 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:48:43.995750 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:43.995378 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" containerID="cri-o://3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea" gracePeriod=30 Jun 11 15:48:45.542839 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.542811 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:45.555190 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.555156 2576 generic.go:356] "Generic (PLEG): container finished" podID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerID="3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea" exitCode=143 Jun 11 15:48:45.555309 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.555207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3daa9f4b-6d31-4490-88d6-14a4f38bfb11","Type":"ContainerDied","Data":"3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea"} Jun 11 15:48:45.555309 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.555248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"3daa9f4b-6d31-4490-88d6-14a4f38bfb11","Type":"ContainerDied","Data":"6070c7210fdcd5d8556d9ae238ba5dc0588c33709834f88336501ba3a53fefe7"} Jun 11 15:48:45.555309 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.555268 2576 scope.go:117] "RemoveContainer" containerID="3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea" Jun 11 15:48:45.555309 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.555207 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:45.565813 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.565791 2576 scope.go:117] "RemoveContainer" containerID="3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea" Jun 11 15:48:45.566190 ip-10-0-133-9 kubenswrapper[2576]: E0611 15:48:45.566158 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea\": container with ID starting with 3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea not found: ID does not exist" containerID="3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea" Jun 11 15:48:45.566275 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.566198 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea"} err="failed to get container status \"3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea\": rpc error: code = NotFound desc = could not find container \"3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea\": container with ID starting with 3e49bdb8a71cf41b93f949a21baa3dd27574c9249c65f94d3835d7f325c4c7ea not found: ID does not exist" Jun 11 15:48:45.650488 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.650403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz5xg\" (UniqueName: \"kubernetes.io/projected/3daa9f4b-6d31-4490-88d6-14a4f38bfb11-kube-api-access-mz5xg\") pod \"3daa9f4b-6d31-4490-88d6-14a4f38bfb11\" (UID: \"3daa9f4b-6d31-4490-88d6-14a4f38bfb11\") " Jun 11 15:48:45.652538 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.652510 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3daa9f4b-6d31-4490-88d6-14a4f38bfb11-kube-api-access-mz5xg" (OuterVolumeSpecName: "kube-api-access-mz5xg") pod "3daa9f4b-6d31-4490-88d6-14a4f38bfb11" (UID: "3daa9f4b-6d31-4490-88d6-14a4f38bfb11"). InnerVolumeSpecName "kube-api-access-mz5xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:48:45.751326 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.751284 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz5xg\" (UniqueName: \"kubernetes.io/projected/3daa9f4b-6d31-4490-88d6-14a4f38bfb11-kube-api-access-mz5xg\") on node \"ip-10-0-133-9.ec2.internal\" DevicePath \"\"" Jun 11 15:48:45.878190 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.878158 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:48:45.881918 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.881894 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:48:45.906845 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.906779 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:48:45.907226 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.907210 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" Jun 11 15:48:45.907297 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.907229 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" Jun 11 15:48:45.907297 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.907292 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" containerName="keycloak" Jun 11 15:48:45.911558 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.911538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:45.914332 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.914306 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 15:48:45.914452 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.914306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-th8v7\"" Jun 11 15:48:45.914452 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.914352 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 15:48:45.914452 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.914367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 15:48:45.914648 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.914635 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 15:48:45.923112 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:45.923087 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:48:46.054754 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.054702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0f77479c-3f54-405b-b14d-a2c032485f39-test-realms\") pod \"maas-keycloak-0\" (UID: \"0f77479c-3f54-405b-b14d-a2c032485f39\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.054754 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.054751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdp4\" (UniqueName: \"kubernetes.io/projected/0f77479c-3f54-405b-b14d-a2c032485f39-kube-api-access-tqdp4\") pod \"maas-keycloak-0\" (UID: \"0f77479c-3f54-405b-b14d-a2c032485f39\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.155549 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.155514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0f77479c-3f54-405b-b14d-a2c032485f39-test-realms\") pod \"maas-keycloak-0\" (UID: \"0f77479c-3f54-405b-b14d-a2c032485f39\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.155549 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.155548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdp4\" (UniqueName: \"kubernetes.io/projected/0f77479c-3f54-405b-b14d-a2c032485f39-kube-api-access-tqdp4\") pod \"maas-keycloak-0\" (UID: \"0f77479c-3f54-405b-b14d-a2c032485f39\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.156249 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.156229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/0f77479c-3f54-405b-b14d-a2c032485f39-test-realms\") pod \"maas-keycloak-0\" (UID: \"0f77479c-3f54-405b-b14d-a2c032485f39\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.164550 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.164484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdp4\" (UniqueName: \"kubernetes.io/projected/0f77479c-3f54-405b-b14d-a2c032485f39-kube-api-access-tqdp4\") pod \"maas-keycloak-0\" (UID: \"0f77479c-3f54-405b-b14d-a2c032485f39\") " pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.221927 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.221896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:46.355417 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.355383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 15:48:46.356913 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:48:46.356875 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f77479c_3f54_405b_b14d_a2c032485f39.slice/crio-42bc3b29b3c0593d9323c63184a46732b9a4478c868288404b7ee4d7b128245f WatchSource:0}: Error finding container 42bc3b29b3c0593d9323c63184a46732b9a4478c868288404b7ee4d7b128245f: Status 404 returned error can't find the container with id 42bc3b29b3c0593d9323c63184a46732b9a4478c868288404b7ee4d7b128245f Jun 11 15:48:46.358542 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.358520 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:48:46.562510 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:46.562428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0f77479c-3f54-405b-b14d-a2c032485f39","Type":"ContainerStarted","Data":"42bc3b29b3c0593d9323c63184a46732b9a4478c868288404b7ee4d7b128245f"} Jun 11 15:48:47.197042 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:47.197000 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3daa9f4b-6d31-4490-88d6-14a4f38bfb11" path="/var/lib/kubelet/pods/3daa9f4b-6d31-4490-88d6-14a4f38bfb11/volumes" Jun 11 15:48:47.570145 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:47.570012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0f77479c-3f54-405b-b14d-a2c032485f39","Type":"ContainerStarted","Data":"7281ced8edaee361d361560fff5bbcba8429fe6ffed2a8fdcac50f8efa4fdd87"} Jun 11 15:48:47.589773 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:47.589722 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.255578911 podStartE2EDuration="2.589704403s" totalImagesPullingTime="334.125492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:48:47.588766011 +0000 UTC m=+1000.862593076" watchObservedRunningTime="2026-06-11 15:48:47.589704403 +0000 UTC m=+1000.863531444" Jun 11 15:48:48.222319 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:48.222274 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:48.224422 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:48.224378 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:49.223455 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:49.223400 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:50.222574 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:50.222517 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:51.223274 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:51.223222 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:52.222801 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:52.222754 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:53.223273 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:53.223214 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:54.223263 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:54.223190 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:55.222540 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:55.222495 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:56.222024 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:56.221975 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:48:56.222400 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:56.222352 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:57.222661 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:57.222611 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:58.222531 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:58.222481 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:48:59.223053 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:48:59.223005 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.40:9000/health/started\": dial tcp 10.134.0.40:9000: connect: connection refused" Jun 11 15:49:00.328507 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:00.328473 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 15:49:00.347838 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:00.347784 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:49:10.332998 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:10.332939 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0f77479c-3f54-405b-b14d-a2c032485f39" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:49:20.333967 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:20.333930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 15:49:44.322100 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.322063 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4"] Jun 11 15:49:44.326717 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.326686 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.329388 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.329363 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:49:44.330516 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.330490 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:49:44.330634 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.330560 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f6xdj\"" Jun 11 15:49:44.330634 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.330607 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 15:49:44.336510 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.336483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4"] Jun 11 15:49:44.448282 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.448244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.448479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.448326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.448479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.448355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.448565 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.448505 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/469c9907-3ffc-4340-b300-9f22c00fa311-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.448565 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.448532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg4p6\" (UniqueName: \"kubernetes.io/projected/469c9907-3ffc-4340-b300-9f22c00fa311-kube-api-access-tg4p6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.448648 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.448562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549454 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/469c9907-3ffc-4340-b300-9f22c00fa311-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg4p6\" (UniqueName: \"kubernetes.io/projected/469c9907-3ffc-4340-b300-9f22c00fa311-kube-api-access-tg4p6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549638 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.549935 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.549929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.550144 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.550099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.552017 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.551991 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/469c9907-3ffc-4340-b300-9f22c00fa311-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.552245 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.552227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/469c9907-3ffc-4340-b300-9f22c00fa311-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.558797 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.558766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg4p6\" (UniqueName: \"kubernetes.io/projected/469c9907-3ffc-4340-b300-9f22c00fa311-kube-api-access-tg4p6\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-4q5z4\" (UID: \"469c9907-3ffc-4340-b300-9f22c00fa311\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.640774 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.640738 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:49:44.796220 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.796187 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4"] Jun 11 15:49:44.798863 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:49:44.798825 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469c9907_3ffc_4340_b300_9f22c00fa311.slice/crio-38140a37d8da18d984db35c3668cbd12c80998d2981ef53d49eabc7d382a24a9 WatchSource:0}: Error finding container 38140a37d8da18d984db35c3668cbd12c80998d2981ef53d49eabc7d382a24a9: Status 404 returned error can't find the container with id 38140a37d8da18d984db35c3668cbd12c80998d2981ef53d49eabc7d382a24a9 Jun 11 15:49:44.903602 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:44.903501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" event={"ID":"469c9907-3ffc-4340-b300-9f22c00fa311","Type":"ContainerStarted","Data":"38140a37d8da18d984db35c3668cbd12c80998d2981ef53d49eabc7d382a24a9"} Jun 11 15:49:48.931131 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:48.931087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" event={"ID":"469c9907-3ffc-4340-b300-9f22c00fa311","Type":"ContainerStarted","Data":"a5fbf3ee33f60c4d0fccd4c160a82584e3c78055f276b52b53c873a07d7c746b"} Jun 11 15:49:56.736369 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.736264 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn"] Jun 11 15:49:56.741025 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.740996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.743909 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.743882 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 15:49:56.752346 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.752315 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn"] Jun 11 15:49:56.876036 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.875994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.876036 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.876042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.876321 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.876066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.876321 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.876213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22306a9d-02fa-420a-ac94-aa733fde1bc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.876321 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.876258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.876321 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.876280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6cq\" (UniqueName: \"kubernetes.io/projected/22306a9d-02fa-420a-ac94-aa733fde1bc1-kube-api-access-nt6cq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977289 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22306a9d-02fa-420a-ac94-aa733fde1bc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977490 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977490 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6cq\" (UniqueName: \"kubernetes.io/projected/22306a9d-02fa-420a-ac94-aa733fde1bc1-kube-api-access-nt6cq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977490 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977663 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977663 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977786 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.977920 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.978013 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.977969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.980210 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.980177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22306a9d-02fa-420a-ac94-aa733fde1bc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.980457 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.980438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22306a9d-02fa-420a-ac94-aa733fde1bc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:56.986887 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:56.986805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6cq\" (UniqueName: \"kubernetes.io/projected/22306a9d-02fa-420a-ac94-aa733fde1bc1-kube-api-access-nt6cq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn\" (UID: \"22306a9d-02fa-420a-ac94-aa733fde1bc1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:57.054925 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:57.054882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:49:57.208744 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:57.208716 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn"] Jun 11 15:49:57.211060 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:49:57.211030 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22306a9d_02fa_420a_ac94_aa733fde1bc1.slice/crio-dabc133fc0d6a09dca3ca5e16450a884f4e805266b45a23dcc96c050b96846a7 WatchSource:0}: Error finding container dabc133fc0d6a09dca3ca5e16450a884f4e805266b45a23dcc96c050b96846a7: Status 404 returned error can't find the container with id dabc133fc0d6a09dca3ca5e16450a884f4e805266b45a23dcc96c050b96846a7 Jun 11 15:49:57.981978 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:57.981939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" event={"ID":"22306a9d-02fa-420a-ac94-aa733fde1bc1","Type":"ContainerStarted","Data":"64912fc18e3db31c0fdd49a48ce84a4a5179a8887fdfd43c0fe5123416ba2f3c"} Jun 11 15:49:57.982486 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:49:57.982007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" event={"ID":"22306a9d-02fa-420a-ac94-aa733fde1bc1","Type":"ContainerStarted","Data":"dabc133fc0d6a09dca3ca5e16450a884f4e805266b45a23dcc96c050b96846a7"} Jun 11 15:50:28.632972 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.632932 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp"] Jun 11 15:50:28.637435 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.637411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.640138 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.640086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 15:50:28.647832 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.647802 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp"] Jun 11 15:50:28.679760 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.679725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.679969 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.679797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.679969 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.679848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.679969 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.679932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.679969 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.679958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.680184 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.679980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x85z\" (UniqueName: \"kubernetes.io/projected/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-kube-api-access-6x85z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781178 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781350 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781399 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781439 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781491 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781601 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x85z\" (UniqueName: \"kubernetes.io/projected/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-kube-api-access-6x85z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781773 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.781887 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.781867 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.782130 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.782097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.784071 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.784033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.784289 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.784269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.791015 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.790975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x85z\" (UniqueName: \"kubernetes.io/projected/d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc-kube-api-access-6x85z\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp\" (UID: \"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:28.950570 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:28.950477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" Jun 11 15:50:29.096442 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:29.096358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp"] Jun 11 15:50:29.098641 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:50:29.098596 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fb4a98_d1dc_4f60_8474_2987b0a7d6fc.slice/crio-70467d6947c0bb2811ee46da60c7c84a1d6d7b5fcfbae31b9f41e433044427d4 WatchSource:0}: Error finding container 70467d6947c0bb2811ee46da60c7c84a1d6d7b5fcfbae31b9f41e433044427d4: Status 404 returned error can't find the container with id 70467d6947c0bb2811ee46da60c7c84a1d6d7b5fcfbae31b9f41e433044427d4 Jun 11 15:50:29.145771 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:29.145742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" event={"ID":"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc","Type":"ContainerStarted","Data":"70467d6947c0bb2811ee46da60c7c84a1d6d7b5fcfbae31b9f41e433044427d4"} Jun 11 15:50:30.152696 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:30.152658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp" event={"ID":"d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc","Type":"ContainerStarted","Data":"dd343276088234edc182eb3467b135f4f2d6ad1c872f4823c536cdf7dec452e9"} Jun 11 15:50:41.220788 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:41.220752 2576 generic.go:356] "Generic (PLEG): container finished" podID="469c9907-3ffc-4340-b300-9f22c00fa311" containerID="a5fbf3ee33f60c4d0fccd4c160a82584e3c78055f276b52b53c873a07d7c746b" exitCode=0 Jun 11 15:50:41.221337 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:41.220800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" event={"ID":"469c9907-3ffc-4340-b300-9f22c00fa311","Type":"ContainerDied","Data":"a5fbf3ee33f60c4d0fccd4c160a82584e3c78055f276b52b53c873a07d7c746b"} Jun 11 15:50:43.233825 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:43.233785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" event={"ID":"469c9907-3ffc-4340-b300-9f22c00fa311","Type":"ContainerStarted","Data":"57e06695f81cbfa4543634b26e50081aa5d832e57b76bc19499cb3014c8862bf"} Jun 11 15:50:43.256544 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:43.256492 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" podStartSLOduration=2.341345519 podStartE2EDuration="59.256473496s" totalImagesPullingTime="4.715185817s" totalInitContainerRuntime="52.19994216s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:49:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:50:43.255809346 +0000 UTC m=+1116.529636398" watchObservedRunningTime="2026-06-11 15:50:43.256473496 +0000 UTC m=+1116.530300538" Jun 11 15:50:44.641207 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:44.641168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:50:44.641652 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:44.641229 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:50:44.654296 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:44.654270 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:50:45.256108 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:45.256080 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-4q5z4" Jun 11 15:50:51.281952 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:51.281919 2576 generic.go:356] "Generic (PLEG): container finished" podID="22306a9d-02fa-420a-ac94-aa733fde1bc1" containerID="64912fc18e3db31c0fdd49a48ce84a4a5179a8887fdfd43c0fe5123416ba2f3c" exitCode=0 Jun 11 15:50:51.282438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:51.281992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" event={"ID":"22306a9d-02fa-420a-ac94-aa733fde1bc1","Type":"ContainerDied","Data":"64912fc18e3db31c0fdd49a48ce84a4a5179a8887fdfd43c0fe5123416ba2f3c"} Jun 11 15:50:52.288722 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:52.288683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" event={"ID":"22306a9d-02fa-420a-ac94-aa733fde1bc1","Type":"ContainerStarted","Data":"258a083d1836b6ca1b138c24bf61897c432f148bce532e3db783e67872f62c4f"} Jun 11 15:50:52.308316 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:52.308264 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" podStartSLOduration=2.760618396 podStartE2EDuration="56.308248947s" totalImagesPullingTime="241.990239ms" totalInitContainerRuntime="53.305640312s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:50:52.307074536 +0000 UTC m=+1125.580901578" watchObservedRunningTime="2026-06-11 15:50:52.308248947 +0000 UTC m=+1125.582075988" Jun 11 15:50:57.055704 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:57.055666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:50:57.056310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:57.055735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:50:57.067995 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:57.067966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:50:57.325281 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:50:57.325205 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn" Jun 11 15:52:07.242425 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:52:07.242393 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:52:07.244967 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:52:07.242626 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nb2gq_0b774e20-f83c-494f-903a-80ab0d32eeb9/ovn-acl-logging/0.log" Jun 11 15:54:36.428267 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:36.428177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp_d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc/storage-initializer/0.log" Jun 11 15:54:42.262150 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:42.262108 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c744446f8-24hwn_43f36b10-4255-4d74-81cf-769263e5d362/nginx/0.log" Jun 11 15:54:42.724740 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:42.724711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d78b8fd58-l6bbc_a37d0c98-55e8-4bad-b98b-68376d38e085/maas-api/0.log" Jun 11 15:54:42.838719 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:42.838691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56657c54b7-mgzr2_89d83449-9a11-4802-93ac-9654e345232e/manager/0.log" Jun 11 15:54:43.391280 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:43.391251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ff979667-nmw8k_8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3/copy-manifests/0.log" Jun 11 15:54:43.398397 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:43.398376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ff979667-nmw8k_8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3/manager/0.log" Jun 11 15:54:44.914299 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:44.914272 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b2q5q_4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43/manager/0.log" Jun 11 15:54:45.254201 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:45.254110 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fn7xm_d96dd480-45c3-4cc8-81fa-51bf6d7d72df/registry-server/0.log" Jun 11 15:54:45.600462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:45.600430 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2pnvb_42303550-c605-4173-81c0-b83f218f41bb/manager/0.log" Jun 11 15:54:45.962506 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:45.962421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795s9zjh_f1b159ae-1734-4e00-90a2-5c4cb1e93d04/istio-proxy/0.log" Jun 11 15:54:46.422239 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:46.422210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/1.log" Jun 11 15:54:46.564169 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:46.564135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9vpmr_cab4b2ca-3bd7-4fcb-9148-cf534b044976/payload-pre-processing/0.log" Jun 11 15:54:46.709302 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:46.709221 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-27bz5_8097c86c-fcca-4411-9d0b-805eb6285a51/payload-processing/0.log" Jun 11 15:54:46.829224 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:46.829199 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cd5cd6bd5-v99b2_9ce73f17-2cda-44d4-8452-a7034ec4cdc9/router/0.log" Jun 11 15:54:47.312374 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:47.312337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-4q5z4_469c9907-3ffc-4340-b300-9f22c00fa311/storage-initializer/0.log" Jun 11 15:54:47.320031 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:47.320006 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-4q5z4_469c9907-3ffc-4340-b300-9f22c00fa311/main/0.log" Jun 11 15:54:47.455531 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:47.455501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn_22306a9d-02fa-420a-ac94-aa733fde1bc1/main/0.log" Jun 11 15:54:47.462698 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:47.462678 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-46zrn_22306a9d-02fa-420a-ac94-aa733fde1bc1/storage-initializer/0.log" Jun 11 15:54:48.083919 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:48.083888 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-nrfxp_d0fb4a98-d1dc-4f60-8474-2987b0a7d6fc/storage-initializer/0.log" Jun 11 15:54:55.882248 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:55.882219 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tnznf_44135148-b091-45e2-8932-9944572694fc/global-pull-secret-syncer/0.log" Jun 11 15:54:56.000641 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:56.000610 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xz527_17def5f2-9bfc-48aa-aed8-9029fb09d8cb/konnectivity-agent/0.log" Jun 11 15:54:56.062316 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:54:56.062285 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-9.ec2.internal_c4691f8359481e5266cae197cdb602c5/haproxy/0.log" Jun 11 15:55:00.866598 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:00.866564 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-b2q5q_4c2a4ae1-b01a-4d35-a7ee-e291ddf7bf43/manager/0.log" Jun 11 15:55:00.978262 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:00.978234 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fn7xm_d96dd480-45c3-4cc8-81fa-51bf6d7d72df/registry-server/0.log" Jun 11 15:55:01.090702 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:01.090673 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2pnvb_42303550-c605-4173-81c0-b83f218f41bb/manager/0.log" Jun 11 15:55:02.916713 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:02.916675 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d6f4f997b-t8mqf_38e1492e-5cbc-430d-9b08-f7849c09ec17/metrics-server/0.log" Jun 11 15:55:02.945043 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:02.944971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-87tc6_59cfd4f5-bce8-4e36-aa4e-be08150ce21f/monitoring-plugin/0.log" Jun 11 15:55:03.069860 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.069834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd8tb_bd3959eb-d674-414e-89e3-36ace97d390e/node-exporter/0.log" Jun 11 15:55:03.097259 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.097234 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd8tb_bd3959eb-d674-414e-89e3-36ace97d390e/kube-rbac-proxy/0.log" Jun 11 15:55:03.130031 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.130009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hd8tb_bd3959eb-d674-414e-89e3-36ace97d390e/init-textfile/0.log" Jun 11 15:55:03.374863 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.374834 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/prometheus/0.log" Jun 11 15:55:03.402913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.402880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/config-reloader/0.log" Jun 11 15:55:03.432346 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.432319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/thanos-sidecar/0.log" Jun 11 15:55:03.455320 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.455295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/kube-rbac-proxy-web/0.log" Jun 11 15:55:03.479632 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.479603 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/kube-rbac-proxy/0.log" Jun 11 15:55:03.505721 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.505650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/kube-rbac-proxy-thanos/0.log" Jun 11 15:55:03.531500 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.531472 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e45a2fe1-6ce5-4cb0-b83e-db824169aa2f/init-config-reloader/0.log" Jun 11 15:55:03.560796 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.560767 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7qkk5_a6299d3f-a3f3-4efa-9871-b517ae46d983/prometheus-operator/0.log" Jun 11 15:55:03.581468 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.581447 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-7qkk5_a6299d3f-a3f3-4efa-9871-b517ae46d983/kube-rbac-proxy/0.log" Jun 11 15:55:03.609111 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.609082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-h27lk_b70c8fd1-f869-4a12-bbc1-ad996a2ec1d6/prometheus-operator-admission-webhook/0.log" Jun 11 15:55:03.740230 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.740201 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bc5b66f7-l5pdd_82cd1d2f-eef4-4432-bc2f-4187ad3139cf/thanos-query/0.log" Jun 11 15:55:03.766333 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.766249 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bc5b66f7-l5pdd_82cd1d2f-eef4-4432-bc2f-4187ad3139cf/kube-rbac-proxy-web/0.log" Jun 11 15:55:03.788707 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.788677 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bc5b66f7-l5pdd_82cd1d2f-eef4-4432-bc2f-4187ad3139cf/kube-rbac-proxy/0.log" Jun 11 15:55:03.812001 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.811970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bc5b66f7-l5pdd_82cd1d2f-eef4-4432-bc2f-4187ad3139cf/prom-label-proxy/0.log" Jun 11 15:55:03.838418 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.838392 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bc5b66f7-l5pdd_82cd1d2f-eef4-4432-bc2f-4187ad3139cf/kube-rbac-proxy-rules/0.log" Jun 11 15:55:03.860591 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:03.860567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bc5b66f7-l5pdd_82cd1d2f-eef4-4432-bc2f-4187ad3139cf/kube-rbac-proxy-metrics/0.log" Jun 11 15:55:06.163758 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.163719 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4"] Jun 11 15:55:06.167196 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.167176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.169913 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.169892 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86tsq\"/\"kube-root-ca.crt\"" Jun 11 15:55:06.170050 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.170032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-86tsq\"/\"default-dockercfg-7v5fs\"" Jun 11 15:55:06.171180 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.171164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86tsq\"/\"openshift-service-ca.crt\"" Jun 11 15:55:06.177453 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.177432 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4"] Jun 11 15:55:06.326220 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.326183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-proc\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.326220 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.326227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-podres\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.326438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.326251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-sys\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.326438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.326333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-lib-modules\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.326438 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.326373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzqww\" (UniqueName: \"kubernetes.io/projected/647c3d04-e335-4556-b49c-7c40b4962d16-kube-api-access-fzqww\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428020 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.427927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-podres\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428020 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.427972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-sys\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428020 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.427994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-lib-modules\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.428027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqww\" (UniqueName: \"kubernetes.io/projected/647c3d04-e335-4556-b49c-7c40b4962d16-kube-api-access-fzqww\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.428065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-sys\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.428099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-podres\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.428227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-lib-modules\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.428235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-proc\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.428290 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.428271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/647c3d04-e335-4556-b49c-7c40b4962d16-proc\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.437008 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.436978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzqww\" (UniqueName: \"kubernetes.io/projected/647c3d04-e335-4556-b49c-7c40b4962d16-kube-api-access-fzqww\") pod \"perf-node-gather-daemonset-cqjp4\" (UID: \"647c3d04-e335-4556-b49c-7c40b4962d16\") " pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.477665 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.477635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:06.617037 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:06.616969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4"] Jun 11 15:55:06.619717 ip-10-0-133-9 kubenswrapper[2576]: W0611 15:55:06.619674 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod647c3d04_e335_4556_b49c_7c40b4962d16.slice/crio-03f5df22fc838b8caa47aaf999d89880292648d02f9381d595003329da88ba73 WatchSource:0}: Error finding container 03f5df22fc838b8caa47aaf999d89880292648d02f9381d595003329da88ba73: Status 404 returned error can't find the container with id 03f5df22fc838b8caa47aaf999d89880292648d02f9381d595003329da88ba73 Jun 11 15:55:07.168841 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:07.168811 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-m4ssf_5568aafd-cf4a-4e1e-b7c6-3d4d324134c3/volume-data-source-validator/0.log" Jun 11 15:55:07.630381 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:07.630347 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" event={"ID":"647c3d04-e335-4556-b49c-7c40b4962d16","Type":"ContainerStarted","Data":"9da87ef5b9778db60153e6a2e02e27c52751b6e8ca08a58ac9fe7062e8c4b626"} Jun 11 15:55:07.630586 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:07.630407 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" event={"ID":"647c3d04-e335-4556-b49c-7c40b4962d16","Type":"ContainerStarted","Data":"03f5df22fc838b8caa47aaf999d89880292648d02f9381d595003329da88ba73"} Jun 11 15:55:07.630586 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:07.630465 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:07.647791 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:07.647745 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" podStartSLOduration=1.647731565 podStartE2EDuration="1.647731565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:55:07.645595767 +0000 UTC m=+1380.919422809" watchObservedRunningTime="2026-06-11 15:55:07.647731565 +0000 UTC m=+1380.921558606" Jun 11 15:55:08.457460 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:08.457430 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qcf5d_999b4fd9-e079-4e6c-a09c-849907af5324/dns/0.log" Jun 11 15:55:08.481279 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:08.481239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qcf5d_999b4fd9-e079-4e6c-a09c-849907af5324/kube-rbac-proxy/0.log" Jun 11 15:55:08.534477 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:08.534451 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jq7wc_2e5e884f-73ea-48fc-951c-537d741857b6/dns-node-resolver/0.log" Jun 11 15:55:09.109354 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:09.109329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5546969db-cckh5_385e7e94-e0d4-4dba-a8f3-2c4c7fa82518/registry/0.log" Jun 11 15:55:09.155715 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:09.155690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kl7vv_243e0a04-0fb5-4cab-b57f-d27a5c4c52cb/node-ca/0.log" Jun 11 15:55:10.170700 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:10.170662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795s9zjh_f1b159ae-1734-4e00-90a2-5c4cb1e93d04/istio-proxy/0.log" Jun 11 15:55:10.296986 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:10.296947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/1.log" Jun 11 15:55:10.297310 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:10.297290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/0.log" Jun 11 15:55:10.320711 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:10.320684 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9vpmr_cab4b2ca-3bd7-4fcb-9148-cf534b044976/payload-pre-processing/0.log" Jun 11 15:55:10.345450 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:10.345427 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-27bz5_8097c86c-fcca-4411-9d0b-805eb6285a51/payload-processing/0.log" Jun 11 15:55:10.373218 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:10.373191 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cd5cd6bd5-v99b2_9ce73f17-2cda-44d4-8452-a7034ec4cdc9/router/0.log" Jun 11 15:55:11.010090 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:11.010057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ddgqw_be4b80f1-c3eb-4257-a28c-b88b077548b5/serve-healthcheck-canary/0.log" Jun 11 15:55:11.573889 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:11.573860 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-dvqqf_d64e9743-6147-481d-b65f-88e9de035c7c/insights-operator/1.log" Jun 11 15:55:11.574313 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:11.574241 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-dvqqf_d64e9743-6147-481d-b65f-88e9de035c7c/insights-operator/0.log" Jun 11 15:55:11.598422 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:11.598397 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2fkkq_8b05e87b-bd7c-4687-874b-f3ddc0197682/kube-rbac-proxy/0.log" Jun 11 15:55:11.620675 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:11.620648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2fkkq_8b05e87b-bd7c-4687-874b-f3ddc0197682/exporter/0.log" Jun 11 15:55:11.644678 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:11.644648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2fkkq_8b05e87b-bd7c-4687-874b-f3ddc0197682/extractor/0.log" Jun 11 15:55:13.646045 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:13.646021 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-86tsq/perf-node-gather-daemonset-cqjp4" Jun 11 15:55:14.036168 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:14.036068 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c744446f8-24hwn_43f36b10-4255-4d74-81cf-769263e5d362/nginx/0.log" Jun 11 15:55:14.171284 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:14.171231 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d78b8fd58-l6bbc_a37d0c98-55e8-4bad-b98b-68376d38e085/maas-api/0.log" Jun 11 15:55:14.202639 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:14.202607 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56657c54b7-mgzr2_89d83449-9a11-4802-93ac-9654e345232e/manager/0.log" Jun 11 15:55:14.455627 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:14.455595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ff979667-nmw8k_8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3/manager/0.log" Jun 11 15:55:14.480130 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:14.480105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77ff979667-nmw8k_8b6b3d26-5ed7-4214-bbe7-c5b14b7b94f3/copy-manifests/0.log" Jun 11 15:55:16.315317 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:16.315284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f9d6f9b9f-qr2sr_45639935-1e85-4422-8eb7-f7b153d61fda/manager/0.log" Jun 11 15:55:20.304749 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:20.304713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795s9zjh_f1b159ae-1734-4e00-90a2-5c4cb1e93d04/istio-proxy/0.log" Jun 11 15:55:20.398197 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:20.398166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/1.log" Jun 11 15:55:20.398573 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:20.398558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/0.log" Jun 11 15:55:20.410427 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:20.410402 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9vpmr_cab4b2ca-3bd7-4fcb-9148-cf534b044976/payload-pre-processing/0.log" Jun 11 15:55:20.428479 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:20.428450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-27bz5_8097c86c-fcca-4411-9d0b-805eb6285a51/payload-processing/0.log" Jun 11 15:55:20.448304 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:20.448275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cd5cd6bd5-v99b2_9ce73f17-2cda-44d4-8452-a7034ec4cdc9/router/0.log" Jun 11 15:55:21.489335 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:21.489308 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795s9zjh_f1b159ae-1734-4e00-90a2-5c4cb1e93d04/istio-proxy/0.log" Jun 11 15:55:21.588369 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:21.588341 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/1.log" Jun 11 15:55:21.588767 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:21.588749 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-nfngj_f54fa715-0ad2-43a0-bc7a-750bc9c2525c/istio-proxy/0.log" Jun 11 15:55:21.600510 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:21.600486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-9vpmr_cab4b2ca-3bd7-4fcb-9148-cf534b044976/payload-pre-processing/0.log" Jun 11 15:55:21.618590 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:21.618568 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-27bz5_8097c86c-fcca-4411-9d0b-805eb6285a51/payload-processing/0.log" Jun 11 15:55:21.636727 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:21.636704 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6cd5cd6bd5-v99b2_9ce73f17-2cda-44d4-8452-a7034ec4cdc9/router/0.log" Jun 11 15:55:23.374917 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:23.374880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cknh7_d45ee1f7-41f3-4275-b546-954dbdbb2af1/kube-multus-additional-cni-plugins/0.log" Jun 11 15:55:23.400462 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:23.400433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cknh7_d45ee1f7-41f3-4275-b546-954dbdbb2af1/egress-router-binary-copy/0.log" Jun 11 15:55:23.423660 ip-10-0-133-9 kubenswrapper[2576]: I0611 15:55:23.423638 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cknh7_d45ee1f7-41f3-4275-b546-954dbdbb2af1/cni-plugins/0.log"