Jun 12 19:11:33.248712 ip-10-0-136-61 systemd[1]: Starting Kubernetes Kubelet... Jun 12 19:11:33.659643 ip-10-0-136-61 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:11:33.659643 ip-10-0-136-61 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 19:11:33.659643 ip-10-0-136-61 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:11:33.659643 ip-10-0-136-61 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 19:11:33.659643 ip-10-0-136-61 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 19:11:33.660894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.660586 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 19:11:33.665503 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665482 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:33.665503 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665501 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:33.665503 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665505 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:33.665503 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665510 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665514 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665519 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665523 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665527 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665531 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665535 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665546 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665550 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665555 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665559 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665563 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665567 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665571 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665575 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665581 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665587 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665592 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665596 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:33.665758 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665600 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665604 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665608 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665613 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665617 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665621 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665626 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665630 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665635 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665640 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665644 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665649 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665653 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665658 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665662 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665667 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665673 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665678 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665686 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665692 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:33.666307 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665697 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665701 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665706 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665711 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665715 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665719 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665724 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665728 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665732 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665736 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665740 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665745 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665749 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665753 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665757 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665761 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665766 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665770 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665775 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665779 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:33.667121 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665783 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665788 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665793 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665797 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665801 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665805 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665810 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665815 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665820 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665826 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665832 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665837 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665841 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665845 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665850 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665854 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665858 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665862 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665866 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665870 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:33.668004 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665875 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665879 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665883 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665888 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665892 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665896 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665900 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665905 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665910 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665914 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665918 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665922 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665927 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665931 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665935 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665941 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.665948 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667704 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667716 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667724 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:33.668660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667729 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667734 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667743 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667748 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667752 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667756 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667760 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667765 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667770 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667774 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667779 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667784 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667788 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667792 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667796 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667801 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667805 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667809 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667814 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667818 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:33.669240 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667822 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667827 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667831 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667835 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667839 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667843 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667848 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667852 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667856 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667860 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667864 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667870 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667875 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667879 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667884 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667889 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667893 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667898 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667905 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667911 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:33.670159 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667915 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667919 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667923 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667928 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667932 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667936 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667940 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667945 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667949 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667953 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667957 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667961 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667965 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667970 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667975 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667980 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667984 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667988 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667992 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.667997 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:33.670738 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668000 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668005 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668009 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668013 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668017 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668022 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668026 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668031 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668036 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668041 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668045 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668052 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668056 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668060 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668064 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668071 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668077 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668082 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668087 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:33.671215 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668092 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668096 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668101 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668105 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668109 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668113 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668117 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668122 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668127 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668131 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668135 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668139 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668146 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668151 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668156 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668161 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.668166 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669682 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669693 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:33.671695 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669698 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669703 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669708 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669712 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669716 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669720 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669727 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669732 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669736 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669744 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669750 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669755 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669759 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669763 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669767 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669772 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669776 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669781 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669785 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:33.672166 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669789 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669793 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669798 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669802 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669806 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669810 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669815 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669819 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669824 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669828 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669833 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669838 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669842 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669846 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669850 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669855 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669861 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669866 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669870 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669875 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:33.672659 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669879 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669883 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669888 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669893 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669897 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669902 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669907 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669911 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669916 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669920 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669924 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669928 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669933 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669937 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669946 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669950 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669954 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669959 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669964 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669969 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669973 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:33.673148 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669977 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669982 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669986 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669991 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669995 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.669999 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670004 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670010 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670015 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670019 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670026 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670032 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670037 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670077 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670101 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670106 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670110 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670113 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670116 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:33.673692 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670120 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670125 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670129 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670133 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670137 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670140 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670144 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670146 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670149 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670152 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670155 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670157 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670160 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670163 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670165 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670169 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670172 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670175 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670272 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670280 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 19:11:33.674144 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670291 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670298 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670304 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670308 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670312 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670317 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670320 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670325 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670329 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670333 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670336 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670339 2554 flags.go:64] FLAG: --cgroup-root="" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670342 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670345 2554 flags.go:64] FLAG: --client-ca-file="" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670348 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670351 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670356 2554 flags.go:64] FLAG: --cluster-domain="" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670359 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670362 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670366 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670371 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670378 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670383 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 19:11:33.674647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670386 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670390 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670393 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670396 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670399 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670402 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670405 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670410 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670413 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670416 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670419 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670437 2554 flags.go:64] FLAG: --enable-server="true" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670440 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670447 2554 flags.go:64] FLAG: --event-burst="100" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670452 2554 flags.go:64] FLAG: --event-qps="50" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670457 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670463 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670469 2554 flags.go:64] FLAG: --eviction-hard="" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670474 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670477 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670480 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670483 2554 flags.go:64] FLAG: --eviction-soft="" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670486 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670489 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670492 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 19:11:33.675200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670495 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670498 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670501 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670504 2554 flags.go:64] FLAG: --feature-gates="" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670508 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670511 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670514 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670517 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670520 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670523 2554 flags.go:64] FLAG: --help="false" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670526 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670530 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670536 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670540 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670546 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670550 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670553 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670556 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670559 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670562 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670565 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670568 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670571 2554 flags.go:64] FLAG: --kube-reserved="" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670575 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 19:11:33.675899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670578 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670582 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670585 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670588 2554 flags.go:64] FLAG: --lock-file="" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670591 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670594 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670597 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670603 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670606 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670609 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670614 2554 flags.go:64] FLAG: --logging-format="text" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670619 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670625 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670629 2554 flags.go:64] FLAG: --manifest-url="" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670632 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670637 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670640 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670644 2554 flags.go:64] FLAG: --max-pods="110" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670647 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670650 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670654 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670656 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670660 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670663 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670665 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 19:11:33.676515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670676 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670679 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670682 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670685 2554 flags.go:64] FLAG: --pod-cidr="" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670688 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670695 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670704 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670709 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670713 2554 flags.go:64] FLAG: --port="10250" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670717 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670720 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-016edba9b2fa54c3e" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670723 2554 flags.go:64] FLAG: --qos-reserved="" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670727 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670730 2554 flags.go:64] FLAG: --register-node="true" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670732 2554 flags.go:64] FLAG: --register-with-taints="" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670737 2554 flags.go:64] FLAG: --registry-burst="10" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670740 2554 flags.go:64] FLAG: --registry-qps="5" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670743 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670746 2554 flags.go:64] FLAG: --reserved-memory="" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670751 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670754 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670757 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670760 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670763 2554 flags.go:64] FLAG: --runonce="false" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670766 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 19:11:33.677127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670769 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670773 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670777 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670783 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670788 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670792 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670795 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670798 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670801 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670804 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670806 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670809 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670813 2554 flags.go:64] FLAG: --system-cgroups="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670817 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670824 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670827 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670830 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670835 2554 flags.go:64] FLAG: --tls-min-version="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670838 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670841 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670844 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670847 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670850 2554 flags.go:64] FLAG: --v="2" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670856 2554 flags.go:64] FLAG: --version="false" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670862 2554 flags.go:64] FLAG: --vmodule="" Jun 12 19:11:33.677795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670869 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.670873 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.670999 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671004 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671007 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671010 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671014 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671018 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671022 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671027 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671031 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671035 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671037 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671040 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671042 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671045 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671048 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671050 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671053 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671057 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:33.678436 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671062 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671065 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671067 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671070 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671073 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671076 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671079 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671081 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671084 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671086 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671089 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671091 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671094 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671099 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671103 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671107 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671112 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671115 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671118 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:33.678939 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671120 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671123 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671125 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671128 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671131 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671135 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671139 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671141 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671144 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671147 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671150 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671153 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671157 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671162 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671165 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671168 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671170 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671174 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671177 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671183 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:33.679395 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671188 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671192 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671196 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671199 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671202 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671205 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671207 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671210 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671213 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671216 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671219 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671221 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671224 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671227 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671229 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671232 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671235 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671237 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671240 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671242 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:33.680114 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671245 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671247 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671250 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671253 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671258 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671263 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671268 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671272 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671276 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671278 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671281 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671284 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671288 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671290 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671293 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671295 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671298 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671301 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671305 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:33.680767 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671309 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671313 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.671316 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.672389 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.679328 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.679459 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.679477 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 19:11:33.681238 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.679483 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 19:11:33.681601 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681573 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681730 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681740 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681746 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681751 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681758 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681763 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681769 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681775 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681786 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681791 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681795 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:33.681815 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681802 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681839 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681981 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681993 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.681996 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682000 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682003 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682006 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682009 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682012 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682015 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682018 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682021 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682024 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682026 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682029 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682032 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682034 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682037 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682040 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:33.682177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682042 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682046 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682049 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682051 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682054 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682057 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682060 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682063 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682066 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682070 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682075 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682078 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682081 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682084 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682087 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682092 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682094 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682097 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682100 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:33.682747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682103 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682107 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682109 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682114 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682117 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682121 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682124 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682127 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682129 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682134 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682139 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682141 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682146 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682149 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682152 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682156 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682161 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682164 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682167 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:33.683213 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682170 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682173 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682177 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682181 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682184 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682188 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682191 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682194 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682197 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682200 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682203 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682206 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682209 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682211 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682214 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682217 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682220 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682223 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682226 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682229 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:33.683689 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682231 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682234 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682237 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682240 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682242 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682245 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682247 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682250 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682252 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.682259 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682388 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682394 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682397 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682400 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682403 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 19:11:33.684172 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682406 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682408 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682411 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682414 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682417 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682419 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682437 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682441 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682444 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682446 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682450 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682455 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682458 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682461 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682463 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682466 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682469 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682471 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682474 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682476 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 19:11:33.684571 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682479 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682482 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682484 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682489 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682493 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682496 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682500 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682503 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682506 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682509 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682512 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682515 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682517 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682520 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682522 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682525 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682528 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682530 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682533 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 19:11:33.685054 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682536 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682538 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682541 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682544 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682546 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682549 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682552 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682554 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682557 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682560 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682562 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682565 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682568 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682570 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682573 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682575 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682578 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682580 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682583 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682586 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 19:11:33.685525 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682589 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682593 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682596 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682600 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682603 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682605 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682608 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682610 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682613 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682616 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682618 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682621 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682624 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682626 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682630 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682633 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682636 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682639 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682642 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 19:11:33.686053 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682644 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682647 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682650 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682652 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682655 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682658 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682660 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682663 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682665 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682668 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682670 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682673 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682675 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682678 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682681 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 19:11:33.686656 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:33.682683 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 19:11:33.687017 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.682689 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 19:11:33.687017 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.682821 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 19:11:33.687017 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.684984 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 19:11:33.687017 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.686343 2554 server.go:1019] "Starting client certificate rotation" Jun 12 19:11:33.687017 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.686460 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 19:11:33.687017 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.686504 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 19:11:33.690513 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.690456 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 19:11:33.691596 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.691583 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 19:11:33.702517 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.702499 2554 log.go:25] "Validated CRI v1 runtime API" Jun 12 19:11:33.705911 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.705897 2554 log.go:25] "Validated CRI v1 image API" Jun 12 19:11:33.706686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.706668 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 19:11:33.710742 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.710716 2554 fs.go:135] Filesystem UUIDs: map[3916a29c-e633-4528-b6b5-9eac0f943639:/dev/nvme0n1p3 43debd46-00f5-4554-9e4d-424aa49d5365:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 12 19:11:33.710820 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.710741 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 19:11:33.716199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.716173 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 19:11:33.717772 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.717665 2554 manager.go:216] Machine: {Timestamp:2026-06-12 19:11:33.716361362 +0000 UTC m=+0.346427573 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086815 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20374e373a0f8b5c6562e19c4ffeee SystemUUID:ec20374e-373a-0f8b-5c65-62e19c4ffeee BootID:6e03583b-6b7f-4860-99a5-828f9f11a95b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:21:74:48:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:21:74:48:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:80:11:00:9e:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 19:11:33.717772 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.717767 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 19:11:33.717905 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.717894 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 19:11:33.720858 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.720837 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 19:11:33.720994 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.720861 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 19:11:33.721508 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.721497 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 19:11:33.721540 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.721509 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 19:11:33.721540 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.721517 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 19:11:33.722159 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.722148 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 19:11:33.723929 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.723920 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 19:11:33.727521 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727510 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 12 19:11:33.727645 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727636 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 19:11:33.727677 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727669 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 12 19:11:33.727709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727681 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 19:11:33.727709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727694 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 19:11:33.727773 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727723 2554 kubelet.go:398] "Adding apiserver pod source" Jun 12 19:11:33.727773 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.727733 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 19:11:33.728138 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.728126 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 19:11:33.728176 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.728148 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 19:11:33.732685 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.732665 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 19:11:33.734352 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734338 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 19:11:33.734406 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734368 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 19:11:33.734556 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734546 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 19:11:33.734595 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734561 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 19:11:33.734595 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734568 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 19:11:33.734595 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734593 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 19:11:33.734675 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734602 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 19:11:33.734675 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.734607 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 19:11:33.735065 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735057 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 19:11:33.735097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735065 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 19:11:33.735097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735072 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 19:11:33.735097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735078 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 19:11:33.735097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735091 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 19:11:33.735097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735099 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 19:11:33.735525 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.735506 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 19:11:33.735567 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.735506 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 19:11:33.735886 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735876 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 19:11:33.735919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.735888 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 19:11:33.738344 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.738325 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 19:11:33.739310 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.739298 2554 server.go:1268] "Started kubelet" Jun 12 19:11:33.739384 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.739357 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 19:11:33.739453 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.739397 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97nth" Jun 12 19:11:33.739492 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.739448 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 19:11:33.739492 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.739487 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 19:11:33.740225 ip-10-0-136-61 systemd[1]: Started Kubernetes Kubelet. Jun 12 19:11:33.741084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.741053 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 12 19:11:33.741392 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.741376 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 19:11:33.745747 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.745722 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 19:11:33.745971 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.745951 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 19:11:33.745971 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.745954 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 19:11:33.746112 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.746022 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:33.746533 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746512 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 19:11:33.746533 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746518 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 19:11:33.746643 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746540 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 19:11:33.746695 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746688 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 12 19:11:33.746742 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746698 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 12 19:11:33.746802 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746785 2554 factory.go:55] Registering systemd factory Jun 12 19:11:33.746848 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.746825 2554 factory.go:223] Registration of the systemd container factory successfully Jun 12 19:11:33.747038 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747009 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97nth" Jun 12 19:11:33.747171 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747152 2554 factory.go:153] Registering CRI-O factory Jun 12 19:11:33.747171 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747171 2554 factory.go:223] Registration of the crio container factory successfully Jun 12 19:11:33.747321 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747221 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 19:11:33.747321 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747260 2554 factory.go:103] Registering Raw factory Jun 12 19:11:33.747321 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747276 2554 manager.go:1196] Started watching for new ooms in manager Jun 12 19:11:33.747639 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.747628 2554 manager.go:349] Starting recovery of all containers Jun 12 19:11:33.748486 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.747365 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-61.ec2.internal.18b86b2d05c11173 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-61.ec2.internal,UID:ip-10-0-136-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-61.ec2.internal,},FirstTimestamp:2026-06-12 19:11:33.739270515 +0000 UTC m=+0.369336728,LastTimestamp:2026-06-12 19:11:33.739270515 +0000 UTC m=+0.369336728,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-61.ec2.internal,}" Jun 12 19:11:33.753343 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.753322 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:33.755959 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.755911 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 19:11:33.757268 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.757243 2554 manager.go:354] Recovery completed Jun 12 19:11:33.760673 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.760640 2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-61.ec2.internal\" not found" node="ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.763760 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.763747 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.766878 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.766855 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.766942 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.766885 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.766942 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.766896 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.767372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.767359 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 19:11:33.767372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.767368 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.767500 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.767370 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 19:11:33.767500 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.767405 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 12 19:11:33.768122 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.768108 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.768178 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.768131 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.768178 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.768142 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.768500 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.768489 2554 policy_none.go:49] "None policy: Start" Jun 12 19:11:33.768539 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.768505 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 19:11:33.768539 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.768515 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 19:11:33.769413 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.769402 2554 policy_none.go:47] "Start" Jun 12 19:11:33.809094 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809071 2554 manager.go:337] "Starting Device Plugin manager" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.809159 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809174 2554 server.go:87] "Starting device plugin registration server" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809265 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809297 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809326 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.809451 2554 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809507 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809521 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809710 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809790 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.809799 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.810581 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.810629 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:33.812649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.811411 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:33.909810 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.909722 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.909943 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.909729 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal"] Jun 12 19:11:33.909943 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.909906 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.911592 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911575 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.911709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911577 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.911709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911603 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.911709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911628 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.911709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911680 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.911709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911709 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.911928 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.911728 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.913042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.913027 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.913151 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.913130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.913193 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.913166 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.916531 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.916509 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.916605 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.916541 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.916605 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.916552 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.916605 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.916516 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.916743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.916627 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.916743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.916645 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.917860 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.917845 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.917941 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.917873 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 19:11:33.918573 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.918559 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientMemory" Jun 12 19:11:33.918642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.918583 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 19:11:33.918642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.918595 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeHasSufficientPID" Jun 12 19:11:33.920015 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.919998 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.920093 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.920020 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-61.ec2.internal\": node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:33.933982 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.933962 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-61.ec2.internal\" not found" node="ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.937848 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.937833 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-61.ec2.internal\" not found" node="ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.939153 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:33.939137 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:33.948496 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.948481 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e49fafff1875e004fc8cc3fbdd3260c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal\" (UID: \"9e49fafff1875e004fc8cc3fbdd3260c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.948553 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.948503 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e49fafff1875e004fc8cc3fbdd3260c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal\" (UID: \"9e49fafff1875e004fc8cc3fbdd3260c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:33.948553 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:33.948522 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95b28959981f75938365112db4b98b52-config\") pod \"kube-apiserver-proxy-ip-10-0-136-61.ec2.internal\" (UID: \"95b28959981f75938365112db4b98b52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.039441 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.039400 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.048697 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.048671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e49fafff1875e004fc8cc3fbdd3260c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal\" (UID: \"9e49fafff1875e004fc8cc3fbdd3260c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.048769 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.048706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e49fafff1875e004fc8cc3fbdd3260c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal\" (UID: \"9e49fafff1875e004fc8cc3fbdd3260c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.048769 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.048724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95b28959981f75938365112db4b98b52-config\") pod \"kube-apiserver-proxy-ip-10-0-136-61.ec2.internal\" (UID: \"95b28959981f75938365112db4b98b52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.048864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.048773 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95b28959981f75938365112db4b98b52-config\") pod \"kube-apiserver-proxy-ip-10-0-136-61.ec2.internal\" (UID: \"95b28959981f75938365112db4b98b52\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.048864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.048784 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e49fafff1875e004fc8cc3fbdd3260c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal\" (UID: \"9e49fafff1875e004fc8cc3fbdd3260c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.048864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.048801 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e49fafff1875e004fc8cc3fbdd3260c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal\" (UID: \"9e49fafff1875e004fc8cc3fbdd3260c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.140474 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.140444 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.236271 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.236200 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.241273 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.241255 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.241357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.241288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.341783 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.341733 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.442269 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.442225 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.542894 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.542807 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.643317 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:34.643285 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-61.ec2.internal\" not found" Jun 12 19:11:34.685801 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.685776 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 19:11:34.686347 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.685918 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:11:34.686347 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.685946 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 19:11:34.741167 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.741142 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:34.746120 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.746095 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 19:11:34.746120 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.746112 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.751563 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.751536 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 19:06:33 +0000 UTC" deadline="2027-12-12 07:13:43.939981367 +0000 UTC" Jun 12 19:11:34.751563 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.751560 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13140h2m9.188424685s" Jun 12 19:11:34.757542 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.757527 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 19:11:34.759702 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.759686 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" Jun 12 19:11:34.759814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.759789 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 19:11:34.766570 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.766557 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 19:11:34.783392 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.783248 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9hcf" Jun 12 19:11:34.791624 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.791605 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b9hcf" Jun 12 19:11:34.793203 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:34.793154 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e49fafff1875e004fc8cc3fbdd3260c.slice/crio-0497957892a6dbb099f0f1214a5dc6f032acfd3a2580291e01d9631dbc0baa7f WatchSource:0}: Error finding container 0497957892a6dbb099f0f1214a5dc6f032acfd3a2580291e01d9631dbc0baa7f: Status 404 returned error can't find the container with id 0497957892a6dbb099f0f1214a5dc6f032acfd3a2580291e01d9631dbc0baa7f Jun 12 19:11:34.793704 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:34.793687 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b28959981f75938365112db4b98b52.slice/crio-4f6945ae3721913cdb7a301bd3cc1476bfac1058bfa3d87a9df8e24182e6e9ad WatchSource:0}: Error finding container 4f6945ae3721913cdb7a301bd3cc1476bfac1058bfa3d87a9df8e24182e6e9ad: Status 404 returned error can't find the container with id 4f6945ae3721913cdb7a301bd3cc1476bfac1058bfa3d87a9df8e24182e6e9ad Jun 12 19:11:34.797559 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.797535 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:11:34.813222 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.813183 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" event={"ID":"9e49fafff1875e004fc8cc3fbdd3260c","Type":"ContainerStarted","Data":"0497957892a6dbb099f0f1214a5dc6f032acfd3a2580291e01d9631dbc0baa7f"} Jun 12 19:11:34.814304 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.814285 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" event={"ID":"95b28959981f75938365112db4b98b52","Type":"ContainerStarted","Data":"4f6945ae3721913cdb7a301bd3cc1476bfac1058bfa3d87a9df8e24182e6e9ad"} Jun 12 19:11:34.845982 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:34.845958 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:35.615755 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.615723 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:35.632953 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.632922 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 19:11:35.728917 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.728881 2554 apiserver.go:52] "Watching apiserver" Jun 12 19:11:35.737804 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.737781 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 19:11:35.739082 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.739058 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qnq2v","openshift-network-diagnostics/network-check-target-242v4","openshift-ovn-kubernetes/ovnkube-node-5l7k5","kube-system/global-pull-secret-syncer-f488f","kube-system/konnectivity-agent-cbmgc","kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mfjsx","openshift-dns/node-resolver-zz8tb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal","openshift-multus/multus-2qdwr","openshift-network-operator/iptables-alerter-ndsft","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf","openshift-image-registry/node-ca-f7qhc","openshift-multus/multus-additional-cni-plugins-d6lfh"] Jun 12 19:11:35.740467 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.740453 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.741532 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.741512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:35.741612 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.741587 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:35.742903 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.742857 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.743688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.743668 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.743783 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.743771 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xnljs\"" Jun 12 19:11:35.743985 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.743968 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.744102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.744086 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:35.744171 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.744141 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:35.745251 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.745235 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 19:11:35.745507 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.745490 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.745931 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.745716 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 19:11:35.745931 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.745733 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 19:11:35.745931 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.745854 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.746786 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.746769 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.747210 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.747187 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bxrpm\"" Jun 12 19:11:35.747370 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.747224 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.747370 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.747239 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 19:11:35.748201 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.748094 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.748201 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.748151 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:35.748340 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.748230 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.748629 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.748610 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.748629 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.748627 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qmjnk\"" Jun 12 19:11:35.749338 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.749310 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 19:11:35.749475 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.749324 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.749663 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.749647 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m5tvl\"" Jun 12 19:11:35.749743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.749651 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.749743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.749703 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 19:11:35.749861 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.749849 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 19:11:35.750151 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.750134 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.750504 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.750489 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.751717 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.751703 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.754082 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.753940 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.754851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.754197 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.754851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.754353 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.754851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.754543 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kzflp\"" Jun 12 19:11:35.754851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.754607 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.754851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.754756 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 19:11:35.755229 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.754974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.756149 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.756094 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 19:11:35.756149 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.756114 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7fgx2\"" Jun 12 19:11:35.756276 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.756156 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 19:11:35.756398 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.756380 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-64qrj\"" Jun 12 19:11:35.757118 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757097 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.757868 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757852 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-cnibin\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.757967 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-kubelet\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.757967 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757892 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-registration-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.757967 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-systemd-units\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.757967 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-systemd\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.757967 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-var-lib-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758197 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-etc-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758197 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.757988 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovnkube-script-lib\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758197 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5174921b-e915-4fa0-9a87-4a64bb1515c0-hosts-file\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.758197 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758077 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5174921b-e915-4fa0-9a87-4a64bb1515c0-tmp-dir\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.758197 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758127 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-slash\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758197 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-run-netns\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-node-log\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758224 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-log-socket\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758246 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758271 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-socket-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758318 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-k8s-cni-cncf-io\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758351 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-cni-netd\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovn-node-metrics-cert\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-cni-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-netns\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-hostroot\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758490 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-conf-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758511 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-daemon-config\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qw56\" (UniqueName: \"kubernetes.io/projected/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-kube-api-access-6qw56\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-cni-bin\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758610 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdp2t\" (UniqueName: \"kubernetes.io/projected/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-kube-api-access-cdp2t\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758639 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-cni-bin\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-ovn\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758679 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8gzt\" (UniqueName: \"kubernetes.io/projected/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-kube-api-access-t8gzt\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758724 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-os-release\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758755 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-cni-binary-copy\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-socket-dir-parent\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-etc-kubernetes\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758832 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5tqf\" (UniqueName: \"kubernetes.io/projected/5174921b-e915-4fa0-9a87-4a64bb1515c0-kube-api-access-v5tqf\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758857 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-cni-multus\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758879 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-multus-certs\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758903 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-kubelet\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.758994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-env-overrides\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759022 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-device-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759060 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-system-cni-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759083 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:35.759108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759108 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759132 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovnkube-config\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtt8r\" (UniqueName: \"kubernetes.io/projected/bbc409d9-e3b2-43d7-968e-e13a8445d96d-kube-api-access-jtt8r\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.759622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.759622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.759249 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-sys-fs\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.762264 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.762056 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 19:11:35.762264 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.762090 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 19:11:35.762264 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.762116 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 19:11:35.762264 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.762251 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 19:11:35.762777 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.762761 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzmg9\"" Jun 12 19:11:35.762931 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.762918 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 19:11:35.763083 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.763069 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kb4wk\"" Jun 12 19:11:35.794060 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.794001 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 19:06:34 +0000 UTC" deadline="2027-12-24 12:52:56.830193989 +0000 UTC" Jun 12 19:11:35.794146 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.794061 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13433h41m21.036137158s" Jun 12 19:11:35.847923 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.847896 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 19:11:35.860472 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-kubelet\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860490 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860499 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-kubelet\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860521 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-system-cni-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860549 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-kubelet-config\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860553 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a02f08-7b21-4b8c-a94f-99a2360855b6-host-slash\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860615 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-system-cni-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.860626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-dbus\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860752 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovnkube-config\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-kubelet\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860791 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860839 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-systemd-units\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860864 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-etc-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860870 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-kubelet\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860839 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovnkube-script-lib\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860934 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-etc-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860939 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5174921b-e915-4fa0-9a87-4a64bb1515c0-hosts-file\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysconfig\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.860985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-lib-modules\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861001 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5174921b-e915-4fa0-9a87-4a64bb1515c0-hosts-file\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.861092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-run-netns\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-run-netns\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861046 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-log-socket\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861058 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-systemd-units\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861076 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861094 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-log-socket\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861128 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-socket-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861150 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qw56\" (UniqueName: \"kubernetes.io/projected/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-kube-api-access-6qw56\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.861190 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-cnibin\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861231 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw69f\" (UniqueName: \"kubernetes.io/projected/82a02f08-7b21-4b8c-a94f-99a2360855b6-kube-api-access-tw69f\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.861273 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:36.361237953 +0000 UTC m=+2.991304156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861360 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-socket-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-cni-netd\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-cni-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.861895 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861486 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-netns\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861501 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-cni-netd\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-systemd\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861559 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-netns\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861564 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-cni-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-cni-bin\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861600 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovnkube-script-lib\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdp2t\" (UniqueName: \"kubernetes.io/projected/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-kube-api-access-cdp2t\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861616 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-cni-bin\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-cni-bin\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861598 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovnkube-config\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6661ec26-5225-42d0-8e1f-60a5c03e3d86-host\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861679 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-kubernetes\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861694 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-cni-bin\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861700 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysctl-conf\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861740 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-ovn\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8gzt\" (UniqueName: \"kubernetes.io/projected/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-kube-api-access-t8gzt\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:35.862688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861804 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-socket-dir-parent\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-ovn\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d3d6997-1ae1-41d6-a227-0da75ce73ac0-konnectivity-ca\") pod \"konnectivity-agent-cbmgc\" (UID: \"7d3d6997-1ae1-41d6-a227-0da75ce73ac0\") " pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861853 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-host\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-cni-multus\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861877 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-socket-dir-parent\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-multus-certs\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861932 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-multus-certs\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861938 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-var-lib-cni-multus\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-sys\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-env-overrides\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.861997 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-device-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862018 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq4q8\" (UniqueName: \"kubernetes.io/projected/a79122e8-0d5c-4ce2-b8c5-9ba937473119-kube-api-access-xq4q8\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862065 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82a02f08-7b21-4b8c-a94f-99a2360855b6-iptables-alerter-script\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862086 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-device-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.863653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862096 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtt8r\" (UniqueName: \"kubernetes.io/projected/bbc409d9-e3b2-43d7-968e-e13a8445d96d-kube-api-access-jtt8r\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862280 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-sys-fs\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-cnibin\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862320 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862328 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-system-cni-dir\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-registration-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-systemd\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862382 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-sys-fs\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862405 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-var-lib-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862449 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5174921b-e915-4fa0-9a87-4a64bb1515c0-tmp-dir\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862455 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-run-systemd\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862451 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-cnibin\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862474 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6661ec26-5225-42d0-8e1f-60a5c03e3d86-serviceca\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862468 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bbc409d9-e3b2-43d7-968e-e13a8445d96d-env-overrides\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862474 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-var-lib-openvswitch\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862498 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-registration-dir\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.864435 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862504 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnqs\" (UniqueName: \"kubernetes.io/projected/b0ad4453-8ecb-480d-b737-430da77a060e-kube-api-access-hpnqs\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862550 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-var-lib-kubelet\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862575 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-slash\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-node-log\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862624 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-host-slash\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862626 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-k8s-cni-cncf-io\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862665 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-host-run-k8s-cni-cncf-io\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-daemon-config\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862698 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-modprobe-d\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862711 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bbc409d9-e3b2-43d7-968e-e13a8445d96d-node-log\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-run\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862724 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5174921b-e915-4fa0-9a87-4a64bb1515c0-tmp-dir\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79122e8-0d5c-4ce2-b8c5-9ba937473119-tmp\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862850 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovn-node-metrics-cert\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-hostroot\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-conf-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9hdl\" (UniqueName: \"kubernetes.io/projected/6661ec26-5225-42d0-8e1f-60a5c03e3d86-kube-api-access-m9hdl\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862951 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d3d6997-1ae1-41d6-a227-0da75ce73ac0-agent-certs\") pod \"konnectivity-agent-cbmgc\" (UID: \"7d3d6997-1ae1-41d6-a227-0da75ce73ac0\") " pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.862974 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysctl-d\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-os-release\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-cni-binary-copy\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-etc-kubernetes\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863077 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5tqf\" (UniqueName: \"kubernetes.io/projected/5174921b-e915-4fa0-9a87-4a64bb1515c0-kube-api-access-v5tqf\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863102 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-os-release\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-tuned\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863176 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-daemon-config\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863243 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-hostroot\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863276 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-os-release\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863281 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-multus-conf-dir\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863411 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863521 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-etc-kubernetes\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.865678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.863753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-cni-binary-copy\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.867418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.867367 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbc409d9-e3b2-43d7-968e-e13a8445d96d-ovn-node-metrics-cert\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.869879 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.869857 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:35.869974 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.869888 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:35.870582 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.870217 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:35.870582 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.870352 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:36.370321157 +0000 UTC m=+3.000387357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:35.873459 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.873399 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtt8r\" (UniqueName: \"kubernetes.io/projected/bbc409d9-e3b2-43d7-968e-e13a8445d96d-kube-api-access-jtt8r\") pod \"ovnkube-node-5l7k5\" (UID: \"bbc409d9-e3b2-43d7-968e-e13a8445d96d\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:35.876370 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.876210 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qw56\" (UniqueName: \"kubernetes.io/projected/f5ad77ff-8c99-45ef-9728-1a8233f1f21c-kube-api-access-6qw56\") pod \"multus-2qdwr\" (UID: \"f5ad77ff-8c99-45ef-9728-1a8233f1f21c\") " pod="openshift-multus/multus-2qdwr" Jun 12 19:11:35.876633 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.876571 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdp2t\" (UniqueName: \"kubernetes.io/projected/74b0ae1a-b5f1-4fcc-818c-4a3671f018ab-kube-api-access-cdp2t\") pod \"aws-ebs-csi-driver-node-m5gnf\" (UID: \"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:35.876788 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.876767 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8gzt\" (UniqueName: \"kubernetes.io/projected/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-kube-api-access-t8gzt\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:35.878015 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.877996 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5tqf\" (UniqueName: \"kubernetes.io/projected/5174921b-e915-4fa0-9a87-4a64bb1515c0-kube-api-access-v5tqf\") pod \"node-resolver-zz8tb\" (UID: \"5174921b-e915-4fa0-9a87-4a64bb1515c0\") " pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:35.963476 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963444 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-lib-modules\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.963646 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-cnibin\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.963646 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963581 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-cnibin\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.963646 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw69f\" (UniqueName: \"kubernetes.io/projected/82a02f08-7b21-4b8c-a94f-99a2360855b6-kube-api-access-tw69f\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.963867 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963645 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-lib-modules\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.963867 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-systemd\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.963867 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963703 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-systemd\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.963867 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6661ec26-5225-42d0-8e1f-60a5c03e3d86-host\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.963867 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963858 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-kubernetes\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysctl-conf\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963910 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6661ec26-5225-42d0-8e1f-60a5c03e3d86-host\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963924 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-kubernetes\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963940 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d3d6997-1ae1-41d6-a227-0da75ce73ac0-konnectivity-ca\") pod \"konnectivity-agent-cbmgc\" (UID: \"7d3d6997-1ae1-41d6-a227-0da75ce73ac0\") " pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.963963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-host\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964034 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysctl-conf\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964055 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-sys\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964063 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-host\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964107 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-sys\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964144 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq4q8\" (UniqueName: \"kubernetes.io/projected/a79122e8-0d5c-4ce2-b8c5-9ba937473119-kube-api-access-xq4q8\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82a02f08-7b21-4b8c-a94f-99a2360855b6-iptables-alerter-script\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964197 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-system-cni-dir\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964231 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964235 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-system-cni-dir\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6661ec26-5225-42d0-8e1f-60a5c03e3d86-serviceca\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964401 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnqs\" (UniqueName: \"kubernetes.io/projected/b0ad4453-8ecb-480d-b737-430da77a060e-kube-api-access-hpnqs\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964447 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-var-lib-kubelet\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964476 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-modprobe-d\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964498 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-run\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964520 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79122e8-0d5c-4ce2-b8c5-9ba937473119-tmp\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9hdl\" (UniqueName: \"kubernetes.io/projected/6661ec26-5225-42d0-8e1f-60a5c03e3d86-kube-api-access-m9hdl\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964570 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d3d6997-1ae1-41d6-a227-0da75ce73ac0-agent-certs\") pod \"konnectivity-agent-cbmgc\" (UID: \"7d3d6997-1ae1-41d6-a227-0da75ce73ac0\") " pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.964610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964591 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysctl-d\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964626 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-os-release\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964650 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964675 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-tuned\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-kubelet-config\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964728 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964753 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a02f08-7b21-4b8c-a94f-99a2360855b6-host-slash\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964769 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6661ec26-5225-42d0-8e1f-60a5c03e3d86-serviceca\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964817 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82a02f08-7b21-4b8c-a94f-99a2360855b6-iptables-alerter-script\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964859 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d3d6997-1ae1-41d6-a227-0da75ce73ac0-konnectivity-ca\") pod \"konnectivity-agent-cbmgc\" (UID: \"7d3d6997-1ae1-41d6-a227-0da75ce73ac0\") " pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964891 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0ad4453-8ecb-480d-b737-430da77a060e-os-release\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964911 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-modprobe-d\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964956 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-var-lib-kubelet\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.964776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-dbus\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965012 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965050 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysconfig\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965050 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysctl-d\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.965355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965084 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-run\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965092 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-kubelet-config\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965134 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-dbus\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.965328 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:35.965386 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:36.465366557 +0000 UTC m=+3.095432776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965603 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-sysconfig\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965624 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965639 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.965695 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82a02f08-7b21-4b8c-a94f-99a2360855b6-host-slash\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.966212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.966079 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0ad4453-8ecb-480d-b737-430da77a060e-cni-binary-copy\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.967475 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.967451 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79122e8-0d5c-4ce2-b8c5-9ba937473119-tmp\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.967818 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.967797 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79122e8-0d5c-4ce2-b8c5-9ba937473119-etc-tuned\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.968015 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.968000 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d3d6997-1ae1-41d6-a227-0da75ce73ac0-agent-certs\") pod \"konnectivity-agent-cbmgc\" (UID: \"7d3d6997-1ae1-41d6-a227-0da75ce73ac0\") " pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:35.976825 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.976805 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnqs\" (UniqueName: \"kubernetes.io/projected/b0ad4453-8ecb-480d-b737-430da77a060e-kube-api-access-hpnqs\") pod \"multus-additional-cni-plugins-d6lfh\" (UID: \"b0ad4453-8ecb-480d-b737-430da77a060e\") " pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:35.979564 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.979536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw69f\" (UniqueName: \"kubernetes.io/projected/82a02f08-7b21-4b8c-a94f-99a2360855b6-kube-api-access-tw69f\") pod \"iptables-alerter-ndsft\" (UID: \"82a02f08-7b21-4b8c-a94f-99a2360855b6\") " pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:35.979922 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.979899 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq4q8\" (UniqueName: \"kubernetes.io/projected/a79122e8-0d5c-4ce2-b8c5-9ba937473119-kube-api-access-xq4q8\") pod \"tuned-mfjsx\" (UID: \"a79122e8-0d5c-4ce2-b8c5-9ba937473119\") " pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:35.980268 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:35.980251 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9hdl\" (UniqueName: \"kubernetes.io/projected/6661ec26-5225-42d0-8e1f-60a5c03e3d86-kube-api-access-m9hdl\") pod \"node-ca-f7qhc\" (UID: \"6661ec26-5225-42d0-8e1f-60a5c03e3d86\") " pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:36.051053 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.051008 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zz8tb" Jun 12 19:11:36.059072 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.059037 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:11:36.065796 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.065778 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" Jun 12 19:11:36.072333 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.072312 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2qdwr" Jun 12 19:11:36.079010 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.078979 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" Jun 12 19:11:36.085973 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.085949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ndsft" Jun 12 19:11:36.091573 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.091554 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:11:36.098101 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.098082 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f7qhc" Jun 12 19:11:36.103576 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.103559 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" Jun 12 19:11:36.367899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.367863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:36.368093 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.368001 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:36.368093 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.368073 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:37.368056333 +0000 UTC m=+3.998122531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:36.468476 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.468440 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:36.468644 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.468509 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:36.468644 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.468605 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:36.468644 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.468627 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:36.468644 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.468646 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:36.468805 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.468656 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:36.468805 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.468676 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:37.4686611 +0000 UTC m=+4.098727298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:36.468805 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:36.468698 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:37.468683258 +0000 UTC m=+4.098749474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:36.737190 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.737159 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5174921b_e915_4fa0_9a87_4a64bb1515c0.slice/crio-cf836af096eae5fb086488ed47c22a567b9a3a9fa62cd3dccf54e8387b2a064e WatchSource:0}: Error finding container cf836af096eae5fb086488ed47c22a567b9a3a9fa62cd3dccf54e8387b2a064e: Status 404 returned error can't find the container with id cf836af096eae5fb086488ed47c22a567b9a3a9fa62cd3dccf54e8387b2a064e Jun 12 19:11:36.738786 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.738689 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc409d9_e3b2_43d7_968e_e13a8445d96d.slice/crio-441ee4416081799e1586d3b8cd3be78cfdffdb6aa49ed24cfff51683dda3b709 WatchSource:0}: Error finding container 441ee4416081799e1586d3b8cd3be78cfdffdb6aa49ed24cfff51683dda3b709: Status 404 returned error can't find the container with id 441ee4416081799e1586d3b8cd3be78cfdffdb6aa49ed24cfff51683dda3b709 Jun 12 19:11:36.741991 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.741966 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79122e8_0d5c_4ce2_b8c5_9ba937473119.slice/crio-7ae653c231b8403ed4711f3555f2103192a56bccc8926d7b5133d54574ef1040 WatchSource:0}: Error finding container 7ae653c231b8403ed4711f3555f2103192a56bccc8926d7b5133d54574ef1040: Status 404 returned error can't find the container with id 7ae653c231b8403ed4711f3555f2103192a56bccc8926d7b5133d54574ef1040 Jun 12 19:11:36.742615 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.742589 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ad4453_8ecb_480d_b737_430da77a060e.slice/crio-6f494ea76ae6fc3990c3e4cf325f1a6e26c4c78b67aea36d859324487f0a0201 WatchSource:0}: Error finding container 6f494ea76ae6fc3990c3e4cf325f1a6e26c4c78b67aea36d859324487f0a0201: Status 404 returned error can't find the container with id 6f494ea76ae6fc3990c3e4cf325f1a6e26c4c78b67aea36d859324487f0a0201 Jun 12 19:11:36.743371 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.743283 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3d6997_1ae1_41d6_a227_0da75ce73ac0.slice/crio-a54c225bf6bf200a6f7986fd3f1fec18c2790ca8629ab09f4f122116a3992ec6 WatchSource:0}: Error finding container a54c225bf6bf200a6f7986fd3f1fec18c2790ca8629ab09f4f122116a3992ec6: Status 404 returned error can't find the container with id a54c225bf6bf200a6f7986fd3f1fec18c2790ca8629ab09f4f122116a3992ec6 Jun 12 19:11:36.744786 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.744744 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b0ae1a_b5f1_4fcc_818c_4a3671f018ab.slice/crio-dfef81ff4c0112613a436f9f1870641607b828da477e1e33af18eb25ec64faca WatchSource:0}: Error finding container dfef81ff4c0112613a436f9f1870641607b828da477e1e33af18eb25ec64faca: Status 404 returned error can't find the container with id dfef81ff4c0112613a436f9f1870641607b828da477e1e33af18eb25ec64faca Jun 12 19:11:36.745955 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:11:36.745873 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6661ec26_5225_42d0_8e1f_60a5c03e3d86.slice/crio-09c4bccc4d139bd5ed44ae8fd244d1b82e9f9cef2a70c4d7d4d3d5ad6bf3a2ca WatchSource:0}: Error finding container 09c4bccc4d139bd5ed44ae8fd244d1b82e9f9cef2a70c4d7d4d3d5ad6bf3a2ca: Status 404 returned error can't find the container with id 09c4bccc4d139bd5ed44ae8fd244d1b82e9f9cef2a70c4d7d4d3d5ad6bf3a2ca Jun 12 19:11:36.794190 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.794148 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 19:06:34 +0000 UTC" deadline="2028-02-25 13:09:43.742667664 +0000 UTC" Jun 12 19:11:36.794190 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.794189 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14945h58m6.948481623s" Jun 12 19:11:36.818367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.818338 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ndsft" event={"ID":"82a02f08-7b21-4b8c-a94f-99a2360855b6","Type":"ContainerStarted","Data":"41f76498d0fbd1216bd8ca9e53801df224c8491ffe0c20dec150265644c6cfac"} Jun 12 19:11:36.819605 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.819576 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" event={"ID":"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab","Type":"ContainerStarted","Data":"dfef81ff4c0112613a436f9f1870641607b828da477e1e33af18eb25ec64faca"} Jun 12 19:11:36.820782 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.820751 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cbmgc" event={"ID":"7d3d6997-1ae1-41d6-a227-0da75ce73ac0","Type":"ContainerStarted","Data":"a54c225bf6bf200a6f7986fd3f1fec18c2790ca8629ab09f4f122116a3992ec6"} Jun 12 19:11:36.822013 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.821990 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"441ee4416081799e1586d3b8cd3be78cfdffdb6aa49ed24cfff51683dda3b709"} Jun 12 19:11:36.824491 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.824403 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" event={"ID":"95b28959981f75938365112db4b98b52","Type":"ContainerStarted","Data":"42148aec339f4e2a4f0c26351694b732a66d625f6b01515cc2b5bf06a94fbc9b"} Jun 12 19:11:36.825770 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.825748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2qdwr" event={"ID":"f5ad77ff-8c99-45ef-9728-1a8233f1f21c","Type":"ContainerStarted","Data":"d26a218a7d1a944edd84618719202341592756c8ff59a2835fd408367b836ba6"} Jun 12 19:11:36.826864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.826845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7qhc" event={"ID":"6661ec26-5225-42d0-8e1f-60a5c03e3d86","Type":"ContainerStarted","Data":"09c4bccc4d139bd5ed44ae8fd244d1b82e9f9cef2a70c4d7d4d3d5ad6bf3a2ca"} Jun 12 19:11:36.827875 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.827853 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerStarted","Data":"6f494ea76ae6fc3990c3e4cf325f1a6e26c4c78b67aea36d859324487f0a0201"} Jun 12 19:11:36.828827 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.828804 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" event={"ID":"a79122e8-0d5c-4ce2-b8c5-9ba937473119","Type":"ContainerStarted","Data":"7ae653c231b8403ed4711f3555f2103192a56bccc8926d7b5133d54574ef1040"} Jun 12 19:11:36.829781 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:36.829757 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zz8tb" event={"ID":"5174921b-e915-4fa0-9a87-4a64bb1515c0","Type":"ContainerStarted","Data":"cf836af096eae5fb086488ed47c22a567b9a3a9fa62cd3dccf54e8387b2a064e"} Jun 12 19:11:37.376045 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.375397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:37.376045 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.375571 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:37.376045 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.375640 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:39.375621355 +0000 UTC m=+6.005687558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:37.476699 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.476638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:37.476863 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.476711 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:37.476863 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.476849 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:37.476985 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.476913 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:39.4768956 +0000 UTC m=+6.106961804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:37.477463 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.477306 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:37.477463 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.477342 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:37.477463 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.477356 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:37.477463 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.477404 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:39.477389528 +0000 UTC m=+6.107455734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:37.811298 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.810549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:37.811298 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.810690 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:37.811298 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.811087 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:37.811298 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.811179 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:37.813488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.811998 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:37.813488 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:37.812101 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:37.844274 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.844238 2554 generic.go:356] "Generic (PLEG): container finished" podID="9e49fafff1875e004fc8cc3fbdd3260c" containerID="9e7b7ef2d5d976ef32820f3c45a4cbdd462f1340584fd3dc89be25beb9bfff73" exitCode=0 Jun 12 19:11:37.844489 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.844464 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" event={"ID":"9e49fafff1875e004fc8cc3fbdd3260c","Type":"ContainerDied","Data":"9e7b7ef2d5d976ef32820f3c45a4cbdd462f1340584fd3dc89be25beb9bfff73"} Jun 12 19:11:37.862727 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:37.862676 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-61.ec2.internal" podStartSLOduration=3.862606147 podStartE2EDuration="3.862606147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:36.847559729 +0000 UTC m=+3.477625948" watchObservedRunningTime="2026-06-12 19:11:37.862606147 +0000 UTC m=+4.492672367" Jun 12 19:11:38.864412 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:38.863674 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" event={"ID":"9e49fafff1875e004fc8cc3fbdd3260c","Type":"ContainerStarted","Data":"913b1d528512c19fda14ea857c68fd9aee341bc2cd14d6a3c894ccae1beda40e"} Jun 12 19:11:39.393392 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:39.393353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:39.393591 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.393545 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:39.393655 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.393608 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:43.393589861 +0000 UTC m=+10.023656061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:39.494725 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:39.494688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:39.494904 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:39.494764 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:39.494975 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.494922 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:39.494975 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.494941 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:39.494975 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.494955 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:39.495096 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.495013 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:43.494994101 +0000 UTC m=+10.125060325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:39.495449 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.495406 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:39.495554 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.495474 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:43.495459466 +0000 UTC m=+10.125525684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:39.812598 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:39.812568 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:39.812771 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.812687 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:39.812771 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:39.812710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:39.812899 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.812786 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:39.812899 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:39.812844 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:39.813002 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:39.812906 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:41.814015 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:41.813935 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:41.814015 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:41.813957 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:41.814553 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:41.814064 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:41.814553 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:41.814476 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:41.814553 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:41.814528 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:41.814695 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:41.814599 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:43.429919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:43.429885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:43.430378 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.430064 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:43.430378 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.430142 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:51.430121943 +0000 UTC m=+18.060188145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:43.530767 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:43.530721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:43.530792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.530860 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.530880 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.530883 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.530893 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.530939 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:51.530921781 +0000 UTC m=+18.160987993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:43.530955 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.530956 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:11:51.530948255 +0000 UTC m=+18.161014454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:43.812469 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:43.811391 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:43.812469 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.811508 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:43.812469 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:43.811564 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:43.812469 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.811636 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:43.812469 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:43.811671 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:43.812469 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:43.811740 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:45.810403 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:45.810360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:45.810911 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:45.810365 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:45.810911 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:45.810517 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:45.810911 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:45.810574 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:45.810911 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:45.810375 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:45.810911 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:45.810672 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:47.809920 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:47.809883 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:47.809920 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:47.809895 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:47.810411 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:47.810008 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:47.810411 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:47.810077 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:47.810411 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:47.810109 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:47.810411 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:47.810212 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:49.809959 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:49.809924 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:49.810347 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:49.809924 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:49.810347 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:49.810038 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:49.810347 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:49.810099 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:49.810347 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:49.809924 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:49.810347 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:49.810189 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:51.487038 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:51.487005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:51.487635 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.487180 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:51.487635 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.487259 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:07.48723858 +0000 UTC m=+34.117304778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:11:51.587655 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:51.587614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:51.587831 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:51.587686 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:51.587831 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.587790 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:51.587947 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.587840 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:11:51.587947 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.587857 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:11:51.587947 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.587869 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:51.587947 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.587873 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:07.587851923 +0000 UTC m=+34.217918121 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:11:51.587947 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.587910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:07.587899798 +0000 UTC m=+34.217965996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:11:51.810213 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:51.810130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:51.810213 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:51.810159 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:51.810459 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:51.810130 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:51.810459 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.810266 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:51.810459 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.810334 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:51.810459 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:51.810441 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:53.811063 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:53.811029 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:53.811646 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:53.811145 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:53.811646 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:53.811171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:53.811646 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:53.811285 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:53.811646 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:53.811319 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:53.811646 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:53.811385 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:55.809983 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.809944 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:55.810538 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.809945 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:55.810538 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:55.810079 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:55.810538 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:55.810143 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:55.810538 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.810185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:55.810538 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:55.810236 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:55.901955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.901919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" event={"ID":"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab","Type":"ContainerStarted","Data":"012c88b45ef462ee6c6ec1d5d596959d6f46348e7d98287bd088527ba0332367"} Jun 12 19:11:55.903298 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.903269 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cbmgc" event={"ID":"7d3d6997-1ae1-41d6-a227-0da75ce73ac0","Type":"ContainerStarted","Data":"95aa060630ff28b1601913192be4ca43049a30fe81ab23037bb2ae1477e6a1c5"} Jun 12 19:11:55.904912 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.904888 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:11:55.905176 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.905155 2554 generic.go:356] "Generic (PLEG): container finished" podID="bbc409d9-e3b2-43d7-968e-e13a8445d96d" containerID="f89bcdb1bf7650e47b8dab9dbbb942eec0c2e32d4edee0bbc01a74bded2c7cc5" exitCode=1 Jun 12 19:11:55.905259 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.905182 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerDied","Data":"f89bcdb1bf7650e47b8dab9dbbb942eec0c2e32d4edee0bbc01a74bded2c7cc5"} Jun 12 19:11:55.905302 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.905256 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"547bde2754bd59d1fdc1ce257f71ac6f6560acd77bcd77d95923862560788640"} Jun 12 19:11:55.906560 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.906512 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2qdwr" event={"ID":"f5ad77ff-8c99-45ef-9728-1a8233f1f21c","Type":"ContainerStarted","Data":"f7137f24de3b40d4fe957015915ed7ef969eb7179e6dd96afb273e0e08f536fd"} Jun 12 19:11:55.907930 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.907907 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f7qhc" event={"ID":"6661ec26-5225-42d0-8e1f-60a5c03e3d86","Type":"ContainerStarted","Data":"4ef0996ddaa93b164a1f904add120ada790ce349f429cce9220d06e0377bd3c1"} Jun 12 19:11:55.910023 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.909707 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0ad4453-8ecb-480d-b737-430da77a060e" containerID="c32bdf1f2b210eb68e25c4bf9a11dcb86e198e8ae22420b7108930ab16647254" exitCode=0 Jun 12 19:11:55.910023 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.909788 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerDied","Data":"c32bdf1f2b210eb68e25c4bf9a11dcb86e198e8ae22420b7108930ab16647254"} Jun 12 19:11:55.911674 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.911544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" event={"ID":"a79122e8-0d5c-4ce2-b8c5-9ba937473119","Type":"ContainerStarted","Data":"9711cf1cb2f625656edbf7fd371711b1ab2589ea993d050f10418695e4637eb0"} Jun 12 19:11:55.913141 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.913116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zz8tb" event={"ID":"5174921b-e915-4fa0-9a87-4a64bb1515c0","Type":"ContainerStarted","Data":"3e92a0c02f964bcfae1c258394af7c3e4c13ac1fe1e30d2aaf081ceff00f05ab"} Jun 12 19:11:55.921777 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.921731 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-61.ec2.internal" podStartSLOduration=21.921717379 podStartE2EDuration="21.921717379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:38.882211128 +0000 UTC m=+5.512277340" watchObservedRunningTime="2026-06-12 19:11:55.921717379 +0000 UTC m=+22.551783599" Jun 12 19:11:55.938885 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.938825 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cbmgc" podStartSLOduration=7.225616245 podStartE2EDuration="21.938808952s" totalImagesPullingTime="14.713192707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:55.921508424 +0000 UTC m=+22.551574638" watchObservedRunningTime="2026-06-12 19:11:55.938808952 +0000 UTC m=+22.568875233" Jun 12 19:11:55.939117 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.939022 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zz8tb" podStartSLOduration=4.117269971 podStartE2EDuration="22.939011414s" totalImagesPullingTime="18.821741443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:55.938555376 +0000 UTC m=+22.568621595" watchObservedRunningTime="2026-06-12 19:11:55.939011414 +0000 UTC m=+22.569077636" Jun 12 19:11:55.968904 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.968840 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2qdwr" podStartSLOduration=4.102122964 podStartE2EDuration="22.968820441s" totalImagesPullingTime="18.866697477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:55.965850233 +0000 UTC m=+22.595916452" watchObservedRunningTime="2026-06-12 19:11:55.968820441 +0000 UTC m=+22.598886663" Jun 12 19:11:55.993836 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:55.993789 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mfjsx" podStartSLOduration=3.172629442 podStartE2EDuration="21.993773735s" totalImagesPullingTime="18.821144293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:55.993638769 +0000 UTC m=+22.623704989" watchObservedRunningTime="2026-06-12 19:11:55.993773735 +0000 UTC m=+22.623839992" Jun 12 19:11:56.017673 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:56.017624 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f7qhc" podStartSLOduration=3.219114625 podStartE2EDuration="22.017607918s" totalImagesPullingTime="18.798493293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:56.017308728 +0000 UTC m=+22.647374948" watchObservedRunningTime="2026-06-12 19:11:56.017607918 +0000 UTC m=+22.647674138" Jun 12 19:11:56.917721 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:56.917692 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:11:56.918225 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:56.917985 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"1a35f1a62012906efa01eb3ec04d415b3696a7341e29065d8c7301ec331ec71f"} Jun 12 19:11:56.918225 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:56.918086 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"bbee38ea79f4911d0e8e52256b43ca5d034ebbfe6bf1fc0aee7ba9df6af08360"} Jun 12 19:11:56.918225 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:56.918118 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"ebe98657bfbc09b9dbe99f05bc3ab487badbb2f32f5220cd72e777448459e154"} Jun 12 19:11:56.918225 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:56.918149 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"b1c53573c7337a1bf7b9b7206fc58c402a5862f716c0babf20109dd677ec5d87"} Jun 12 19:11:57.193679 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.193651 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 19:11:57.810348 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.810301 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:57.810652 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:57.810440 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:57.810652 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.810467 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:57.810652 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:57.810579 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:57.810652 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.810315 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:57.810864 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:57.810686 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:11:57.820538 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.820447 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T19:11:57.193671694Z","UUID":"126e78f5-90ec-47d3-94f1-78ca6c432861","Handler":null,"Name":"","Endpoint":""} Jun 12 19:11:57.822291 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.822067 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 19:11:57.822291 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.822112 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 19:11:57.921552 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.921518 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ndsft" event={"ID":"82a02f08-7b21-4b8c-a94f-99a2360855b6","Type":"ContainerStarted","Data":"37f46f4b58d136dac34596d278292b2548a0a386a735dee4381fe49a2c4cb06c"} Jun 12 19:11:57.923256 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.923231 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" event={"ID":"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab","Type":"ContainerStarted","Data":"182d704806e18fd47fb8159899c67d6aa576add6f5994324106683647bb1a2d7"} Jun 12 19:11:57.940501 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:57.940442 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ndsft" podStartSLOduration=5.14240632 podStartE2EDuration="23.940414124s" totalImagesPullingTime="18.798007804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:57.939660126 +0000 UTC m=+24.569726351" watchObservedRunningTime="2026-06-12 19:11:57.940414124 +0000 UTC m=+24.570480343" Jun 12 19:11:58.927737 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:58.927703 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" event={"ID":"74b0ae1a-b5f1-4fcc-818c-4a3671f018ab","Type":"ContainerStarted","Data":"aadfd3b9a7bf83f7b11f55d7fb57a7b4a7348ab1ec5599cb53cfc43de916b021"} Jun 12 19:11:58.930761 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:58.930735 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:11:58.931133 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:58.931114 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"529286af7b79070368f6e515f620320427b42fdfe131bb96fe9acb421260aacb"} Jun 12 19:11:58.946888 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:58.946836 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5gnf" podStartSLOduration=4.75373978 podStartE2EDuration="25.946819891s" totalImagesPullingTime="21.193080111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:58.946765182 +0000 UTC m=+25.576831402" watchObservedRunningTime="2026-06-12 19:11:58.946819891 +0000 UTC m=+25.576886094" Jun 12 19:11:59.810189 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:59.810154 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:11:59.810498 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:59.810154 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:11:59.810498 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:59.810286 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:11:59.810498 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:11:59.810157 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:11:59.810498 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:59.810341 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:11:59.810498 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:11:59.810410 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:12:00.498675 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:00.498634 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:12:00.499625 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:00.499602 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:12:00.936062 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:00.936023 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:12:00.936595 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:00.936577 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cbmgc" Jun 12 19:12:01.809717 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.809548 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:01.810095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.809549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:01.810095 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:01.809792 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:12:01.810095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.809549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:01.810095 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:01.809909 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:12:01.810095 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:01.809924 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:12:01.942077 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.942045 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:12:01.943034 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.942992 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"413139a8ceeb1b29fa547000017b41e46125ef7bc348e1fdeb3d61958dbf40f5"} Jun 12 19:12:01.943544 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.943372 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:12:01.943544 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.943468 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:12:01.943688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.943569 2554 scope.go:117] "RemoveContainer" containerID="f89bcdb1bf7650e47b8dab9dbbb942eec0c2e32d4edee0bbc01a74bded2c7cc5" Jun 12 19:12:01.960743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.960521 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:12:01.963542 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:01.963367 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:12:02.946534 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:02.946498 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0ad4453-8ecb-480d-b737-430da77a060e" containerID="260ee0ca794351b1afcf22b468f24bdc604809e4fe3094e7b41bec680ffd2a65" exitCode=0 Jun 12 19:12:02.946997 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:02.946581 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerDied","Data":"260ee0ca794351b1afcf22b468f24bdc604809e4fe3094e7b41bec680ffd2a65"} Jun 12 19:12:02.950213 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:02.950192 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:12:02.950609 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:02.950515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" event={"ID":"bbc409d9-e3b2-43d7-968e-e13a8445d96d","Type":"ContainerStarted","Data":"0f4f5ef67b011631d168615bd6c6307018048b51186b5dba8f30c44ea3f4d038"} Jun 12 19:12:02.950609 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:02.950597 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 19:12:03.001676 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:03.001556 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" podStartSLOduration=11.127301753 podStartE2EDuration="30.001539955s" totalImagesPullingTime="18.874238202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:03.000779624 +0000 UTC m=+29.630845878" watchObservedRunningTime="2026-06-12 19:12:03.001539955 +0000 UTC m=+29.631606185" Jun 12 19:12:03.810495 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:03.810303 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:03.810653 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:03.810360 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:03.810653 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:03.810581 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:12:03.810737 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:03.810651 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:12:03.810737 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:03.810383 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:03.810798 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:03.810735 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:12:03.953061 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:03.953034 2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 19:12:04.000289 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.000223 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-242v4"] Jun 12 19:12:04.000511 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.000394 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:04.000632 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:04.000518 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:12:04.001253 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.001199 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f488f"] Jun 12 19:12:04.001322 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.001296 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:04.001413 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:04.001391 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:12:04.001948 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.001906 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qnq2v"] Jun 12 19:12:04.002066 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.002002 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:04.002133 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:04.002088 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:12:04.461907 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.461864 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:12:04.957102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.957062 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0ad4453-8ecb-480d-b737-430da77a060e" containerID="8a9b035852c9a0f6ad94dccade2ccb17412b3dc7741905950bf27e4892a85c78" exitCode=0 Jun 12 19:12:04.957713 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:04.957139 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerDied","Data":"8a9b035852c9a0f6ad94dccade2ccb17412b3dc7741905950bf27e4892a85c78"} Jun 12 19:12:05.810378 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:05.810143 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:05.810546 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:05.810143 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:05.810546 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:05.810500 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:12:05.810546 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:05.810167 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:05.810690 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:05.810548 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:12:05.810690 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:05.810627 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:12:05.962096 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:05.962011 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0ad4453-8ecb-480d-b737-430da77a060e" containerID="85d843301ff4f184148f5971c0b2ad97f2a2df08a3f19438c503e603e9ccc550" exitCode=0 Jun 12 19:12:05.962096 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:05.962049 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerDied","Data":"85d843301ff4f184148f5971c0b2ad97f2a2df08a3f19438c503e603e9ccc550"} Jun 12 19:12:07.504693 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:07.504656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:07.505272 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.504816 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:12:07.505272 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.504886 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:39.504866134 +0000 UTC m=+66.134932332 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 19:12:07.605319 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:07.605279 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:07.605529 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:07.605350 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:07.605529 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.605465 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 19:12:07.605529 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.605475 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 19:12:07.605529 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.605493 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 19:12:07.605529 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.605507 2554 projected.go:196] Error preparing data for projected volume kube-api-access-hkm6j for pod openshift-network-diagnostics/network-check-target-242v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:12:07.605791 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.605547 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret podName:d1aa761a-48ed-4e86-a2a9-9b60abdac1c3 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:39.605525138 +0000 UTC m=+66.235591355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret") pod "global-pull-secret-syncer-f488f" (UID: "d1aa761a-48ed-4e86-a2a9-9b60abdac1c3") : object "kube-system"/"original-pull-secret" not registered Jun 12 19:12:07.605791 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.605570 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j podName:68aef275-a885-42e2-b4b9-8ff7f7b06a68 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:39.605558898 +0000 UTC m=+66.235625096 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hkm6j" (UniqueName: "kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j") pod "network-check-target-242v4" (UID: "68aef275-a885-42e2-b4b9-8ff7f7b06a68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 19:12:07.814189 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:07.814104 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:07.814356 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:07.814227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:07.814356 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:07.814237 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:07.814356 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.814232 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f488f" podUID="d1aa761a-48ed-4e86-a2a9-9b60abdac1c3" Jun 12 19:12:07.814356 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.814324 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-242v4" podUID="68aef275-a885-42e2-b4b9-8ff7f7b06a68" Jun 12 19:12:07.814586 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:07.814407 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:12:09.625036 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.625000 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-61.ec2.internal" event="NodeReady" Jun 12 19:12:09.625463 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.625145 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 19:12:09.678035 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.678001 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pnmjv"] Jun 12 19:12:09.680668 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.680645 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.682293 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.682267 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bzkjg"] Jun 12 19:12:09.684052 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.684032 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.684296 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.684267 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 19:12:09.684517 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.684501 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z8hpj\"" Jun 12 19:12:09.684742 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.684720 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 19:12:09.684923 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.684900 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 19:12:09.687971 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.687952 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 19:12:09.688075 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.687992 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 19:12:09.688075 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.688021 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b26x6\"" Jun 12 19:12:09.703402 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.703379 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pnmjv"] Jun 12 19:12:09.705828 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.705798 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bzkjg"] Jun 12 19:12:09.809769 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.809724 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:09.809962 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.809776 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:09.810027 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.809962 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:09.814308 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.814269 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rt4s\"" Jun 12 19:12:09.815970 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.815949 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 19:12:09.816091 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.815976 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 19:12:09.816091 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.815992 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 19:12:09.816650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.816632 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 19:12:09.817784 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.817765 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trrmf\"" Jun 12 19:12:09.819896 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.819870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29b86679-82f5-4b22-b237-6baf60380db9-config-volume\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.819994 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.819913 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmmg\" (UniqueName: \"kubernetes.io/projected/29b86679-82f5-4b22-b237-6baf60380db9-kube-api-access-2gmmg\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.819994 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.819953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk2jm\" (UniqueName: \"kubernetes.io/projected/2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9-kube-api-access-bk2jm\") pod \"ingress-canary-pnmjv\" (UID: \"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9\") " pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.820112 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.820020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b86679-82f5-4b22-b237-6baf60380db9-tmp-dir\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.820112 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.820085 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.820212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.820136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9-cert\") pod \"ingress-canary-pnmjv\" (UID: \"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9\") " pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.920542 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.920502 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk2jm\" (UniqueName: \"kubernetes.io/projected/2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9-kube-api-access-bk2jm\") pod \"ingress-canary-pnmjv\" (UID: \"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9\") " pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.920780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.920745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b86679-82f5-4b22-b237-6baf60380db9-tmp-dir\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.920871 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.920818 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.920871 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.920847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9-cert\") pod \"ingress-canary-pnmjv\" (UID: \"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9\") " pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.920965 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.920900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29b86679-82f5-4b22-b237-6baf60380db9-config-volume\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.920965 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.920931 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmmg\" (UniqueName: \"kubernetes.io/projected/29b86679-82f5-4b22-b237-6baf60380db9-kube-api-access-2gmmg\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.921042 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:09.920973 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:09.921042 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:09.921036 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:10.421016203 +0000 UTC m=+37.051082403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:09.921153 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.921109 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29b86679-82f5-4b22-b237-6baf60380db9-tmp-dir\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.921790 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.921754 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29b86679-82f5-4b22-b237-6baf60380db9-config-volume\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.926185 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.926160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9-cert\") pod \"ingress-canary-pnmjv\" (UID: \"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9\") " pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.934730 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.934699 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmmg\" (UniqueName: \"kubernetes.io/projected/29b86679-82f5-4b22-b237-6baf60380db9-kube-api-access-2gmmg\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:09.934879 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.934767 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk2jm\" (UniqueName: \"kubernetes.io/projected/2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9-kube-api-access-bk2jm\") pod \"ingress-canary-pnmjv\" (UID: \"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9\") " pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:09.993407 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:09.993369 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pnmjv" Jun 12 19:12:10.424338 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:10.424298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:10.424525 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:10.424493 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:10.424607 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:10.424572 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:11.424549785 +0000 UTC m=+38.054616038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:10.838213 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:10.838178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pnmjv"] Jun 12 19:12:10.889113 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:12:10.889080 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa3df4b_c6bd_4343_b1c2_9a96b1b261f9.slice/crio-4ac5c01c7e994cc70a7f040a4dd3d7e7194c2dcf9addcf5031393cc11ef8483e WatchSource:0}: Error finding container 4ac5c01c7e994cc70a7f040a4dd3d7e7194c2dcf9addcf5031393cc11ef8483e: Status 404 returned error can't find the container with id 4ac5c01c7e994cc70a7f040a4dd3d7e7194c2dcf9addcf5031393cc11ef8483e Jun 12 19:12:10.975330 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:10.975268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pnmjv" event={"ID":"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9","Type":"ContainerStarted","Data":"4ac5c01c7e994cc70a7f040a4dd3d7e7194c2dcf9addcf5031393cc11ef8483e"} Jun 12 19:12:11.432416 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:11.432376 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:11.432641 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:11.432559 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:11.432703 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:11.432642 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:13.432619905 +0000 UTC m=+40.062686119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:11.979747 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:11.979710 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0ad4453-8ecb-480d-b737-430da77a060e" containerID="fe4627b88fce1f66a469ec5f8900778dd185660c4b8619474ebba9bf12aa7c58" exitCode=0 Jun 12 19:12:11.980337 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:11.979760 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerDied","Data":"fe4627b88fce1f66a469ec5f8900778dd185660c4b8619474ebba9bf12aa7c58"} Jun 12 19:12:12.985396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:12.985362 2554 generic.go:356] "Generic (PLEG): container finished" podID="b0ad4453-8ecb-480d-b737-430da77a060e" containerID="3e611ab2cc83eeeb0c6a8b881595b6223f239543d571f10a2ec572366fe6af19" exitCode=0 Jun 12 19:12:12.985852 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:12.985410 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerDied","Data":"3e611ab2cc83eeeb0c6a8b881595b6223f239543d571f10a2ec572366fe6af19"} Jun 12 19:12:13.446819 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:13.446778 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:13.446979 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:13.446921 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:13.447020 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:13.447000 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:17.446980442 +0000 UTC m=+44.077046652 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:13.991097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:13.991004 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" event={"ID":"b0ad4453-8ecb-480d-b737-430da77a060e","Type":"ContainerStarted","Data":"0a15f516e9c0b8c746a40d54b88970d1fe71f312a0d5ea63f60844e4f5098c99"} Jun 12 19:12:13.992619 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:13.992596 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pnmjv" event={"ID":"2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9","Type":"ContainerStarted","Data":"a6822f0aaf284305b22137c861f3652a282deeb6c9aee7bb375226ccb39f31d5"} Jun 12 19:12:14.019900 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:14.019850 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d6lfh" podStartSLOduration=8.698155999 podStartE2EDuration="40.019836753s" totalImagesPullingTime="31.321680754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:14.018072932 +0000 UTC m=+40.648139152" watchObservedRunningTime="2026-06-12 19:12:14.019836753 +0000 UTC m=+40.649902972" Jun 12 19:12:14.035404 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:14.035352 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pnmjv" podStartSLOduration=2.264838556 podStartE2EDuration="5.035335922s" totalImagesPullingTime="2.770497366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:14.034605793 +0000 UTC m=+40.664672014" watchObservedRunningTime="2026-06-12 19:12:14.035335922 +0000 UTC m=+40.665402154" Jun 12 19:12:17.386125 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.386093 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b"] Jun 12 19:12:17.411731 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.411705 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b"] Jun 12 19:12:17.411886 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.411813 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.415954 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.415932 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nrhzj\"" Jun 12 19:12:17.416106 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.415963 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 19:12:17.416106 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.415979 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 19:12:17.416106 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.415931 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 19:12:17.416106 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.415931 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 19:12:17.418198 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.418158 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv"] Jun 12 19:12:17.433503 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.433475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.435511 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.435487 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv"] Jun 12 19:12:17.436263 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.436247 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 12 19:12:17.477305 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.477274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:17.477506 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:17.477459 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:17.477550 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:17.477516 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:25.47750074 +0000 UTC m=+52.107566939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:17.578258 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.578221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d57867d2-662b-420e-939f-c3693968487a-tmp\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.578258 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.578255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d57867d2-662b-420e-939f-c3693968487a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.578410 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.578277 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2526\" (UniqueName: \"kubernetes.io/projected/d57867d2-662b-420e-939f-c3693968487a-kube-api-access-f2526\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.578410 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.578369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46713dc6-001d-4e49-ac97-2992074420fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67d98454b4-p9t9b\" (UID: \"46713dc6-001d-4e49-ac97-2992074420fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.578503 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.578420 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg48w\" (UniqueName: \"kubernetes.io/projected/46713dc6-001d-4e49-ac97-2992074420fd-kube-api-access-fg48w\") pod \"managed-serviceaccount-addon-agent-67d98454b4-p9t9b\" (UID: \"46713dc6-001d-4e49-ac97-2992074420fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.679300 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.679271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2526\" (UniqueName: \"kubernetes.io/projected/d57867d2-662b-420e-939f-c3693968487a-kube-api-access-f2526\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.679385 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.679329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46713dc6-001d-4e49-ac97-2992074420fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67d98454b4-p9t9b\" (UID: \"46713dc6-001d-4e49-ac97-2992074420fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.679385 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.679372 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg48w\" (UniqueName: \"kubernetes.io/projected/46713dc6-001d-4e49-ac97-2992074420fd-kube-api-access-fg48w\") pod \"managed-serviceaccount-addon-agent-67d98454b4-p9t9b\" (UID: \"46713dc6-001d-4e49-ac97-2992074420fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.679481 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.679465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d57867d2-662b-420e-939f-c3693968487a-tmp\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.679536 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.679493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d57867d2-662b-420e-939f-c3693968487a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.679819 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.679798 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d57867d2-662b-420e-939f-c3693968487a-tmp\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.682932 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.682902 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d57867d2-662b-420e-939f-c3693968487a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.683013 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.682905 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/46713dc6-001d-4e49-ac97-2992074420fd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67d98454b4-p9t9b\" (UID: \"46713dc6-001d-4e49-ac97-2992074420fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.688499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.688474 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2526\" (UniqueName: \"kubernetes.io/projected/d57867d2-662b-420e-939f-c3693968487a-kube-api-access-f2526\") pod \"klusterlet-addon-workmgr-b58756666-tjxfv\" (UID: \"d57867d2-662b-420e-939f-c3693968487a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.688617 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.688474 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg48w\" (UniqueName: \"kubernetes.io/projected/46713dc6-001d-4e49-ac97-2992074420fd-kube-api-access-fg48w\") pod \"managed-serviceaccount-addon-agent-67d98454b4-p9t9b\" (UID: \"46713dc6-001d-4e49-ac97-2992074420fd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.731196 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.731163 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:12:17.743346 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.743321 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:17.892517 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.892483 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b"] Jun 12 19:12:17.895906 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:12:17.895874 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46713dc6_001d_4e49_ac97_2992074420fd.slice/crio-900f01867139239ebbbf107e5d174a9556dd28201d3394657ed93d5377bb539c WatchSource:0}: Error finding container 900f01867139239ebbbf107e5d174a9556dd28201d3394657ed93d5377bb539c: Status 404 returned error can't find the container with id 900f01867139239ebbbf107e5d174a9556dd28201d3394657ed93d5377bb539c Jun 12 19:12:17.912534 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:17.912508 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv"] Jun 12 19:12:17.915183 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:12:17.915157 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57867d2_662b_420e_939f_c3693968487a.slice/crio-b597de20d462ff5cb32a3245c724db6531e544bca66083a33827a30ff2b41939 WatchSource:0}: Error finding container b597de20d462ff5cb32a3245c724db6531e544bca66083a33827a30ff2b41939: Status 404 returned error can't find the container with id b597de20d462ff5cb32a3245c724db6531e544bca66083a33827a30ff2b41939 Jun 12 19:12:18.003332 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:18.003228 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" event={"ID":"d57867d2-662b-420e-939f-c3693968487a","Type":"ContainerStarted","Data":"b597de20d462ff5cb32a3245c724db6531e544bca66083a33827a30ff2b41939"} Jun 12 19:12:18.004200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:18.004179 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" event={"ID":"46713dc6-001d-4e49-ac97-2992074420fd","Type":"ContainerStarted","Data":"900f01867139239ebbbf107e5d174a9556dd28201d3394657ed93d5377bb539c"} Jun 12 19:12:24.022877 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:24.022839 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" event={"ID":"d57867d2-662b-420e-939f-c3693968487a","Type":"ContainerStarted","Data":"9fb68fb2d0277809419fe06e6a272cf00f2c543af4eda269f03b6b8ae564076e"} Jun 12 19:12:24.023445 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:24.023017 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:24.024382 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:24.024353 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" event={"ID":"46713dc6-001d-4e49-ac97-2992074420fd","Type":"ContainerStarted","Data":"2e9f9462c5f65b10abcb73495e60dc03547f3e768d80ac889ebc525f662842e9"} Jun 12 19:12:24.024953 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:24.024938 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:12:24.043400 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:24.043345 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" podStartSLOduration=1.352455581 podStartE2EDuration="7.043327606s" totalImagesPullingTime="5.690872025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:24.042613259 +0000 UTC m=+50.672679478" watchObservedRunningTime="2026-06-12 19:12:24.043327606 +0000 UTC m=+50.673393821" Jun 12 19:12:25.546095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:25.546053 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:25.546509 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:25.546200 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:25.546509 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:25.546267 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:12:41.546250107 +0000 UTC m=+68.176316304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:34.973588 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:34.973552 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7k5" Jun 12 19:12:35.002167 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:35.002109 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" podStartSLOduration=12.308928793 podStartE2EDuration="18.00209098s" totalImagesPullingTime="5.693162187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:24.084095234 +0000 UTC m=+50.714161466" watchObservedRunningTime="2026-06-12 19:12:35.00209098 +0000 UTC m=+61.632157237" Jun 12 19:12:39.554686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.554632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:12:39.558089 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.558070 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 19:12:39.565350 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:39.565326 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 19:12:39.565408 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:39.565401 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:13:43.565377135 +0000 UTC m=+130.195443343 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : secret "metrics-daemon-secret" not found Jun 12 19:12:39.655351 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.655303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:39.655471 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.655404 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:39.658548 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.658529 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 19:12:39.658591 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.658530 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 19:12:39.667964 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.667921 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1aa761a-48ed-4e86-a2a9-9b60abdac1c3-original-pull-secret\") pod \"global-pull-secret-syncer-f488f\" (UID: \"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3\") " pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:39.668322 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.668306 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 19:12:39.678084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.678057 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkm6j\" (UniqueName: \"kubernetes.io/projected/68aef275-a885-42e2-b4b9-8ff7f7b06a68-kube-api-access-hkm6j\") pod \"network-check-target-242v4\" (UID: \"68aef275-a885-42e2-b4b9-8ff7f7b06a68\") " pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:39.831833 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.831750 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trrmf\"" Jun 12 19:12:39.835070 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.835054 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f488f" Jun 12 19:12:39.839041 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.839028 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:39.967548 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.967514 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f488f"] Jun 12 19:12:39.970460 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:12:39.970403 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1aa761a_48ed_4e86_a2a9_9b60abdac1c3.slice/crio-4477065f4353b8e3bdbde513bf07a7b5fff0cfeb3cde7d16635f859ce7045cc5 WatchSource:0}: Error finding container 4477065f4353b8e3bdbde513bf07a7b5fff0cfeb3cde7d16635f859ce7045cc5: Status 404 returned error can't find the container with id 4477065f4353b8e3bdbde513bf07a7b5fff0cfeb3cde7d16635f859ce7045cc5 Jun 12 19:12:39.984033 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:39.983980 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-242v4"] Jun 12 19:12:39.987156 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:12:39.987130 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68aef275_a885_42e2_b4b9_8ff7f7b06a68.slice/crio-3bd2009724417437b4547a1de9dd9e461761e8b7bed54ea8d70191bc4b26e226 WatchSource:0}: Error finding container 3bd2009724417437b4547a1de9dd9e461761e8b7bed54ea8d70191bc4b26e226: Status 404 returned error can't find the container with id 3bd2009724417437b4547a1de9dd9e461761e8b7bed54ea8d70191bc4b26e226 Jun 12 19:12:40.065112 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:40.065072 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-242v4" event={"ID":"68aef275-a885-42e2-b4b9-8ff7f7b06a68","Type":"ContainerStarted","Data":"3bd2009724417437b4547a1de9dd9e461761e8b7bed54ea8d70191bc4b26e226"} Jun 12 19:12:40.066135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:40.066108 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f488f" event={"ID":"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3","Type":"ContainerStarted","Data":"4477065f4353b8e3bdbde513bf07a7b5fff0cfeb3cde7d16635f859ce7045cc5"} Jun 12 19:12:41.571731 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:41.571694 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:12:41.572281 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:41.571920 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:12:41.572281 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:12:41.571992 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:13:13.571972988 +0000 UTC m=+100.202039187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:12:45.083295 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:45.083252 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-242v4" event={"ID":"68aef275-a885-42e2-b4b9-8ff7f7b06a68","Type":"ContainerStarted","Data":"322554787feb90f0e045bf367a61f5d008ca0a45cd4db9b24d830d4c1fe97ec4"} Jun 12 19:12:45.083759 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:45.083331 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:12:45.084675 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:45.084649 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f488f" event={"ID":"d1aa761a-48ed-4e86-a2a9-9b60abdac1c3","Type":"ContainerStarted","Data":"7c63d7e033812782aef2bc92f7ada4cb4d8998fb87eed46db3a615bcddcd74e7"} Jun 12 19:12:45.101212 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:45.101159 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-242v4" podStartSLOduration=67.667519624 podStartE2EDuration="1m12.101145115s" totalImagesPullingTime="4.433625491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:45.099265924 +0000 UTC m=+71.729332140" watchObservedRunningTime="2026-06-12 19:12:45.101145115 +0000 UTC m=+71.731211313" Jun 12 19:12:45.114484 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:12:45.114415 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f488f" podStartSLOduration=66.659715859 podStartE2EDuration="1m11.114400669s" totalImagesPullingTime="4.45468481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:12:45.113966518 +0000 UTC m=+71.744032750" watchObservedRunningTime="2026-06-12 19:12:45.114400669 +0000 UTC m=+71.744466888" Jun 12 19:13:13.575605 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:13:13.575557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:13:13.576002 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:13:13.575723 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:13:13.576002 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:13:13.575808 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:14:17.57578958 +0000 UTC m=+164.205855779 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:13:16.091333 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:13:16.091300 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-242v4" Jun 12 19:13:43.666172 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:13:43.666134 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:13:43.666675 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:13:43.666249 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 19:13:43.666675 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:13:43.666301 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs podName:b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:45.666286627 +0000 UTC m=+252.296352825 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs") pod "network-metrics-daemon-qnq2v" (UID: "b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828") : secret "metrics-daemon-secret" not found Jun 12 19:14:12.698483 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:14:12.698418 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bzkjg" podUID="29b86679-82f5-4b22-b237-6baf60380db9" Jun 12 19:14:12.822058 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:14:12.822025 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qnq2v" podUID="b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828" Jun 12 19:14:13.334945 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:13.334921 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bzkjg" Jun 12 19:14:17.607054 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:17.607012 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:14:17.607545 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:14:17.607127 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 19:14:17.607545 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:14:17.607181 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls podName:29b86679-82f5-4b22-b237-6baf60380db9 nodeName:}" failed. No retries permitted until 2026-06-12 19:16:19.607168442 +0000 UTC m=+286.237234640 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls") pod "dns-default-bzkjg" (UID: "29b86679-82f5-4b22-b237-6baf60380db9") : secret "dns-default-metrics-tls" not found Jun 12 19:14:23.811417 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:23.811380 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:14:24.024130 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.024035 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" podUID="d57867d2-662b-420e-939f-c3693968487a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 12 19:14:24.365610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.365516 2554 generic.go:356] "Generic (PLEG): container finished" podID="46713dc6-001d-4e49-ac97-2992074420fd" containerID="2e9f9462c5f65b10abcb73495e60dc03547f3e768d80ac889ebc525f662842e9" exitCode=255 Jun 12 19:14:24.365610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.365589 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" event={"ID":"46713dc6-001d-4e49-ac97-2992074420fd","Type":"ContainerDied","Data":"2e9f9462c5f65b10abcb73495e60dc03547f3e768d80ac889ebc525f662842e9"} Jun 12 19:14:24.367047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.367026 2554 generic.go:356] "Generic (PLEG): container finished" podID="d57867d2-662b-420e-939f-c3693968487a" containerID="9fb68fb2d0277809419fe06e6a272cf00f2c543af4eda269f03b6b8ae564076e" exitCode=1 Jun 12 19:14:24.367147 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.367066 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" event={"ID":"d57867d2-662b-420e-939f-c3693968487a","Type":"ContainerDied","Data":"9fb68fb2d0277809419fe06e6a272cf00f2c543af4eda269f03b6b8ae564076e"} Jun 12 19:14:24.367334 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.367323 2554 scope.go:117] "RemoveContainer" containerID="9fb68fb2d0277809419fe06e6a272cf00f2c543af4eda269f03b6b8ae564076e" Jun 12 19:14:24.372485 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:24.372469 2554 scope.go:117] "RemoveContainer" containerID="2e9f9462c5f65b10abcb73495e60dc03547f3e768d80ac889ebc525f662842e9" Jun 12 19:14:25.371594 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:25.371555 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" event={"ID":"46713dc6-001d-4e49-ac97-2992074420fd","Type":"ContainerStarted","Data":"ce0ed013b08fab3a42ba09efc75000726d096084c2eab249fafc31a48dbebe16"} Jun 12 19:14:25.373195 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:25.373172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" event={"ID":"d57867d2-662b-420e-939f-c3693968487a","Type":"ContainerStarted","Data":"cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8"} Jun 12 19:14:25.373458 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:25.373442 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:14:25.374065 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:14:25.374035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:15:02.197607 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.197572 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68cc9d548-j5x88"] Jun 12 19:15:02.199469 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.199452 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.206906 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.206889 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vhjkg\"" Jun 12 19:15:02.207030 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.207011 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 19:15:02.207407 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.207393 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 19:15:02.208349 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.208334 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 19:15:02.232497 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.232473 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 19:15:02.269037 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.269011 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cc9d548-j5x88"] Jun 12 19:15:02.305367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305340 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-image-registry-private-configuration\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305470 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305378 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-installation-pull-secrets\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305470 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305398 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-bound-sa-token\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305470 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50947029-0ddc-4232-928a-e7b487fbe2bf-ca-trust-extracted\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305581 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5dz4\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-kube-api-access-v5dz4\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305581 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305651 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-certificates\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.305651 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.305600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-trusted-ca\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.390116 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.390084 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-rg4zt"] Jun 12 19:15:02.391917 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.391897 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:02.401072 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.401057 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 12 19:15:02.401279 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.401266 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 12 19:15:02.401360 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.401343 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l6z4z\"" Jun 12 19:15:02.405966 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.405948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-image-registry-private-configuration\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406057 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.405978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-installation-pull-secrets\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406057 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.405999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-bound-sa-token\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406057 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406029 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50947029-0ddc-4232-928a-e7b487fbe2bf-ca-trust-extracted\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406207 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5dz4\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-kube-api-access-v5dz4\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406207 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406193 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406309 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-certificates\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406309 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406283 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-trusted-ca\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406413 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.406346 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:15:02.406413 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.406366 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cc9d548-j5x88: secret "image-registry-tls" not found Jun 12 19:15:02.406535 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406448 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50947029-0ddc-4232-928a-e7b487fbe2bf-ca-trust-extracted\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.406535 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.406460 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls podName:50947029-0ddc-4232-928a-e7b487fbe2bf nodeName:}" failed. No retries permitted until 2026-06-12 19:15:02.906438218 +0000 UTC m=+209.536504444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls") pod "image-registry-68cc9d548-j5x88" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf") : secret "image-registry-tls" not found Jun 12 19:15:02.406844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.406824 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-certificates\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.407052 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.407033 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-trusted-ca\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.408405 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.408386 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-image-registry-private-configuration\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.408499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.408413 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-installation-pull-secrets\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.413688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.413635 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-rg4zt"] Jun 12 19:15:02.435089 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.435068 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5dz4\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-kube-api-access-v5dz4\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.436204 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.436187 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-bound-sa-token\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.507540 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.507485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-nginx-conf\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:02.507540 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.507533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:02.608051 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.608026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-nginx-conf\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:02.608150 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.608064 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:02.608150 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.608138 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 19:15:02.608258 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.608197 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert podName:a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:03.10818359 +0000 UTC m=+209.738249789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rg4zt" (UID: "a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a") : secret "networking-console-plugin-cert" not found Jun 12 19:15:02.608720 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.608698 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-nginx-conf\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:02.910293 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:02.910267 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:02.910455 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.910416 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:15:02.910511 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.910457 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cc9d548-j5x88: secret "image-registry-tls" not found Jun 12 19:15:02.910555 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:02.910521 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls podName:50947029-0ddc-4232-928a-e7b487fbe2bf nodeName:}" failed. No retries permitted until 2026-06-12 19:15:03.910504497 +0000 UTC m=+210.540570695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls") pod "image-registry-68cc9d548-j5x88" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf") : secret "image-registry-tls" not found Jun 12 19:15:03.111562 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:03.111523 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:03.111692 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:03.111671 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 19:15:03.111757 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:03.111746 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert podName:a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:04.111729683 +0000 UTC m=+210.741795887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rg4zt" (UID: "a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a") : secret "networking-console-plugin-cert" not found Jun 12 19:15:03.916918 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:03.916882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:03.917393 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:03.917367 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:15:03.917495 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:03.917397 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cc9d548-j5x88: secret "image-registry-tls" not found Jun 12 19:15:03.917495 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:03.917488 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls podName:50947029-0ddc-4232-928a-e7b487fbe2bf nodeName:}" failed. No retries permitted until 2026-06-12 19:15:05.917468336 +0000 UTC m=+212.547534550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls") pod "image-registry-68cc9d548-j5x88" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf") : secret "image-registry-tls" not found Jun 12 19:15:04.118298 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:04.118259 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:04.118475 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:04.118371 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 19:15:04.118475 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:04.118420 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert podName:a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:06.118406036 +0000 UTC m=+212.748472234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rg4zt" (UID: "a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a") : secret "networking-console-plugin-cert" not found Jun 12 19:15:05.929138 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:05.929099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:05.929577 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:05.929261 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:15:05.929577 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:05.929280 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cc9d548-j5x88: secret "image-registry-tls" not found Jun 12 19:15:05.929577 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:05.929344 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls podName:50947029-0ddc-4232-928a-e7b487fbe2bf nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.929325163 +0000 UTC m=+216.559391363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls") pod "image-registry-68cc9d548-j5x88" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf") : secret "image-registry-tls" not found Jun 12 19:15:06.131211 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:06.131178 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:06.131358 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:06.131317 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 19:15:06.131401 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:06.131388 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert podName:a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:10.131370531 +0000 UTC m=+216.761436741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rg4zt" (UID: "a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a") : secret "networking-console-plugin-cert" not found Jun 12 19:15:07.427939 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.427899 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m756s"] Jun 12 19:15:07.430687 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.430667 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.433752 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.433728 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 19:15:07.433865 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.433735 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 19:15:07.433865 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.433782 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 19:15:07.435223 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.435205 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfqjf\"" Jun 12 19:15:07.435223 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.435214 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 19:15:07.445557 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.445533 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m756s"] Jun 12 19:15:07.540615 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.540595 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.540706 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.540631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-data-volume\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.540706 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.540672 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.540706 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.540701 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwkk9\" (UniqueName: \"kubernetes.io/projected/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-api-access-lwkk9\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.540827 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.540762 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-crio-socket\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641252 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641229 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641256 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwkk9\" (UniqueName: \"kubernetes.io/projected/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-api-access-lwkk9\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641379 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:07.641363 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:07.641449 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-crio-socket\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641505 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:07.641438 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:08.141409075 +0000 UTC m=+214.771475273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:07.641505 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641586 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641527 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-crio-socket\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641586 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641537 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-data-volume\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.641645 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:07.641594 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:07.641676 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:07.641648 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:08.141634541 +0000 UTC m=+214.771700778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : configmap "kube-rbac-proxy" not found Jun 12 19:15:07.641788 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.641773 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-data-volume\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:07.652908 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:07.652877 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwkk9\" (UniqueName: \"kubernetes.io/projected/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-api-access-lwkk9\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:08.077319 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.077291 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb"] Jun 12 19:15:08.079210 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.079195 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" Jun 12 19:15:08.083734 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.083709 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 12 19:15:08.083847 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.083709 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 12 19:15:08.083847 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.083780 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dl8q2\"" Jun 12 19:15:08.105535 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.105508 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb"] Jun 12 19:15:08.144639 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.144604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:08.144730 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.144667 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:08.144730 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.144686 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzth\" (UniqueName: \"kubernetes.io/projected/fa391f77-363f-4b0a-ad54-b39e2532b005-kube-api-access-qzzth\") pod \"migrator-d4bcd4867-p48kb\" (UID: \"fa391f77-363f-4b0a-ad54-b39e2532b005\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" Jun 12 19:15:08.144813 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:08.144729 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:08.144813 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:08.144772 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:08.144813 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:08.144781 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.144768075 +0000 UTC m=+215.774834299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:08.144918 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:08.144819 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:09.144808875 +0000 UTC m=+215.774875073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : configmap "kube-rbac-proxy" not found Jun 12 19:15:08.245835 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.245811 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzth\" (UniqueName: \"kubernetes.io/projected/fa391f77-363f-4b0a-ad54-b39e2532b005-kube-api-access-qzzth\") pod \"migrator-d4bcd4867-p48kb\" (UID: \"fa391f77-363f-4b0a-ad54-b39e2532b005\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" Jun 12 19:15:08.261371 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.261348 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzth\" (UniqueName: \"kubernetes.io/projected/fa391f77-363f-4b0a-ad54-b39e2532b005-kube-api-access-qzzth\") pod \"migrator-d4bcd4867-p48kb\" (UID: \"fa391f77-363f-4b0a-ad54-b39e2532b005\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" Jun 12 19:15:08.387538 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.387465 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" Jun 12 19:15:08.503352 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:08.503326 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb"] Jun 12 19:15:08.507205 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:08.507179 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa391f77_363f_4b0a_ad54_b39e2532b005.slice/crio-5d698207202637197f0e21be5e4a0479651bb89e6523e021c5c056b83dbcf81a WatchSource:0}: Error finding container 5d698207202637197f0e21be5e4a0479651bb89e6523e021c5c056b83dbcf81a: Status 404 returned error can't find the container with id 5d698207202637197f0e21be5e4a0479651bb89e6523e021c5c056b83dbcf81a Jun 12 19:15:09.152474 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:09.152439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:09.152654 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:09.152510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:09.152654 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.152606 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:09.152654 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.152627 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:09.152785 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.152677 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:11.152654443 +0000 UTC m=+217.782720642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : configmap "kube-rbac-proxy" not found Jun 12 19:15:09.152785 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.152692 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:11.15268477 +0000 UTC m=+217.782750971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:09.495588 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:09.495554 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" event={"ID":"fa391f77-363f-4b0a-ad54-b39e2532b005","Type":"ContainerStarted","Data":"5d698207202637197f0e21be5e4a0479651bb89e6523e021c5c056b83dbcf81a"} Jun 12 19:15:09.610468 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:09.610419 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zz8tb_5174921b-e915-4fa0-9a87-4a64bb1515c0/dns-node-resolver/0.log" Jun 12 19:15:09.958502 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:09.958473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:09.959316 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.959031 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 19:15:09.959316 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.959069 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cc9d548-j5x88: secret "image-registry-tls" not found Jun 12 19:15:09.959316 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:09.959139 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls podName:50947029-0ddc-4232-928a-e7b487fbe2bf nodeName:}" failed. No retries permitted until 2026-06-12 19:15:17.959111246 +0000 UTC m=+224.589177447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls") pod "image-registry-68cc9d548-j5x88" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf") : secret "image-registry-tls" not found Jun 12 19:15:10.160614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:10.160563 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:10.160773 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:10.160741 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 19:15:10.160832 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:10.160808 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert podName:a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:18.160792893 +0000 UTC m=+224.790859092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rg4zt" (UID: "a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a") : secret "networking-console-plugin-cert" not found Jun 12 19:15:10.211939 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:10.211860 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7qhc_6661ec26-5225-42d0-8e1f-60a5c03e3d86/node-ca/0.log" Jun 12 19:15:10.500152 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:10.500061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" event={"ID":"fa391f77-363f-4b0a-ad54-b39e2532b005","Type":"ContainerStarted","Data":"21af830aa97265320f136190e8027726716d926de724567fc248a4606cd8398c"} Jun 12 19:15:10.500299 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:10.500161 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" event={"ID":"fa391f77-363f-4b0a-ad54-b39e2532b005","Type":"ContainerStarted","Data":"936dd39d19c3c45ddd50f6f1ae2839edf23f30742b8971175ce4fccc0d8c07ce"} Jun 12 19:15:10.523032 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:10.522977 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-p48kb" podStartSLOduration=1.443895327 podStartE2EDuration="2.522962792s" totalImagesPullingTime="1.079067465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:10.522642426 +0000 UTC m=+217.152708646" watchObservedRunningTime="2026-06-12 19:15:10.522962792 +0000 UTC m=+217.153029077" Jun 12 19:15:11.169441 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:11.169394 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:11.169815 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:11.169556 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:11.169815 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:11.169568 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:11.169815 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:11.169616 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:15.16960242 +0000 UTC m=+221.799668621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:11.169815 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:11.169654 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:11.169815 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:11.169699 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:15.169688399 +0000 UTC m=+221.799754597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : configmap "kube-rbac-proxy" not found Jun 12 19:15:11.211974 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:11.211948 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pnmjv_2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9/serve-healthcheck-canary/0.log" Jun 12 19:15:15.199946 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:15.199908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:15.200375 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:15.199987 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:15.200375 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:15.200046 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 19:15:15.200375 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:15.200083 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 19:15:15.200375 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:15.200115 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:23.200099622 +0000 UTC m=+229.830165819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : configmap "kube-rbac-proxy" not found Jun 12 19:15:15.200375 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:15.200131 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls podName:b7fb28b7-e3f7-4e56-8c52-a839a6a51a28 nodeName:}" failed. No retries permitted until 2026-06-12 19:15:23.20012546 +0000 UTC m=+229.830191661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m756s" (UID: "b7fb28b7-e3f7-4e56-8c52-a839a6a51a28") : secret "insights-runtime-extractor-tls" not found Jun 12 19:15:18.018927 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.018878 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:18.021355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.021328 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"image-registry-68cc9d548-j5x88\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:18.108495 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.108443 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:18.220771 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.220735 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:18.220933 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:18.220913 2554 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 19:15:18.221007 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:18.220987 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert podName:a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:34.220968828 +0000 UTC m=+240.851035025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-rg4zt" (UID: "a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a") : secret "networking-console-plugin-cert" not found Jun 12 19:15:18.245682 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.245651 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cc9d548-j5x88"] Jun 12 19:15:18.249055 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:18.249031 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50947029_0ddc_4232_928a_e7b487fbe2bf.slice/crio-f81d55f0c94367c7ae15a0f5d5c3e16ec56fcbc9aaeaad1d63723fa653c6e677 WatchSource:0}: Error finding container f81d55f0c94367c7ae15a0f5d5c3e16ec56fcbc9aaeaad1d63723fa653c6e677: Status 404 returned error can't find the container with id f81d55f0c94367c7ae15a0f5d5c3e16ec56fcbc9aaeaad1d63723fa653c6e677 Jun 12 19:15:18.523650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.523611 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" event={"ID":"50947029-0ddc-4232-928a-e7b487fbe2bf","Type":"ContainerStarted","Data":"b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb"} Jun 12 19:15:18.523821 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.523672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" event={"ID":"50947029-0ddc-4232-928a-e7b487fbe2bf","Type":"ContainerStarted","Data":"f81d55f0c94367c7ae15a0f5d5c3e16ec56fcbc9aaeaad1d63723fa653c6e677"} Jun 12 19:15:18.523821 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.523717 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:18.557144 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:18.557035 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" podStartSLOduration=16.557017368 podStartE2EDuration="16.557017368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:18.556325735 +0000 UTC m=+225.186391978" watchObservedRunningTime="2026-06-12 19:15:18.557017368 +0000 UTC m=+225.187083587" Jun 12 19:15:23.260598 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.260544 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:23.261010 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.260636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:23.261251 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.261228 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:23.262877 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.262860 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7fb28b7-e3f7-4e56-8c52-a839a6a51a28-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m756s\" (UID: \"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28\") " pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:23.341163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.341120 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m756s" Jun 12 19:15:23.471315 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.471288 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m756s"] Jun 12 19:15:23.473762 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:23.473728 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fb28b7_e3f7_4e56_8c52_a839a6a51a28.slice/crio-adb86a370989ac54c0b974ba3099bf8f50ff3f291e9321bf88ec70264f516434 WatchSource:0}: Error finding container adb86a370989ac54c0b974ba3099bf8f50ff3f291e9321bf88ec70264f516434: Status 404 returned error can't find the container with id adb86a370989ac54c0b974ba3099bf8f50ff3f291e9321bf88ec70264f516434 Jun 12 19:15:23.541497 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:23.541395 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m756s" event={"ID":"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28","Type":"ContainerStarted","Data":"adb86a370989ac54c0b974ba3099bf8f50ff3f291e9321bf88ec70264f516434"} Jun 12 19:15:27.558050 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:27.558014 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m756s" event={"ID":"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28","Type":"ContainerStarted","Data":"8fa0bb59f841fed7a24297bc91bb8245ab602b631146e20a85ec692db92ae7ca"} Jun 12 19:15:27.558418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:27.558076 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m756s" event={"ID":"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28","Type":"ContainerStarted","Data":"129030d8fec6f3a43bdf573fa170096eb5f2ca42d6504ddaaacb33e04715cede"} Jun 12 19:15:29.566792 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:29.566755 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m756s" event={"ID":"b7fb28b7-e3f7-4e56-8c52-a839a6a51a28","Type":"ContainerStarted","Data":"a0f9a95f2f82210ba0eef0480181203e59c44b06847e25e73bb5e8b0b6ee09a0"} Jun 12 19:15:29.589506 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:29.589453 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m756s" podStartSLOduration=17.348784325 podStartE2EDuration="22.589438282s" totalImagesPullingTime="5.240653957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:29.587281725 +0000 UTC m=+236.217347983" watchObservedRunningTime="2026-06-12 19:15:29.589438282 +0000 UTC m=+236.219504492" Jun 12 19:15:33.131622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:33.131586 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68cc9d548-j5x88"] Jun 12 19:15:33.135837 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:33.135808 2554 patch_prober.go:28] interesting pod/image-registry-68cc9d548-j5x88 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 19:15:33.135969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:33.135855 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:15:34.257814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:34.257768 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:34.260112 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:34.260091 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-rg4zt\" (UID: \"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:34.502652 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:34.502622 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l6z4z\"" Jun 12 19:15:34.510564 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:34.510475 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" Jun 12 19:15:34.643859 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:34.643828 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-rg4zt"] Jun 12 19:15:34.647465 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:34.647419 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45f4e07_d7bb_4658_b88c_7d7dbd88bb7a.slice/crio-3ffcf99205f3131080f8eb086d1841ffe5d914489c4ad707f264b1daabd4234c WatchSource:0}: Error finding container 3ffcf99205f3131080f8eb086d1841ffe5d914489c4ad707f264b1daabd4234c: Status 404 returned error can't find the container with id 3ffcf99205f3131080f8eb086d1841ffe5d914489c4ad707f264b1daabd4234c Jun 12 19:15:35.586749 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:35.586710 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" event={"ID":"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a","Type":"ContainerStarted","Data":"3ffcf99205f3131080f8eb086d1841ffe5d914489c4ad707f264b1daabd4234c"} Jun 12 19:15:36.590849 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:36.590805 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" event={"ID":"a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a","Type":"ContainerStarted","Data":"8f9a44ddd4ecabd5f60b39fba3c6aca040079257565fa3624da5b2d56fcb4bec"} Jun 12 19:15:37.090355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.090302 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-rg4zt" podStartSLOduration=33.732235548 podStartE2EDuration="35.09028462s" totalImagesPullingTime="1.358049072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:36.610057817 +0000 UTC m=+243.240124038" watchObservedRunningTime="2026-06-12 19:15:37.09028462 +0000 UTC m=+243.720350841" Jun 12 19:15:37.091008 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.090990 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv"] Jun 12 19:15:37.096064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.096033 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:37.098728 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.098707 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sn8lv\"" Jun 12 19:15:37.098858 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.098751 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 19:15:37.113572 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.113546 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv"] Jun 12 19:15:37.278978 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.278936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/214b534e-0a92-45ea-8946-0267ad1ba440-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-ff2bv\" (UID: \"214b534e-0a92-45ea-8946-0267ad1ba440\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:37.379403 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.379317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/214b534e-0a92-45ea-8946-0267ad1ba440-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-ff2bv\" (UID: \"214b534e-0a92-45ea-8946-0267ad1ba440\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:37.381793 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.381760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/214b534e-0a92-45ea-8946-0267ad1ba440-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-ff2bv\" (UID: \"214b534e-0a92-45ea-8946-0267ad1ba440\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:37.404200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.404161 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:37.535448 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.535400 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv"] Jun 12 19:15:37.539010 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:37.538982 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod214b534e_0a92_45ea_8946_0267ad1ba440.slice/crio-8cf79db957711be7ebe35b3cdbf0744b785c6817bc1306e738e76f2842aaaf4a WatchSource:0}: Error finding container 8cf79db957711be7ebe35b3cdbf0744b785c6817bc1306e738e76f2842aaaf4a: Status 404 returned error can't find the container with id 8cf79db957711be7ebe35b3cdbf0744b785c6817bc1306e738e76f2842aaaf4a Jun 12 19:15:37.595602 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:37.595568 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" event={"ID":"214b534e-0a92-45ea-8946-0267ad1ba440","Type":"ContainerStarted","Data":"8cf79db957711be7ebe35b3cdbf0744b785c6817bc1306e738e76f2842aaaf4a"} Jun 12 19:15:39.602932 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:39.602896 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" event={"ID":"214b534e-0a92-45ea-8946-0267ad1ba440","Type":"ContainerStarted","Data":"d014272ceb10b93c3148e087676e2e702fe9cc7363c921e2841743a3e753ed7d"} Jun 12 19:15:39.603330 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:39.603112 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:39.607794 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:39.607772 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" Jun 12 19:15:39.620525 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:39.620478 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-ff2bv" podStartSLOduration=1.589615596 podStartE2EDuration="2.620463643s" totalImagesPullingTime="1.030848047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:39.619764891 +0000 UTC m=+246.249831113" watchObservedRunningTime="2026-06-12 19:15:39.620463643 +0000 UTC m=+246.250529895" Jun 12 19:15:40.158352 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.158320 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw"] Jun 12 19:15:40.162156 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.162138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.164930 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.164911 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qhfl2\"" Jun 12 19:15:40.165069 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.164932 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 19:15:40.165304 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.165286 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 19:15:40.165304 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.165295 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 19:15:40.165408 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.165343 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 19:15:40.165618 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.165598 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 19:15:40.174842 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.174817 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw"] Jun 12 19:15:40.201865 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.201825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.201865 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.201866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxvqh\" (UniqueName: \"kubernetes.io/projected/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-kube-api-access-wxvqh\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.202084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.201942 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.202084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.201977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.303043 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.303013 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.303148 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.303056 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.303148 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.303117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.303148 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.303142 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxvqh\" (UniqueName: \"kubernetes.io/projected/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-kube-api-access-wxvqh\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.303258 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:40.303188 2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 12 19:15:40.303258 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:40.303253 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-tls podName:19fdeafb-a4d2-4be3-b65b-b77f30b6796a nodeName:}" failed. No retries permitted until 2026-06-12 19:15:40.803238299 +0000 UTC m=+247.433304496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-lsqnw" (UID: "19fdeafb-a4d2-4be3-b65b-b77f30b6796a") : secret "prometheus-operator-tls" not found Jun 12 19:15:40.303886 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.303865 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.305534 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.305512 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.320021 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.319990 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxvqh\" (UniqueName: \"kubernetes.io/projected/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-kube-api-access-wxvqh\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.806119 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.806079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:40.808372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:40.808353 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19fdeafb-a4d2-4be3-b65b-b77f30b6796a-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-lsqnw\" (UID: \"19fdeafb-a4d2-4be3-b65b-b77f30b6796a\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:41.070999 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:41.070894 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" Jun 12 19:15:41.194935 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:41.194899 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw"] Jun 12 19:15:41.197747 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:41.197716 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fdeafb_a4d2_4be3_b65b_b77f30b6796a.slice/crio-7397740350d5c1aa81908b69ae51ed52afc00b66920a96594c034f3f3a5b1581 WatchSource:0}: Error finding container 7397740350d5c1aa81908b69ae51ed52afc00b66920a96594c034f3f3a5b1581: Status 404 returned error can't find the container with id 7397740350d5c1aa81908b69ae51ed52afc00b66920a96594c034f3f3a5b1581 Jun 12 19:15:41.610298 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:41.610265 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" event={"ID":"19fdeafb-a4d2-4be3-b65b-b77f30b6796a","Type":"ContainerStarted","Data":"7397740350d5c1aa81908b69ae51ed52afc00b66920a96594c034f3f3a5b1581"} Jun 12 19:15:42.615461 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.615408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" event={"ID":"19fdeafb-a4d2-4be3-b65b-b77f30b6796a","Type":"ContainerStarted","Data":"44bdd2948a1b1b6021a5ee8a010e832857aafa45380c14763042ca776b716884"} Jun 12 19:15:42.615832 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.615520 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" event={"ID":"19fdeafb-a4d2-4be3-b65b-b77f30b6796a","Type":"ContainerStarted","Data":"14390055c2c101badb14a853174dfad7234177cbb36af9f6cd3df400231f6268"} Jun 12 19:15:42.635118 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.635066 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-lsqnw" podStartSLOduration=1.442652394 podStartE2EDuration="2.635053069s" totalImagesPullingTime="1.192400675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:42.634287353 +0000 UTC m=+249.264353574" watchObservedRunningTime="2026-06-12 19:15:42.635053069 +0000 UTC m=+249.265119288" Jun 12 19:15:42.796571 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.796540 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7f568f68-wjm54"] Jun 12 19:15:42.799641 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.799624 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.804286 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.804261 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 19:15:42.804441 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.804355 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 19:15:42.804520 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.804502 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 19:15:42.804565 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.804547 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 19:15:42.804614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.804509 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 19:15:42.809757 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.809737 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 19:15:42.809857 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.809776 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 19:15:42.809857 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.809737 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hjc2q\"" Jun 12 19:15:42.825057 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.825029 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-oauth-config\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.825163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.825069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-console-config\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.825163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.825090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-serving-cert\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.825163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.825119 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phxwj\" (UniqueName: \"kubernetes.io/projected/561891a0-74e9-475c-a6d9-5fc81a3af231-kube-api-access-phxwj\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.825309 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.825166 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-service-ca\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.825309 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.825245 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-oauth-serving-cert\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.834219 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.834194 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7f568f68-wjm54"] Jun 12 19:15:42.925969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.925932 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-oauth-config\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.925969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.925976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-console-config\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926003 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-serving-cert\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926026 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phxwj\" (UniqueName: \"kubernetes.io/projected/561891a0-74e9-475c-a6d9-5fc81a3af231-kube-api-access-phxwj\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-service-ca\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926338 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926251 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-oauth-serving-cert\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926813 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-service-ca\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926971 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926849 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-console-config\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.926971 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.926873 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-oauth-serving-cert\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.928374 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.928354 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-oauth-config\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.928475 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.928417 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-serving-cert\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:42.935876 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:42.935851 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phxwj\" (UniqueName: \"kubernetes.io/projected/561891a0-74e9-475c-a6d9-5fc81a3af231-kube-api-access-phxwj\") pod \"console-5c7f568f68-wjm54\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:43.108476 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:43.108357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:43.136977 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:43.136942 2554 patch_prober.go:28] interesting pod/image-registry-68cc9d548-j5x88 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 19:15:43.137147 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:43.136995 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:15:43.235007 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:43.234974 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7f568f68-wjm54"] Jun 12 19:15:43.238419 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:43.238397 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561891a0_74e9_475c_a6d9_5fc81a3af231.slice/crio-fc469a787259d17885c995ec079674e333361adbc07c82a60454ec8e80047ac6 WatchSource:0}: Error finding container fc469a787259d17885c995ec079674e333361adbc07c82a60454ec8e80047ac6: Status 404 returned error can't find the container with id fc469a787259d17885c995ec079674e333361adbc07c82a60454ec8e80047ac6 Jun 12 19:15:43.619625 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:43.619591 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f568f68-wjm54" event={"ID":"561891a0-74e9-475c-a6d9-5fc81a3af231","Type":"ContainerStarted","Data":"fc469a787259d17885c995ec079674e333361adbc07c82a60454ec8e80047ac6"} Jun 12 19:15:44.496292 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.496259 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98"] Jun 12 19:15:44.499876 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.499851 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.502648 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.502624 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rxx4h\"" Jun 12 19:15:44.502777 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.502734 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 19:15:44.505081 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.505053 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 19:15:44.512844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.512820 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98"] Jun 12 19:15:44.539368 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.539336 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0ce90-aad5-4183-af7a-eab66ba42849-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.539539 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.539448 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7dx\" (UniqueName: \"kubernetes.io/projected/d2f0ce90-aad5-4183-af7a-eab66ba42849-kube-api-access-6h7dx\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.539539 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.539499 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2f0ce90-aad5-4183-af7a-eab66ba42849-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.539630 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.539539 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2f0ce90-aad5-4183-af7a-eab66ba42849-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.557335 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.557302 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f6sxw"] Jun 12 19:15:44.560364 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.560350 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.563780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.563763 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9lrff\"" Jun 12 19:15:44.564248 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.564225 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 19:15:44.564349 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.564279 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 19:15:44.564349 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.564300 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 19:15:44.640177 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0ce90-aad5-4183-af7a-eab66ba42849-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7dx\" (UniqueName: \"kubernetes.io/projected/d2f0ce90-aad5-4183-af7a-eab66ba42849-kube-api-access-6h7dx\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640227 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf393f55-dc15-493e-a254-62b71f58a42b-metrics-client-ca\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640253 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-textfile\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640315 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-wtmp\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640342 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640367 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2f0ce90-aad5-4183-af7a-eab66ba42849-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-tls\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640464 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwl9\" (UniqueName: \"kubernetes.io/projected/cf393f55-dc15-493e-a254-62b71f58a42b-kube-api-access-rqwl9\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640503 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2f0ce90-aad5-4183-af7a-eab66ba42849-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640553 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-sys\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.640650 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640576 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-root\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.641095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.640855 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2f0ce90-aad5-4183-af7a-eab66ba42849-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.642999 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.642977 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2f0ce90-aad5-4183-af7a-eab66ba42849-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.643186 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.643163 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2f0ce90-aad5-4183-af7a-eab66ba42849-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.648700 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.648676 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7dx\" (UniqueName: \"kubernetes.io/projected/d2f0ce90-aad5-4183-af7a-eab66ba42849-kube-api-access-6h7dx\") pod \"openshift-state-metrics-6b8d965dd5-fvm98\" (UID: \"d2f0ce90-aad5-4183-af7a-eab66ba42849\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.741976 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.741941 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-sys\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742150 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.741988 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-root\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742150 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742045 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-sys\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742150 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf393f55-dc15-493e-a254-62b71f58a42b-metrics-client-ca\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742150 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742094 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-textfile\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742150 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742124 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-wtmp\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742145 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-root\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-tls\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742249 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742274 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwl9\" (UniqueName: \"kubernetes.io/projected/cf393f55-dc15-493e-a254-62b71f58a42b-kube-api-access-rqwl9\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742750 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742788 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-wtmp\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742795 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf393f55-dc15-493e-a254-62b71f58a42b-metrics-client-ca\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.742961 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.742865 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-textfile\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.745050 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.745025 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-tls\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.745169 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.745050 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf393f55-dc15-493e-a254-62b71f58a42b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.750177 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.750127 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwl9\" (UniqueName: \"kubernetes.io/projected/cf393f55-dc15-493e-a254-62b71f58a42b-kube-api-access-rqwl9\") pod \"node-exporter-f6sxw\" (UID: \"cf393f55-dc15-493e-a254-62b71f58a42b\") " pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.810177 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.810138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" Jun 12 19:15:44.868932 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.868910 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6sxw" Jun 12 19:15:44.880729 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:44.880697 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf393f55_dc15_493e_a254_62b71f58a42b.slice/crio-53463c23de0540f7a2eee52ba81a45e71d23adef5dd3f324efe46a8a78e9e1ec WatchSource:0}: Error finding container 53463c23de0540f7a2eee52ba81a45e71d23adef5dd3f324efe46a8a78e9e1ec: Status 404 returned error can't find the container with id 53463c23de0540f7a2eee52ba81a45e71d23adef5dd3f324efe46a8a78e9e1ec Jun 12 19:15:44.944578 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:44.944375 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98"] Jun 12 19:15:44.947232 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:44.947207 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f0ce90_aad5_4183_af7a_eab66ba42849.slice/crio-1414b9d0c38fa06b3c1b27fbb562409cb734bbbab8416bd84e9177f07ff45f0c WatchSource:0}: Error finding container 1414b9d0c38fa06b3c1b27fbb562409cb734bbbab8416bd84e9177f07ff45f0c: Status 404 returned error can't find the container with id 1414b9d0c38fa06b3c1b27fbb562409cb734bbbab8416bd84e9177f07ff45f0c Jun 12 19:15:45.632987 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:45.632919 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6sxw" event={"ID":"cf393f55-dc15-493e-a254-62b71f58a42b","Type":"ContainerStarted","Data":"53463c23de0540f7a2eee52ba81a45e71d23adef5dd3f324efe46a8a78e9e1ec"} Jun 12 19:15:45.635637 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:45.635610 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" event={"ID":"d2f0ce90-aad5-4183-af7a-eab66ba42849","Type":"ContainerStarted","Data":"3555b7c4c618bdfa798ccc481cbc502310a6cb734cd03ed3f4769abf96374a84"} Jun 12 19:15:45.635784 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:45.635661 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" event={"ID":"d2f0ce90-aad5-4183-af7a-eab66ba42849","Type":"ContainerStarted","Data":"67dc07e4e3709a929c83566cff5ca9e80468ee2ad9be400a64cbd9ac582fa1cf"} Jun 12 19:15:45.635784 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:45.635679 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" event={"ID":"d2f0ce90-aad5-4183-af7a-eab66ba42849","Type":"ContainerStarted","Data":"1414b9d0c38fa06b3c1b27fbb562409cb734bbbab8416bd84e9177f07ff45f0c"} Jun 12 19:15:45.749533 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:45.749390 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:15:45.752247 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:45.752218 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828-metrics-certs\") pod \"network-metrics-daemon-qnq2v\" (UID: \"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828\") " pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:15:46.015363 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:46.015334 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6rt4s\"" Jun 12 19:15:46.023041 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:46.023019 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qnq2v" Jun 12 19:15:47.321140 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.321072 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qnq2v"] Jun 12 19:15:47.324655 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:47.324607 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b0c0c6_ec40_4b20_aceb_e9f9bcd94828.slice/crio-d387f295ccf9119bc296021d3b05765fdd425828d7e99186535bd203e1d9787b WatchSource:0}: Error finding container d387f295ccf9119bc296021d3b05765fdd425828d7e99186535bd203e1d9787b: Status 404 returned error can't find the container with id d387f295ccf9119bc296021d3b05765fdd425828d7e99186535bd203e1d9787b Jun 12 19:15:47.644130 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.644095 2554 generic.go:356] "Generic (PLEG): container finished" podID="cf393f55-dc15-493e-a254-62b71f58a42b" containerID="9c4aa07e95a0bd250ee02c3daa788998b7d71d9cdb0094cc034ec53ecd8b77e8" exitCode=0 Jun 12 19:15:47.644316 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.644169 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6sxw" event={"ID":"cf393f55-dc15-493e-a254-62b71f58a42b","Type":"ContainerDied","Data":"9c4aa07e95a0bd250ee02c3daa788998b7d71d9cdb0094cc034ec53ecd8b77e8"} Jun 12 19:15:47.646341 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.646313 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" event={"ID":"d2f0ce90-aad5-4183-af7a-eab66ba42849","Type":"ContainerStarted","Data":"e7b57ee80b7f119b8cc56288265a873bd281eecc2bca5a1c216e6d18841e02c1"} Jun 12 19:15:47.647405 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.647381 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnq2v" event={"ID":"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828","Type":"ContainerStarted","Data":"d387f295ccf9119bc296021d3b05765fdd425828d7e99186535bd203e1d9787b"} Jun 12 19:15:47.648762 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.648744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f568f68-wjm54" event={"ID":"561891a0-74e9-475c-a6d9-5fc81a3af231","Type":"ContainerStarted","Data":"c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713"} Jun 12 19:15:47.681662 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.681600 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7f568f68-wjm54" podStartSLOduration=1.736644315 podStartE2EDuration="5.681579741s" totalImagesPullingTime="3.944935426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:47.680994748 +0000 UTC m=+254.311060977" watchObservedRunningTime="2026-06-12 19:15:47.681579741 +0000 UTC m=+254.311645959" Jun 12 19:15:47.705681 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:47.705633 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-fvm98" podStartSLOduration=1.631007171 podStartE2EDuration="3.705615435s" totalImagesPullingTime="2.074608264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:47.704871427 +0000 UTC m=+254.334937647" watchObservedRunningTime="2026-06-12 19:15:47.705615435 +0000 UTC m=+254.335681655" Jun 12 19:15:48.654170 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:48.654136 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnq2v" event={"ID":"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828","Type":"ContainerStarted","Data":"6026c7be2b5020da46ccbfc05b51f526b5fe377967bccd47745c417f14244177"} Jun 12 19:15:48.654652 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:48.654232 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qnq2v" event={"ID":"b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828","Type":"ContainerStarted","Data":"208aa64f6afda5794a15eda2b3e683f9bdda79f838277b231c44bebbd082bba3"} Jun 12 19:15:48.656311 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:48.656281 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6sxw" event={"ID":"cf393f55-dc15-493e-a254-62b71f58a42b","Type":"ContainerStarted","Data":"0512da695baf0795c0b043717083531d2a77e2295d2e6ce84faf3e233ee834fe"} Jun 12 19:15:48.656459 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:48.656341 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6sxw" event={"ID":"cf393f55-dc15-493e-a254-62b71f58a42b","Type":"ContainerStarted","Data":"4eb569d2b82547ffd44c1af27dfc9e6cccde3c5a39fcfc1d2f5966db441eece2"} Jun 12 19:15:48.672985 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:48.672931 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qnq2v" podStartSLOduration=254.661036502 podStartE2EDuration="4m15.672915864s" totalImagesPullingTime="1.011879362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:48.67083019 +0000 UTC m=+255.300896409" watchObservedRunningTime="2026-06-12 19:15:48.672915864 +0000 UTC m=+255.302982080" Jun 12 19:15:48.692332 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:48.692228 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f6sxw" podStartSLOduration=2.320339682 podStartE2EDuration="4.692212447s" totalImagesPullingTime="2.2956468s" totalInitContainerRuntime="76.225965ms" isStatefulPod=true podCreationTimestamp="2026-06-12 19:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:48.69186017 +0000 UTC m=+255.321926392" watchObservedRunningTime="2026-06-12 19:15:48.692212447 +0000 UTC m=+255.322278666" Jun 12 19:15:50.413620 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.413581 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7f568f68-wjm54"] Jun 12 19:15:50.748806 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.748704 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:15:50.753507 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.753478 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.756465 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.756437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 19:15:50.756608 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.756437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 19:15:50.757815 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.757791 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 19:15:50.758011 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.757996 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 19:15:50.758218 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758197 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3pjmlunieg1op\"" Jun 12 19:15:50.758300 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758282 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wwdd9\"" Jun 12 19:15:50.758353 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758311 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 19:15:50.758402 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758311 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 19:15:50.758488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758416 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 19:15:50.758537 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758517 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 19:15:50.758537 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758525 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 19:15:50.758657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.758643 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 19:15:50.760904 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.760883 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 19:15:50.761019 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.760916 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 19:15:50.761337 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.761128 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 19:15:50.765097 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.765074 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 19:15:50.768601 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.768580 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 19:15:50.783329 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.783281 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:15:50.796414 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796381 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-config\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796419 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796470 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796488 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796533 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-web-config\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796570 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-config-out\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dwg\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-kube-api-access-45dwg\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796841 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796866 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.796919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.797188 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.797188 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.796985 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.797188 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.797004 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898524 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898469 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898593 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45dwg\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-kube-api-access-45dwg\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.898950 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.898876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.899635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.899141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.899635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.899159 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.899635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.899209 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.899635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.899243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.899635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.899592 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.899987 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900042 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900123 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-config\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900207 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900207 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-web-config\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900360 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-config-out\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900389 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.900774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.901894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.901572 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.902686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.902001 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.902686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.902159 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.902686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.902254 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.903409 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.903384 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.904110 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.904059 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.904656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.904630 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.904925 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.904897 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.905153 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.905124 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-web-config\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.905266 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.905177 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-config\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.905328 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.905302 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.905544 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.905512 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.907900 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.906000 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.907900 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.907400 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-config-out\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:50.914009 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:50.913981 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dwg\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-kube-api-access-45dwg\") pod \"prometheus-k8s-0\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:51.064990 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:51.064863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:15:51.236337 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:51.236307 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:15:51.236905 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:15:51.236883 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566d0443_3970_45aa_82b0_a0d9baa9ee11.slice/crio-be95523e725708ef63fc23245a0abc557279a557806aebd5a55741e344fd41f6 WatchSource:0}: Error finding container be95523e725708ef63fc23245a0abc557279a557806aebd5a55741e344fd41f6: Status 404 returned error can't find the container with id be95523e725708ef63fc23245a0abc557279a557806aebd5a55741e344fd41f6 Jun 12 19:15:51.673721 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:51.673668 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"be95523e725708ef63fc23245a0abc557279a557806aebd5a55741e344fd41f6"} Jun 12 19:15:52.678509 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:52.678478 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" exitCode=0 Jun 12 19:15:52.678877 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:52.678569 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} Jun 12 19:15:53.109512 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:53.109410 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:15:53.137093 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:53.137054 2554 patch_prober.go:28] interesting pod/image-registry-68cc9d548-j5x88 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 19:15:53.137279 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:53.137113 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 19:15:56.699056 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:56.699016 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} Jun 12 19:15:56.699469 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:56.699101 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} Jun 12 19:15:57.707007 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:57.706971 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} Jun 12 19:15:57.707333 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:57.707053 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} Jun 12 19:15:57.707333 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:57.707099 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} Jun 12 19:15:58.151029 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.150936 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" containerID="cri-o://b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb" gracePeriod=30 Jun 12 19:15:58.385869 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.385844 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:58.463558 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463525 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-bound-sa-token\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.463745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463583 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50947029-0ddc-4232-928a-e7b487fbe2bf-ca-trust-extracted\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.463745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463615 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.463745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463632 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-certificates\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.463745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463650 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-image-registry-private-configuration\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.463745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463688 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5dz4\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-kube-api-access-v5dz4\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.463745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463718 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-trusted-ca\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.464039 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.463769 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-installation-pull-secrets\") pod \"50947029-0ddc-4232-928a-e7b487fbe2bf\" (UID: \"50947029-0ddc-4232-928a-e7b487fbe2bf\") " Jun 12 19:15:58.464206 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.464148 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:15:58.464314 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.464264 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:15:58.466084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.466045 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:15:58.466170 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.466076 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:15:58.466170 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.466111 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-kube-api-access-v5dz4" (OuterVolumeSpecName: "kube-api-access-v5dz4") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "kube-api-access-v5dz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:15:58.466170 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.466142 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:15:58.466639 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.466620 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:15:58.473694 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.473667 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50947029-0ddc-4232-928a-e7b487fbe2bf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "50947029-0ddc-4232-928a-e7b487fbe2bf" (UID: "50947029-0ddc-4232-928a-e7b487fbe2bf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:15:58.564607 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564567 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-installation-pull-secrets\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564607 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564603 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-bound-sa-token\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564607 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564616 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50947029-0ddc-4232-928a-e7b487fbe2bf-ca-trust-extracted\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564628 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-tls\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564641 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-registry-certificates\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564652 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50947029-0ddc-4232-928a-e7b487fbe2bf-image-registry-private-configuration\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564666 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5dz4\" (UniqueName: \"kubernetes.io/projected/50947029-0ddc-4232-928a-e7b487fbe2bf-kube-api-access-v5dz4\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.564844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.564676 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50947029-0ddc-4232-928a-e7b487fbe2bf-trusted-ca\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:15:58.715406 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.715322 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerStarted","Data":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} Jun 12 19:15:58.716723 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.716694 2554 generic.go:356] "Generic (PLEG): container finished" podID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerID="b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb" exitCode=0 Jun 12 19:15:58.716851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.716761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" event={"ID":"50947029-0ddc-4232-928a-e7b487fbe2bf","Type":"ContainerDied","Data":"b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb"} Jun 12 19:15:58.716851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.716796 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" event={"ID":"50947029-0ddc-4232-928a-e7b487fbe2bf","Type":"ContainerDied","Data":"f81d55f0c94367c7ae15a0f5d5c3e16ec56fcbc9aaeaad1d63723fa653c6e677"} Jun 12 19:15:58.716851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.716819 2554 scope.go:117] "RemoveContainer" containerID="b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb" Jun 12 19:15:58.717076 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.716954 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cc9d548-j5x88" Jun 12 19:15:58.727076 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.727038 2554 scope.go:117] "RemoveContainer" containerID="b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb" Jun 12 19:15:58.727391 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:15:58.727368 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb\": container with ID starting with b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb not found: ID does not exist" containerID="b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb" Jun 12 19:15:58.727509 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.727398 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb"} err="failed to get container status \"b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb\": rpc error: code = NotFound desc = could not find container \"b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb\": container with ID starting with b3c20667edc408d0094b4fb4afedb9e002276875116e9434330839a3f15ff7fb not found: ID does not exist" Jun 12 19:15:58.751750 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.751694 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.012817749 podStartE2EDuration="8.751676817s" totalImagesPullingTime="5.717073447s" totalInitContainerRuntime="21.785621ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:15:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:15:58.748627994 +0000 UTC m=+265.378694214" watchObservedRunningTime="2026-06-12 19:15:58.751676817 +0000 UTC m=+265.381743037" Jun 12 19:15:58.764405 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.764368 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68cc9d548-j5x88"] Jun 12 19:15:58.768546 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:58.768487 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68cc9d548-j5x88"] Jun 12 19:15:59.819592 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:15:59.819560 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" path="/var/lib/kubelet/pods/50947029-0ddc-4232-928a-e7b487fbe2bf/volumes" Jun 12 19:16:01.065807 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:01.065769 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:16:15.433794 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:15.433758 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c7f568f68-wjm54" podUID="561891a0-74e9-475c-a6d9-5fc81a3af231" containerName="console" containerID="cri-o://c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713" gracePeriod=15 Jun 12 19:16:16.335668 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:16.335630 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bzkjg" podUID="29b86679-82f5-4b22-b237-6baf60380db9" Jun 12 19:16:16.784061 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:16.784034 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bzkjg" Jun 12 19:16:19.646694 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:19.646657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:16:19.649001 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:19.648969 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29b86679-82f5-4b22-b237-6baf60380db9-metrics-tls\") pod \"dns-default-bzkjg\" (UID: \"29b86679-82f5-4b22-b237-6baf60380db9\") " pod="openshift-dns/dns-default-bzkjg" Jun 12 19:16:19.787879 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:19.787847 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b26x6\"" Jun 12 19:16:19.795655 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:19.795625 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bzkjg" Jun 12 19:16:20.060214 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:20.060178 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bzkjg"] Jun 12 19:16:20.063347 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:16:20.063314 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b86679_82f5_4b22_b237_6baf60380db9.slice/crio-7bae9b633d2d2879ab1d0e450f7743f6c72a329bbfb7e17e1087a9ba220eece8 WatchSource:0}: Error finding container 7bae9b633d2d2879ab1d0e450f7743f6c72a329bbfb7e17e1087a9ba220eece8: Status 404 returned error can't find the container with id 7bae9b633d2d2879ab1d0e450f7743f6c72a329bbfb7e17e1087a9ba220eece8 Jun 12 19:16:20.799480 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:20.799440 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bzkjg" event={"ID":"29b86679-82f5-4b22-b237-6baf60380db9","Type":"ContainerStarted","Data":"7bae9b633d2d2879ab1d0e450f7743f6c72a329bbfb7e17e1087a9ba220eece8"} Jun 12 19:16:21.804873 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:21.804784 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bzkjg" event={"ID":"29b86679-82f5-4b22-b237-6baf60380db9","Type":"ContainerStarted","Data":"b72f5cd9c8e5c229dca09c869626bd0c4774c7a11a6fa870b352b1d379236aa2"} Jun 12 19:16:21.804873 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:21.804835 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bzkjg" event={"ID":"29b86679-82f5-4b22-b237-6baf60380db9","Type":"ContainerStarted","Data":"de36db7f108bbddef77d604616ac2336c6b39792ee77775429f20c913c34303c"} Jun 12 19:16:21.805284 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:21.804903 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bzkjg" Jun 12 19:16:21.825161 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:21.825112 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bzkjg" podStartSLOduration=251.420454357 podStartE2EDuration="4m12.825096561s" totalImagesPullingTime="1.404642204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:16:21.824160506 +0000 UTC m=+288.454226727" watchObservedRunningTime="2026-06-12 19:16:21.825096561 +0000 UTC m=+288.455162780" Jun 12 19:16:24.820067 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.819962 2554 generic.go:356] "Generic (PLEG): container finished" podID="46713dc6-001d-4e49-ac97-2992074420fd" containerID="ce0ed013b08fab3a42ba09efc75000726d096084c2eab249fafc31a48dbebe16" exitCode=255 Jun 12 19:16:24.820067 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.820044 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" event={"ID":"46713dc6-001d-4e49-ac97-2992074420fd","Type":"ContainerDied","Data":"ce0ed013b08fab3a42ba09efc75000726d096084c2eab249fafc31a48dbebe16"} Jun 12 19:16:24.820582 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.820092 2554 scope.go:117] "RemoveContainer" containerID="2e9f9462c5f65b10abcb73495e60dc03547f3e768d80ac889ebc525f662842e9" Jun 12 19:16:24.826864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.826828 2554 generic.go:356] "Generic (PLEG): container finished" podID="d57867d2-662b-420e-939f-c3693968487a" containerID="cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8" exitCode=1 Jun 12 19:16:24.826996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.826877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" event={"ID":"d57867d2-662b-420e-939f-c3693968487a","Type":"ContainerDied","Data":"cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8"} Jun 12 19:16:24.827277 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.827261 2554 scope.go:117] "RemoveContainer" containerID="cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8" Jun 12 19:16:24.827529 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:24.827506 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b58756666-tjxfv_open-cluster-management-agent-addon(d57867d2-662b-420e-939f-c3693968487a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" podUID="d57867d2-662b-420e-939f-c3693968487a" Jun 12 19:16:24.831792 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.831770 2554 scope.go:117] "RemoveContainer" containerID="ce0ed013b08fab3a42ba09efc75000726d096084c2eab249fafc31a48dbebe16" Jun 12 19:16:24.831952 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:24.831932 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-67d98454b4-p9t9b_open-cluster-management-agent-addon(46713dc6-001d-4e49-ac97-2992074420fd)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" podUID="46713dc6-001d-4e49-ac97-2992074420fd" Jun 12 19:16:24.833159 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:24.833140 2554 scope.go:117] "RemoveContainer" containerID="9fb68fb2d0277809419fe06e6a272cf00f2c543af4eda269f03b6b8ae564076e" Jun 12 19:16:25.373681 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:25.373642 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:16:25.832168 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:25.832138 2554 scope.go:117] "RemoveContainer" containerID="cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8" Jun 12 19:16:25.832604 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:25.832356 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b58756666-tjxfv_open-cluster-management-agent-addon(d57867d2-662b-420e-939f-c3693968487a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" podUID="d57867d2-662b-420e-939f-c3693968487a" Jun 12 19:16:27.732079 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:27.732033 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" Jun 12 19:16:27.732588 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:27.732501 2554 scope.go:117] "RemoveContainer" containerID="ce0ed013b08fab3a42ba09efc75000726d096084c2eab249fafc31a48dbebe16" Jun 12 19:16:27.732723 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:27.732700 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-67d98454b4-p9t9b_open-cluster-management-agent-addon(46713dc6-001d-4e49-ac97-2992074420fd)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" podUID="46713dc6-001d-4e49-ac97-2992074420fd" Jun 12 19:16:27.744303 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:27.744280 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:16:27.744665 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:27.744650 2554 scope.go:117] "RemoveContainer" containerID="cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8" Jun 12 19:16:27.744855 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:27.744827 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b58756666-tjxfv_open-cluster-management-agent-addon(d57867d2-662b-420e-939f-c3693968487a)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" podUID="d57867d2-662b-420e-939f-c3693968487a" Jun 12 19:16:30.623356 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.623334 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c7f568f68-wjm54_561891a0-74e9-475c-a6d9-5fc81a3af231/console/0.log" Jun 12 19:16:30.624545 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.624530 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:16:30.632204 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632189 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-service-ca\") pod \"561891a0-74e9-475c-a6d9-5fc81a3af231\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " Jun 12 19:16:30.632262 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632228 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-serving-cert\") pod \"561891a0-74e9-475c-a6d9-5fc81a3af231\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " Jun 12 19:16:30.632262 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632250 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-oauth-config\") pod \"561891a0-74e9-475c-a6d9-5fc81a3af231\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " Jun 12 19:16:30.632324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632274 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-console-config\") pod \"561891a0-74e9-475c-a6d9-5fc81a3af231\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " Jun 12 19:16:30.632324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632299 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phxwj\" (UniqueName: \"kubernetes.io/projected/561891a0-74e9-475c-a6d9-5fc81a3af231-kube-api-access-phxwj\") pod \"561891a0-74e9-475c-a6d9-5fc81a3af231\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " Jun 12 19:16:30.632324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632321 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-oauth-serving-cert\") pod \"561891a0-74e9-475c-a6d9-5fc81a3af231\" (UID: \"561891a0-74e9-475c-a6d9-5fc81a3af231\") " Jun 12 19:16:30.632645 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632613 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-service-ca" (OuterVolumeSpecName: "service-ca") pod "561891a0-74e9-475c-a6d9-5fc81a3af231" (UID: "561891a0-74e9-475c-a6d9-5fc81a3af231"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:16:30.632755 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632737 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-console-config" (OuterVolumeSpecName: "console-config") pod "561891a0-74e9-475c-a6d9-5fc81a3af231" (UID: "561891a0-74e9-475c-a6d9-5fc81a3af231"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:16:30.632872 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.632848 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "561891a0-74e9-475c-a6d9-5fc81a3af231" (UID: "561891a0-74e9-475c-a6d9-5fc81a3af231"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:16:30.634410 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.634384 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "561891a0-74e9-475c-a6d9-5fc81a3af231" (UID: "561891a0-74e9-475c-a6d9-5fc81a3af231"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:16:30.634507 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.634452 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "561891a0-74e9-475c-a6d9-5fc81a3af231" (UID: "561891a0-74e9-475c-a6d9-5fc81a3af231"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:16:30.634565 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.634544 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/561891a0-74e9-475c-a6d9-5fc81a3af231-kube-api-access-phxwj" (OuterVolumeSpecName: "kube-api-access-phxwj") pod "561891a0-74e9-475c-a6d9-5fc81a3af231" (UID: "561891a0-74e9-475c-a6d9-5fc81a3af231"). InnerVolumeSpecName "kube-api-access-phxwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:16:30.733587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.733536 2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-serving-cert\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:16:30.733587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.733556 2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/561891a0-74e9-475c-a6d9-5fc81a3af231-console-oauth-config\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:16:30.733587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.733566 2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-console-config\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:16:30.733587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.733575 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phxwj\" (UniqueName: \"kubernetes.io/projected/561891a0-74e9-475c-a6d9-5fc81a3af231-kube-api-access-phxwj\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:16:30.733587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.733583 2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-oauth-serving-cert\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:16:30.733784 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.733592 2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/561891a0-74e9-475c-a6d9-5fc81a3af231-service-ca\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:16:30.852906 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.852886 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c7f568f68-wjm54_561891a0-74e9-475c-a6d9-5fc81a3af231/console/0.log" Jun 12 19:16:30.852982 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.852921 2554 generic.go:356] "Generic (PLEG): container finished" podID="561891a0-74e9-475c-a6d9-5fc81a3af231" containerID="c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713" exitCode=137 Jun 12 19:16:30.852982 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.852959 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f568f68-wjm54" Jun 12 19:16:30.852982 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.852968 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f568f68-wjm54" event={"ID":"561891a0-74e9-475c-a6d9-5fc81a3af231","Type":"ContainerDied","Data":"c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713"} Jun 12 19:16:30.853081 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.852996 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f568f68-wjm54" event={"ID":"561891a0-74e9-475c-a6d9-5fc81a3af231","Type":"ContainerDied","Data":"fc469a787259d17885c995ec079674e333361adbc07c82a60454ec8e80047ac6"} Jun 12 19:16:30.853081 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.853014 2554 scope.go:117] "RemoveContainer" containerID="c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713" Jun 12 19:16:30.861192 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.861169 2554 scope.go:117] "RemoveContainer" containerID="c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713" Jun 12 19:16:30.861416 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:16:30.861399 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713\": container with ID starting with c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713 not found: ID does not exist" containerID="c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713" Jun 12 19:16:30.861478 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.861439 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713"} err="failed to get container status \"c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713\": rpc error: code = NotFound desc = could not find container \"c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713\": container with ID starting with c5b9a0273c74d0b6f01519c5c1aadde9c7458d119d985f69c6241305f86a2713 not found: ID does not exist" Jun 12 19:16:30.877462 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.877439 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7f568f68-wjm54"] Jun 12 19:16:30.879265 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:30.879245 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7f568f68-wjm54"] Jun 12 19:16:31.814659 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:31.814630 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="561891a0-74e9-475c-a6d9-5fc81a3af231" path="/var/lib/kubelet/pods/561891a0-74e9-475c-a6d9-5fc81a3af231/volumes" Jun 12 19:16:31.815054 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:31.814907 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bzkjg" Jun 12 19:16:32.980548 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:32.980521 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6sxw_cf393f55-dc15-493e-a254-62b71f58a42b/init-textfile/0.log" Jun 12 19:16:33.183406 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:33.183376 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6sxw_cf393f55-dc15-493e-a254-62b71f58a42b/node-exporter/0.log" Jun 12 19:16:33.380616 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:33.380551 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6sxw_cf393f55-dc15-493e-a254-62b71f58a42b/kube-rbac-proxy/0.log" Jun 12 19:16:33.773729 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:33.773703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:16:33.774634 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:33.774613 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:16:33.777080 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:33.777062 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 19:16:34.181071 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:34.181045 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-fvm98_d2f0ce90-aad5-4183-af7a-eab66ba42849/kube-rbac-proxy-main/0.log" Jun 12 19:16:34.381562 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:34.381534 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-fvm98_d2f0ce90-aad5-4183-af7a-eab66ba42849/kube-rbac-proxy-self/0.log" Jun 12 19:16:34.582718 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:34.582621 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-fvm98_d2f0ce90-aad5-4183-af7a-eab66ba42849/openshift-state-metrics/0.log" Jun 12 19:16:34.781445 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:34.781391 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/init-config-reloader/0.log" Jun 12 19:16:34.981169 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:34.981145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/prometheus/0.log" Jun 12 19:16:35.184031 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:35.183997 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/config-reloader/0.log" Jun 12 19:16:35.381138 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:35.381064 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/thanos-sidecar/0.log" Jun 12 19:16:35.581850 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:35.581783 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/kube-rbac-proxy-web/0.log" Jun 12 19:16:35.781046 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:35.781004 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/kube-rbac-proxy/0.log" Jun 12 19:16:35.988000 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:35.987934 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_566d0443-3970-45aa-82b0-a0d9baa9ee11/kube-rbac-proxy-thanos/0.log" Jun 12 19:16:36.182787 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:36.182761 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-lsqnw_19fdeafb-a4d2-4be3-b65b-b77f30b6796a/prometheus-operator/0.log" Jun 12 19:16:36.380835 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:36.380799 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-lsqnw_19fdeafb-a4d2-4be3-b65b-b77f30b6796a/kube-rbac-proxy/0.log" Jun 12 19:16:36.582203 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:36.582133 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-ff2bv_214b534e-0a92-45ea-8946-0267ad1ba440/prometheus-operator-admission-webhook/0.log" Jun 12 19:16:37.981897 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:37.981870 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-rg4zt_a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a/networking-console-plugin/0.log" Jun 12 19:16:38.810490 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:38.810455 2554 scope.go:117] "RemoveContainer" containerID="cabb3748c4061010b796eb9f877866a8db7e51c96692ffe06ebecf532f0115e8" Jun 12 19:16:38.885883 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:38.885845 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" event={"ID":"d57867d2-662b-420e-939f-c3693968487a","Type":"ContainerStarted","Data":"06c248e3f35749739a273f9e7f186ee885061fa0cee55a17f725e891f53c6127"} Jun 12 19:16:38.886225 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:38.886205 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:16:38.887467 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:38.887415 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" podUID="d57867d2-662b-420e-939f-c3693968487a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 12 19:16:39.380864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:39.380835 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bzkjg_29b86679-82f5-4b22-b237-6baf60380db9/dns/0.log" Jun 12 19:16:39.580873 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:39.580836 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bzkjg_29b86679-82f5-4b22-b237-6baf60380db9/kube-rbac-proxy/0.log" Jun 12 19:16:39.890666 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:39.890634 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58756666-tjxfv" Jun 12 19:16:40.982633 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:40.982605 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zz8tb_5174921b-e915-4fa0-9a87-4a64bb1515c0/dns-node-resolver/0.log" Jun 12 19:16:41.580502 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:41.580467 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7qhc_6661ec26-5225-42d0-8e1f-60a5c03e3d86/node-ca/0.log" Jun 12 19:16:42.580705 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:42.580677 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pnmjv_2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9/serve-healthcheck-canary/0.log" Jun 12 19:16:42.815950 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:42.815923 2554 scope.go:117] "RemoveContainer" containerID="ce0ed013b08fab3a42ba09efc75000726d096084c2eab249fafc31a48dbebe16" Jun 12 19:16:42.903054 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:42.903021 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67d98454b4-p9t9b" event={"ID":"46713dc6-001d-4e49-ac97-2992074420fd","Type":"ContainerStarted","Data":"ddd3c66259a98b7d7af33d6d69294be2803e454ea18b053cea3598ee112c5257"} Jun 12 19:16:51.066234 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:51.066177 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:16:51.087394 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:51.087363 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:16:51.955331 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:16:51.955290 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:09.176403 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.176361 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:17:09.176995 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.176773 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="prometheus" containerID="cri-o://7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" gracePeriod=600 Jun 12 19:17:09.176995 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.176901 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy" containerID="cri-o://c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" gracePeriod=600 Jun 12 19:17:09.176995 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.176954 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-web" containerID="cri-o://9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" gracePeriod=600 Jun 12 19:17:09.177164 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.177017 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" gracePeriod=600 Jun 12 19:17:09.177164 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.177039 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="thanos-sidecar" containerID="cri-o://450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" gracePeriod=600 Jun 12 19:17:09.177164 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.177093 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="config-reloader" containerID="cri-o://9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" gracePeriod=600 Jun 12 19:17:09.440346 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.440316 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:09.527241 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527208 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-config-out\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527249 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-grpc-tls\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527267 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-db\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527284 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-trusted-ca-bundle\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527318 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527345 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-serving-certs-ca-bundle\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527373 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-tls-assets\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527437 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527403 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527444 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45dwg\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-kube-api-access-45dwg\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527472 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-metrics-client-ca\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527499 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-kubelet-serving-ca-bundle\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527535 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-metrics-client-certs\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527560 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-kube-rbac-proxy\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527584 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-config\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527605 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-1\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527627 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-tls\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527647 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-thanos-prometheus-http-client-file\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527673 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-2\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527706 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-0\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.527795 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527729 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-web-config\") pod \"566d0443-3970-45aa-82b0-a0d9baa9ee11\" (UID: \"566d0443-3970-45aa-82b0-a0d9baa9ee11\") " Jun 12 19:17:09.528345 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.527919 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.528399 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.528338 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:17:09.529372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.528668 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.529372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.528768 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.529372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.529032 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.530271 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.529977 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.530747 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.530483 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.530849 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.530829 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.531926 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.531887 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.532059 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532029 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-kube-api-access-45dwg" (OuterVolumeSpecName: "kube-api-access-45dwg") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "kube-api-access-45dwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:09.532129 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532103 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-config-out" (OuterVolumeSpecName: "config-out") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:17:09.532249 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532219 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:17:09.532620 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532590 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.532713 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532617 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.532876 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532839 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:17:09.532944 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.532914 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.533357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.533332 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.533589 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.533570 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-config" (OuterVolumeSpecName: "config") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.534296 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.534273 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.543054 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.543024 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-web-config" (OuterVolumeSpecName: "web-config") pod "566d0443-3970-45aa-82b0-a0d9baa9ee11" (UID: "566d0443-3970-45aa-82b0-a0d9baa9ee11"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 19:17:09.628780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628738 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.628780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628770 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.628780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628780 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-tls-assets\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.628780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628790 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628799 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45dwg\" (UniqueName: \"kubernetes.io/projected/566d0443-3970-45aa-82b0-a0d9baa9ee11-kube-api-access-45dwg\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628808 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-metrics-client-ca\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628819 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628828 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-metrics-client-certs\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628838 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-kube-rbac-proxy\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628846 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-config\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628856 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628864 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628873 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628881 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628891 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628899 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-web-config\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628906 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-config-out\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628913 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/566d0443-3970-45aa-82b0-a0d9baa9ee11-secret-grpc-tls\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628920 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-k8s-db\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:09.629042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:09.628929 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/566d0443-3970-45aa-82b0-a0d9baa9ee11-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:17:10.006063 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006025 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" exitCode=0 Jun 12 19:17:10.006063 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006053 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" exitCode=0 Jun 12 19:17:10.006063 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006062 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" exitCode=0 Jun 12 19:17:10.006063 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006069 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" exitCode=0 Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006076 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" exitCode=0 Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006084 2554 generic.go:356] "Generic (PLEG): container finished" podID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" exitCode=0 Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006104 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006118 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006181 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006215 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006240 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006263 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006265 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} Jun 12 19:17:10.006390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006375 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} Jun 12 19:17:10.006864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.006399 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"566d0443-3970-45aa-82b0-a0d9baa9ee11","Type":"ContainerDied","Data":"be95523e725708ef63fc23245a0abc557279a557806aebd5a55741e344fd41f6"} Jun 12 19:17:10.014089 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.014073 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.021579 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.021553 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.028207 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.028186 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.035096 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.035067 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:17:10.035440 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.035406 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.039901 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.039877 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:17:10.042656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.042639 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.049842 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.049825 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.056739 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.056719 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.057010 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.056990 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.057052 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057020 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} err="failed to get container status \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" Jun 12 19:17:10.057052 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057040 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.057278 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.057261 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.057321 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057286 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} err="failed to get container status \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" Jun 12 19:17:10.057321 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057304 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.057539 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.057519 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.057622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057542 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} err="failed to get container status \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" Jun 12 19:17:10.057622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057555 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.057765 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.057749 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.057814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057765 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} err="failed to get container status \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" Jun 12 19:17:10.057814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057776 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.057980 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.057956 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.058093 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057982 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} err="failed to get container status \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" Jun 12 19:17:10.058093 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.057997 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.058279 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.058259 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.058336 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.058281 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} err="failed to get container status \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" Jun 12 19:17:10.058336 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.058293 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.058534 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:17:10.058519 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.058579 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.058537 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} err="failed to get container status \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" Jun 12 19:17:10.058579 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.058550 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.058765 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.058744 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} err="failed to get container status \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" Jun 12 19:17:10.058810 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.058767 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.059028 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059009 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} err="failed to get container status \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" Jun 12 19:17:10.059095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059030 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.059265 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059249 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} err="failed to get container status \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" Jun 12 19:17:10.059312 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059266 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.059509 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059488 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} err="failed to get container status \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" Jun 12 19:17:10.059563 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059510 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.059744 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059726 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} err="failed to get container status \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" Jun 12 19:17:10.059808 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059745 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.059975 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059958 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} err="failed to get container status \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" Jun 12 19:17:10.060022 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.059976 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.060171 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060154 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} err="failed to get container status \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" Jun 12 19:17:10.060240 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060173 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.060361 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060345 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} err="failed to get container status \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" Jun 12 19:17:10.060452 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060363 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.060581 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060565 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} err="failed to get container status \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" Jun 12 19:17:10.060648 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060581 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.060810 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060792 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} err="failed to get container status \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" Jun 12 19:17:10.060854 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060811 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.060998 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.060981 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} err="failed to get container status \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" Jun 12 19:17:10.061065 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061001 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.061205 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061182 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} err="failed to get container status \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" Jun 12 19:17:10.061250 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061205 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.061416 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061397 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} err="failed to get container status \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" Jun 12 19:17:10.061476 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061417 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.061658 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061641 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} err="failed to get container status \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" Jun 12 19:17:10.061658 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061657 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.061845 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061829 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} err="failed to get container status \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" Jun 12 19:17:10.061898 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.061845 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.062027 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062013 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} err="failed to get container status \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" Jun 12 19:17:10.062082 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062027 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.062252 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062234 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} err="failed to get container status \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" Jun 12 19:17:10.062312 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062253 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.062480 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062462 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} err="failed to get container status \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" Jun 12 19:17:10.062545 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062480 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.062697 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062678 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} err="failed to get container status \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" Jun 12 19:17:10.062739 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062697 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.062879 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062864 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} err="failed to get container status \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" Jun 12 19:17:10.062917 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.062879 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.063092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063075 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} err="failed to get container status \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" Jun 12 19:17:10.063092 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063091 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.063305 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063289 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} err="failed to get container status \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" Jun 12 19:17:10.063350 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063304 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.063530 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063514 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} err="failed to get container status \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" Jun 12 19:17:10.063573 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063530 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.063728 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063712 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} err="failed to get container status \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" Jun 12 19:17:10.063785 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063738 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.063940 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063925 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} err="failed to get container status \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" Jun 12 19:17:10.063997 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.063940 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.064135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064120 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} err="failed to get container status \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" Jun 12 19:17:10.064194 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064136 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.064346 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064330 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} err="failed to get container status \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" Jun 12 19:17:10.064346 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064346 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.064551 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064531 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} err="failed to get container status \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" Jun 12 19:17:10.064551 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064549 2554 scope.go:117] "RemoveContainer" containerID="0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90" Jun 12 19:17:10.064748 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064732 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90"} err="failed to get container status \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": rpc error: code = NotFound desc = could not find container \"0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90\": container with ID starting with 0b1667d9babf45597885c268655756d528884852855279abf6ff31e2fd32af90 not found: ID does not exist" Jun 12 19:17:10.064748 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064748 2554 scope.go:117] "RemoveContainer" containerID="c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c" Jun 12 19:17:10.064948 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064933 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c"} err="failed to get container status \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": rpc error: code = NotFound desc = could not find container \"c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c\": container with ID starting with c5e7a602ca69d70a3467b21aa99653e5bc73ee9b4858e51c6ce60d6177ee227c not found: ID does not exist" Jun 12 19:17:10.064948 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.064947 2554 scope.go:117] "RemoveContainer" containerID="9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d" Jun 12 19:17:10.065120 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065102 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d"} err="failed to get container status \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": rpc error: code = NotFound desc = could not find container \"9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d\": container with ID starting with 9a00daaa5818f0c529e661fc240e329dea2dad837609a8517657e8133f83b03d not found: ID does not exist" Jun 12 19:17:10.065163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065121 2554 scope.go:117] "RemoveContainer" containerID="450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f" Jun 12 19:17:10.065307 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065292 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f"} err="failed to get container status \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": rpc error: code = NotFound desc = could not find container \"450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f\": container with ID starting with 450473b44458f57cb232b74c5ad10cedd0bd6771c5d69656c22912441b7eb54f not found: ID does not exist" Jun 12 19:17:10.065348 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065306 2554 scope.go:117] "RemoveContainer" containerID="9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275" Jun 12 19:17:10.065488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065474 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275"} err="failed to get container status \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": rpc error: code = NotFound desc = could not find container \"9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275\": container with ID starting with 9b89a1596f4517eb7a31efc4def26bed4f0043e6cbe02a8769b256ed2e397275 not found: ID does not exist" Jun 12 19:17:10.065488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065487 2554 scope.go:117] "RemoveContainer" containerID="7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156" Jun 12 19:17:10.065682 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065652 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156"} err="failed to get container status \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": rpc error: code = NotFound desc = could not find container \"7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156\": container with ID starting with 7d544e273f0bcf1c6fa6e6a0f0cce5129cc1e6035a4f9a556394e05d965d6156 not found: ID does not exist" Jun 12 19:17:10.065682 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065671 2554 scope.go:117] "RemoveContainer" containerID="4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68" Jun 12 19:17:10.065877 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.065857 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68"} err="failed to get container status \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": rpc error: code = NotFound desc = could not find container \"4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68\": container with ID starting with 4062caab2099c0f8b0b3fb54814ffea715c60d83675b3b967b8a4b073353cf68 not found: ID does not exist" Jun 12 19:17:10.069641 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069621 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:17:10.069870 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069859 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-web" Jun 12 19:17:10.069909 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069872 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-web" Jun 12 19:17:10.069909 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069880 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy" Jun 12 19:17:10.069909 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069885 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy" Jun 12 19:17:10.069909 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069893 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="config-reloader" Jun 12 19:17:10.069909 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069900 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="config-reloader" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069911 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="thanos-sidecar" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069917 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="thanos-sidecar" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069924 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="561891a0-74e9-475c-a6d9-5fc81a3af231" containerName="console" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069929 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="561891a0-74e9-475c-a6d9-5fc81a3af231" containerName="console" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069935 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-thanos" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069940 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-thanos" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069951 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="init-config-reloader" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069956 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="init-config-reloader" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069961 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="prometheus" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069966 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="prometheus" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069972 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.069977 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070017 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="prometheus" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070025 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070031 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="561891a0-74e9-475c-a6d9-5fc81a3af231" containerName="console" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070037 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="config-reloader" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070042 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-thanos" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070048 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="thanos-sidecar" Jun 12 19:17:10.070047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070054 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="50947029-0ddc-4232-928a-e7b487fbe2bf" containerName="registry" Jun 12 19:17:10.070563 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.070059 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" containerName="kube-rbac-proxy-web" Jun 12 19:17:10.075189 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.075138 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.080199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.080176 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 19:17:10.080522 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.080413 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 19:17:10.080522 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.080467 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 19:17:10.080692 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.080475 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wwdd9\"" Jun 12 19:17:10.080761 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.080747 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 19:17:10.080981 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.080962 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 19:17:10.081067 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.081005 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 19:17:10.082350 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.082321 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 19:17:10.082460 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.082354 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3pjmlunieg1op\"" Jun 12 19:17:10.082517 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.082458 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 19:17:10.082631 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.082615 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 19:17:10.083318 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.083302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 19:17:10.083390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.083358 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 19:17:10.083490 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.083439 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 19:17:10.083745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.083727 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 19:17:10.085512 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.085494 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 19:17:10.087989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.087971 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 19:17:10.096128 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.096104 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:17:10.133486 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133486 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133485 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133567 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935aca99-422a-4d86-b059-9097d41009a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133628 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133684 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133725 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-config\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133745 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133770 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133855 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935aca99-422a-4d86-b059-9097d41009a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.133989 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.134297 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.133996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.134297 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.134068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.134297 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.134099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.134297 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.134123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmqj\" (UniqueName: \"kubernetes.io/projected/935aca99-422a-4d86-b059-9097d41009a6-kube-api-access-7qmqj\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235035 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.234996 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935aca99-422a-4d86-b059-9097d41009a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235035 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235039 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235112 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-config\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235167 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235202 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235230 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935aca99-422a-4d86-b059-9097d41009a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235303 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235366 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235396 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235417 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmqj\" (UniqueName: \"kubernetes.io/projected/935aca99-422a-4d86-b059-9097d41009a6-kube-api-access-7qmqj\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235504 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.235635 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.236390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.236390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.235664 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.236390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.236094 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.236390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.236292 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.238123 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/935aca99-422a-4d86-b059-9097d41009a6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.238307 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.238849 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-config\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.238899 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.238960 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239383 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.239126 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-web-config\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239383 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.239256 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239522 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.239485 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239963 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.239709 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239963 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.239855 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.239963 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.239914 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.240792 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.240765 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/935aca99-422a-4d86-b059-9097d41009a6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.240933 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.240910 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.241300 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.241279 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.241505 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.241481 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/935aca99-422a-4d86-b059-9097d41009a6-config-out\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.241726 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.241710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/935aca99-422a-4d86-b059-9097d41009a6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.244366 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.244349 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmqj\" (UniqueName: \"kubernetes.io/projected/935aca99-422a-4d86-b059-9097d41009a6-kube-api-access-7qmqj\") pod \"prometheus-k8s-0\" (UID: \"935aca99-422a-4d86-b059-9097d41009a6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.385058 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.384967 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:17:10.531025 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:10.530994 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 19:17:10.534192 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:17:10.534166 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935aca99_422a_4d86_b059_9097d41009a6.slice/crio-c795be30f76312de926b21a184f69376fa325bae5e5eca2adc9687dff09e85f2 WatchSource:0}: Error finding container c795be30f76312de926b21a184f69376fa325bae5e5eca2adc9687dff09e85f2: Status 404 returned error can't find the container with id c795be30f76312de926b21a184f69376fa325bae5e5eca2adc9687dff09e85f2 Jun 12 19:17:11.012700 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:11.012663 2554 generic.go:356] "Generic (PLEG): container finished" podID="935aca99-422a-4d86-b059-9097d41009a6" containerID="418a400e3ba1387e4566b07c34cc3aa8b2360cdd7089a0b6c7cc1d64763a8184" exitCode=0 Jun 12 19:17:11.012871 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:11.012711 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerDied","Data":"418a400e3ba1387e4566b07c34cc3aa8b2360cdd7089a0b6c7cc1d64763a8184"} Jun 12 19:17:11.012871 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:11.012767 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"c795be30f76312de926b21a184f69376fa325bae5e5eca2adc9687dff09e85f2"} Jun 12 19:17:11.815012 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:11.814979 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="566d0443-3970-45aa-82b0-a0d9baa9ee11" path="/var/lib/kubelet/pods/566d0443-3970-45aa-82b0-a0d9baa9ee11/volumes" Jun 12 19:17:12.020824 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.020788 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"8e1a9d6e675160b5233cc3528b6756eea96de821c2b0d0eb626ee1bc9add3ba5"} Jun 12 19:17:12.020996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.020857 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"2e815f98a2c73243d833903a53fc5d8f03daf64c5b9be408a2964ec266f5ca03"} Jun 12 19:17:12.020996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.020889 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"67380b7a561eab24b0620c0f7053539e872cb81eacb922a9b4f3f93496a03a1a"} Jun 12 19:17:12.020996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.020914 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"3be26f281fe52724e81302d0d0635fa75147075b7e9f46edc61bce77b2883006"} Jun 12 19:17:12.020996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.020945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"520dfdae4e201608709309e232daa022237417a3b6a8d747571a49750be528f7"} Jun 12 19:17:12.020996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.020972 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"935aca99-422a-4d86-b059-9097d41009a6","Type":"ContainerStarted","Data":"18321ddf44a07dd9b5c1a8ff2259b6fc6d30a07e3a3e35b9b2b6f9d362f00b00"} Jun 12 19:17:12.052158 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:12.052097 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.034543512 podStartE2EDuration="2.052046321s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.502809ms" isStatefulPod=false podCreationTimestamp="2026-06-12 19:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:17:12.050220787 +0000 UTC m=+338.680287008" watchObservedRunningTime="2026-06-12 19:17:12.052046321 +0000 UTC m=+338.682112540" Jun 12 19:17:15.385767 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:17:15.385710 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:18:10.385636 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:18:10.385587 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:18:10.401231 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:18:10.401199 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:18:11.252949 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:18:11.252925 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 19:20:10.447111 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.447073 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz"] Jun 12 19:20:10.450490 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.450473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.453632 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.453611 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 19:20:10.453740 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.453637 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 19:20:10.454235 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.454217 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 19:20:10.454665 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.454648 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q52mx\"" Jun 12 19:20:10.454757 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.454671 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 19:20:10.466694 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.466669 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz"] Jun 12 19:20:10.603661 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.603625 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/316d8cce-bee4-4c46-a151-8e78842a0781-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.603836 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.603692 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzjr\" (UniqueName: \"kubernetes.io/projected/316d8cce-bee4-4c46-a151-8e78842a0781-kube-api-access-bvzjr\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.603836 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.603756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/316d8cce-bee4-4c46-a151-8e78842a0781-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.603836 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.603775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/316d8cce-bee4-4c46-a151-8e78842a0781-tmp\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.603836 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.603803 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/316d8cce-bee4-4c46-a151-8e78842a0781-manifests\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.705061 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.704975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvzjr\" (UniqueName: \"kubernetes.io/projected/316d8cce-bee4-4c46-a151-8e78842a0781-kube-api-access-bvzjr\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.705061 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.705019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/316d8cce-bee4-4c46-a151-8e78842a0781-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.705061 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.705039 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/316d8cce-bee4-4c46-a151-8e78842a0781-tmp\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.705310 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.705066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/316d8cce-bee4-4c46-a151-8e78842a0781-manifests\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.705310 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.705163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/316d8cce-bee4-4c46-a151-8e78842a0781-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.705496 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.705475 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/316d8cce-bee4-4c46-a151-8e78842a0781-manifests\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.707549 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.707525 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/316d8cce-bee4-4c46-a151-8e78842a0781-tmp\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.707698 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.707676 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/316d8cce-bee4-4c46-a151-8e78842a0781-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.707792 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.707777 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/316d8cce-bee4-4c46-a151-8e78842a0781-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.718663 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.718641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvzjr\" (UniqueName: \"kubernetes.io/projected/316d8cce-bee4-4c46-a151-8e78842a0781-kube-api-access-bvzjr\") pod \"opendatahub-operator-controller-manager-6dc6d65868-gw4rz\" (UID: \"316d8cce-bee4-4c46-a151-8e78842a0781\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.760831 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.760793 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:10.933968 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.933942 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz"] Jun 12 19:20:10.935853 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:20:10.935824 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316d8cce_bee4_4c46_a151_8e78842a0781.slice/crio-1c9fa1e82cea207f912b2d82507e5311a4dd1cf4291a945d42f6d19dc5505be8 WatchSource:0}: Error finding container 1c9fa1e82cea207f912b2d82507e5311a4dd1cf4291a945d42f6d19dc5505be8: Status 404 returned error can't find the container with id 1c9fa1e82cea207f912b2d82507e5311a4dd1cf4291a945d42f6d19dc5505be8 Jun 12 19:20:10.937599 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:10.937582 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:20:11.673887 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:11.673850 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" event={"ID":"316d8cce-bee4-4c46-a151-8e78842a0781","Type":"ContainerStarted","Data":"1c9fa1e82cea207f912b2d82507e5311a4dd1cf4291a945d42f6d19dc5505be8"} Jun 12 19:20:13.682488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:13.682456 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" event={"ID":"316d8cce-bee4-4c46-a151-8e78842a0781","Type":"ContainerStarted","Data":"f64f3561b4925b6575ffd52eebe06261670e1f3292e61ade3721f0e4e83f2d33"} Jun 12 19:20:15.690781 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:15.690745 2554 generic.go:356] "Generic (PLEG): container finished" podID="316d8cce-bee4-4c46-a151-8e78842a0781" containerID="f64f3561b4925b6575ffd52eebe06261670e1f3292e61ade3721f0e4e83f2d33" exitCode=0 Jun 12 19:20:15.691173 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:15.690807 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" event={"ID":"316d8cce-bee4-4c46-a151-8e78842a0781","Type":"ContainerDied","Data":"f64f3561b4925b6575ffd52eebe06261670e1f3292e61ade3721f0e4e83f2d33"} Jun 12 19:20:16.696186 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:16.696142 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" event={"ID":"316d8cce-bee4-4c46-a151-8e78842a0781","Type":"ContainerStarted","Data":"2ea63c8fcfd2352c315303230c28f6c05fdcef5fb3c0230605005c69b78a8e21"} Jun 12 19:20:16.696690 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:16.696373 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:16.721492 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:16.721435 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" podStartSLOduration=2.699728947 podStartE2EDuration="6.721403874s" totalImagesPullingTime="2.9961007s" totalInitContainerRuntime="1.025574227s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:16.720375287 +0000 UTC m=+523.350441508" watchObservedRunningTime="2026-06-12 19:20:16.721403874 +0000 UTC m=+523.351470094" Jun 12 19:20:27.701231 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:27.701155 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc6d65868-gw4rz" Jun 12 19:20:32.965792 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.965759 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn"] Jun 12 19:20:32.971680 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.971659 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:32.974539 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.974520 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vgvw\" (UniqueName: \"kubernetes.io/projected/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-kube-api-access-8vgvw\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:32.974633 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.974561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-cert\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:32.974675 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.974638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-manager-config\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:32.974707 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.974678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-metrics-cert\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:32.975952 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.975931 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 19:20:32.976038 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.975933 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 19:20:32.976104 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.976049 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 19:20:32.976104 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.976069 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 19:20:32.976210 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.976156 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p96q2\"" Jun 12 19:20:32.976493 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.976477 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 19:20:32.982072 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:32.982051 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn"] Jun 12 19:20:33.075047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.075016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vgvw\" (UniqueName: \"kubernetes.io/projected/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-kube-api-access-8vgvw\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.075199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.075068 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-cert\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.075199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.075091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-manager-config\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.075199 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.075108 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-metrics-cert\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.075782 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.075756 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-manager-config\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.077651 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.077629 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-cert\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.077739 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.077631 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-metrics-cert\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.083747 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.083724 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vgvw\" (UniqueName: \"kubernetes.io/projected/6a7b082c-3a76-4c77-b72a-e0c38957e8d2-kube-api-access-8vgvw\") pod \"lws-controller-manager-7d7db986fb-vkcvn\" (UID: \"6a7b082c-3a76-4c77-b72a-e0c38957e8d2\") " pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.280456 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.280339 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:33.405975 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.405951 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn"] Jun 12 19:20:33.407495 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:20:33.407468 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7b082c_3a76_4c77_b72a_e0c38957e8d2.slice/crio-db60a3295e5030e04846dd10eff3067ea803352f4e490996ee6818255b626b69 WatchSource:0}: Error finding container db60a3295e5030e04846dd10eff3067ea803352f4e490996ee6818255b626b69: Status 404 returned error can't find the container with id db60a3295e5030e04846dd10eff3067ea803352f4e490996ee6818255b626b69 Jun 12 19:20:33.761310 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:33.761274 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" event={"ID":"6a7b082c-3a76-4c77-b72a-e0c38957e8d2","Type":"ContainerStarted","Data":"db60a3295e5030e04846dd10eff3067ea803352f4e490996ee6818255b626b69"} Jun 12 19:20:35.770245 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:35.770216 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" event={"ID":"6a7b082c-3a76-4c77-b72a-e0c38957e8d2","Type":"ContainerStarted","Data":"8d06cfd439ee79405149065fe9c9850e02e8a5cd71e743f70559035457c6ba3a"} Jun 12 19:20:35.770539 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:35.770299 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:35.792877 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:35.792833 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" podStartSLOduration=1.4964543049999999 podStartE2EDuration="3.792820079s" totalImagesPullingTime="2.296365774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:20:35.792547918 +0000 UTC m=+542.422614139" watchObservedRunningTime="2026-06-12 19:20:35.792820079 +0000 UTC m=+542.422886365" Jun 12 19:20:46.776201 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:46.776166 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d7db986fb-vkcvn" Jun 12 19:20:56.720186 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.720143 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99"] Jun 12 19:20:56.723319 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.723302 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.726269 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.726251 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 19:20:56.726269 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.726251 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kvtxf\"" Jun 12 19:20:56.726515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.726501 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 19:20:56.727543 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.727528 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 19:20:56.736047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.736021 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99"] Jun 12 19:20:56.767541 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767507 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767732 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767557 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767732 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767627 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767732 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767660 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5135d09a-4c18-4881-94ad-036ac29d035c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767732 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767689 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767732 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767708 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5135d09a-4c18-4881-94ad-036ac29d035c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767902 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5135d09a-4c18-4881-94ad-036ac29d035c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767902 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767798 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgt8\" (UniqueName: \"kubernetes.io/projected/5135d09a-4c18-4881-94ad-036ac29d035c-kube-api-access-5wgt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.767902 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.767828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.868938 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.868902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.868950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.868972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.868994 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5135d09a-4c18-4881-94ad-036ac29d035c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869020 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5135d09a-4c18-4881-94ad-036ac29d035c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869086 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5135d09a-4c18-4881-94ad-036ac29d035c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgt8\" (UniqueName: \"kubernetes.io/projected/5135d09a-4c18-4881-94ad-036ac29d035c-kube-api-access-5wgt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869503 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869765 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869655 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.869765 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.869746 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.870255 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.870228 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5135d09a-4c18-4881-94ad-036ac29d035c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.870439 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.870298 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.875620 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.870439 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.875746 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.872482 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5135d09a-4c18-4881-94ad-036ac29d035c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.875814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.872547 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5135d09a-4c18-4881-94ad-036ac29d035c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.879064 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.879040 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5135d09a-4c18-4881-94ad-036ac29d035c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:56.882266 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:56.882232 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgt8\" (UniqueName: \"kubernetes.io/projected/5135d09a-4c18-4881-94ad-036ac29d035c-kube-api-access-5wgt8\") pod \"data-science-gateway-data-science-gateway-class-74759f9795pfb99\" (UID: \"5135d09a-4c18-4881-94ad-036ac29d035c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:57.033110 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.033023 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:20:57.164249 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.164224 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99"] Jun 12 19:20:57.166990 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:20:57.166964 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5135d09a_4c18_4881_94ad_036ac29d035c.slice/crio-e7478cc1e7f177efd1f51d9fa573622917b44f889fcfac2cc75cbdfec94171f3 WatchSource:0}: Error finding container e7478cc1e7f177efd1f51d9fa573622917b44f889fcfac2cc75cbdfec94171f3: Status 404 returned error can't find the container with id e7478cc1e7f177efd1f51d9fa573622917b44f889fcfac2cc75cbdfec94171f3 Jun 12 19:20:57.266237 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.266203 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d9895d9db-78f45"] Jun 12 19:20:57.270626 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.270605 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.274593 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.274566 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 19:20:57.274728 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.274623 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vtzbt\"" Jun 12 19:20:57.278498 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.278472 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d9895d9db-78f45"] Jun 12 19:20:57.373874 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.373777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvs2\" (UniqueName: \"kubernetes.io/projected/16c67791-e148-41e7-9b5f-caa89518a290-kube-api-access-rsvs2\") pod \"dashboard-redirect-6d9895d9db-78f45\" (UID: \"16c67791-e148-41e7-9b5f-caa89518a290\") " pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.373874 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.373826 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/16c67791-e148-41e7-9b5f-caa89518a290-redirect-config\") pod \"dashboard-redirect-6d9895d9db-78f45\" (UID: \"16c67791-e148-41e7-9b5f-caa89518a290\") " pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.475255 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.475225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvs2\" (UniqueName: \"kubernetes.io/projected/16c67791-e148-41e7-9b5f-caa89518a290-kube-api-access-rsvs2\") pod \"dashboard-redirect-6d9895d9db-78f45\" (UID: \"16c67791-e148-41e7-9b5f-caa89518a290\") " pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.475444 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.475265 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/16c67791-e148-41e7-9b5f-caa89518a290-redirect-config\") pod \"dashboard-redirect-6d9895d9db-78f45\" (UID: \"16c67791-e148-41e7-9b5f-caa89518a290\") " pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.475977 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.475960 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/16c67791-e148-41e7-9b5f-caa89518a290-redirect-config\") pod \"dashboard-redirect-6d9895d9db-78f45\" (UID: \"16c67791-e148-41e7-9b5f-caa89518a290\") " pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.483638 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.483611 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvs2\" (UniqueName: \"kubernetes.io/projected/16c67791-e148-41e7-9b5f-caa89518a290-kube-api-access-rsvs2\") pod \"dashboard-redirect-6d9895d9db-78f45\" (UID: \"16c67791-e148-41e7-9b5f-caa89518a290\") " pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.584508 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.584477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" Jun 12 19:20:57.727078 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.727043 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d9895d9db-78f45"] Jun 12 19:20:57.731470 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:20:57.731437 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c67791_e148_41e7_9b5f_caa89518a290.slice/crio-040c50a6cd10a1bcfbc041d4f2ec2cd1310bbeed351c25f9b9702478fb980180 WatchSource:0}: Error finding container 040c50a6cd10a1bcfbc041d4f2ec2cd1310bbeed351c25f9b9702478fb980180: Status 404 returned error can't find the container with id 040c50a6cd10a1bcfbc041d4f2ec2cd1310bbeed351c25f9b9702478fb980180 Jun 12 19:20:57.854022 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.853987 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" event={"ID":"5135d09a-4c18-4881-94ad-036ac29d035c","Type":"ContainerStarted","Data":"e7478cc1e7f177efd1f51d9fa573622917b44f889fcfac2cc75cbdfec94171f3"} Jun 12 19:20:57.855543 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:20:57.855497 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" event={"ID":"16c67791-e148-41e7-9b5f-caa89518a290","Type":"ContainerStarted","Data":"040c50a6cd10a1bcfbc041d4f2ec2cd1310bbeed351c25f9b9702478fb980180"} Jun 12 19:21:00.368359 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.368316 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:21:00.368743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.368406 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:21:00.368743 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.368475 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:21:00.871335 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.871294 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" event={"ID":"16c67791-e148-41e7-9b5f-caa89518a290","Type":"ContainerStarted","Data":"86b4f986a38362401a5f19cf95ea74f19294d6bc99616c63904799ef8c499e98"} Jun 12 19:21:00.872876 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.872850 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" event={"ID":"5135d09a-4c18-4881-94ad-036ac29d035c","Type":"ContainerStarted","Data":"4aafa623ff6e76c95f3b75ddd68a7185540b03cf046159646ca1123fd3eaf471"} Jun 12 19:21:00.887697 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.887652 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d9895d9db-78f45" podStartSLOduration=1.201553631 podStartE2EDuration="3.887635081s" totalImagesPullingTime="2.68608145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:21:00.886965779 +0000 UTC m=+567.517032007" watchObservedRunningTime="2026-06-12 19:21:00.887635081 +0000 UTC m=+567.517701301" Jun 12 19:21:00.924565 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:00.924503 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" podStartSLOduration=1.725800348 podStartE2EDuration="4.924491398s" totalImagesPullingTime="3.19869105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:21:00.922994167 +0000 UTC m=+567.553060387" watchObservedRunningTime="2026-06-12 19:21:00.924491398 +0000 UTC m=+567.554557617" Jun 12 19:21:01.034137 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:01.034114 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:21:01.035440 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:01.035407 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-74759f9795pfb99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 12 19:21:01.035508 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:01.035463 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" podUID="5135d09a-4c18-4881-94ad-036ac29d035c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 12 19:21:02.037330 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:02.037305 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:21:02.881906 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:02.881869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:21:02.883149 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:02.883121 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795pfb99" Jun 12 19:21:31.104738 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.104705 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjsw6"] Jun 12 19:21:31.197419 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.197380 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjsw6"] Jun 12 19:21:31.197630 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.197511 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:31.200389 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.200361 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 19:21:31.200536 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.200495 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-m6p97\"" Jun 12 19:21:31.201699 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.201680 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 19:21:31.244541 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.244509 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vscr9\" (UniqueName: \"kubernetes.io/projected/bde6ab2e-30b8-453a-87fe-243bf7e255e1-kube-api-access-vscr9\") pod \"kuadrant-operator-catalog-qjsw6\" (UID: \"bde6ab2e-30b8-453a-87fe-243bf7e255e1\") " pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:31.345301 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.345262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vscr9\" (UniqueName: \"kubernetes.io/projected/bde6ab2e-30b8-453a-87fe-243bf7e255e1-kube-api-access-vscr9\") pod \"kuadrant-operator-catalog-qjsw6\" (UID: \"bde6ab2e-30b8-453a-87fe-243bf7e255e1\") " pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:31.358704 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.358641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vscr9\" (UniqueName: \"kubernetes.io/projected/bde6ab2e-30b8-453a-87fe-243bf7e255e1-kube-api-access-vscr9\") pod \"kuadrant-operator-catalog-qjsw6\" (UID: \"bde6ab2e-30b8-453a-87fe-243bf7e255e1\") " pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:31.468998 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.468962 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjsw6"] Jun 12 19:21:31.469243 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.469232 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:31.637321 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.637243 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjsw6"] Jun 12 19:21:31.641642 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:21:31.641614 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbde6ab2e_30b8_453a_87fe_243bf7e255e1.slice/crio-71ba7c21bd1c799c39920804ae9d02bbc6c4806b12da1615efb5fab46d92a653 WatchSource:0}: Error finding container 71ba7c21bd1c799c39920804ae9d02bbc6c4806b12da1615efb5fab46d92a653: Status 404 returned error can't find the container with id 71ba7c21bd1c799c39920804ae9d02bbc6c4806b12da1615efb5fab46d92a653 Jun 12 19:21:31.679469 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.679420 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8rvjr"] Jun 12 19:21:31.682534 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.682511 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:31.690599 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.690565 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8rvjr"] Jun 12 19:21:31.747418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.747372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q7d7\" (UniqueName: \"kubernetes.io/projected/f537c329-3857-401f-abae-451b69e9a25a-kube-api-access-7q7d7\") pod \"kuadrant-operator-catalog-8rvjr\" (UID: \"f537c329-3857-401f-abae-451b69e9a25a\") " pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:31.848541 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.848501 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q7d7\" (UniqueName: \"kubernetes.io/projected/f537c329-3857-401f-abae-451b69e9a25a-kube-api-access-7q7d7\") pod \"kuadrant-operator-catalog-8rvjr\" (UID: \"f537c329-3857-401f-abae-451b69e9a25a\") " pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:31.857359 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.857321 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q7d7\" (UniqueName: \"kubernetes.io/projected/f537c329-3857-401f-abae-451b69e9a25a-kube-api-access-7q7d7\") pod \"kuadrant-operator-catalog-8rvjr\" (UID: \"f537c329-3857-401f-abae-451b69e9a25a\") " pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:31.992614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.992571 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:31.999878 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:31.999843 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" event={"ID":"bde6ab2e-30b8-453a-87fe-243bf7e255e1","Type":"ContainerStarted","Data":"71ba7c21bd1c799c39920804ae9d02bbc6c4806b12da1615efb5fab46d92a653"} Jun 12 19:21:32.131505 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:32.131439 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8rvjr"] Jun 12 19:21:32.134955 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:21:32.134927 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf537c329_3857_401f_abae_451b69e9a25a.slice/crio-2d10dd632a4ff77d1ab27f6d5ed0fd70f67ed7f1f6655cb485a5a1e41cf879fb WatchSource:0}: Error finding container 2d10dd632a4ff77d1ab27f6d5ed0fd70f67ed7f1f6655cb485a5a1e41cf879fb: Status 404 returned error can't find the container with id 2d10dd632a4ff77d1ab27f6d5ed0fd70f67ed7f1f6655cb485a5a1e41cf879fb Jun 12 19:21:33.007536 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:33.007495 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" event={"ID":"f537c329-3857-401f-abae-451b69e9a25a","Type":"ContainerStarted","Data":"2d10dd632a4ff77d1ab27f6d5ed0fd70f67ed7f1f6655cb485a5a1e41cf879fb"} Jun 12 19:21:33.801975 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:33.801941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:21:33.804812 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:33.804792 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:21:34.013658 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.013624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" event={"ID":"bde6ab2e-30b8-453a-87fe-243bf7e255e1","Type":"ContainerStarted","Data":"36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20"} Jun 12 19:21:34.013857 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.013667 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" podUID="bde6ab2e-30b8-453a-87fe-243bf7e255e1" containerName="registry-server" containerID="cri-o://36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20" gracePeriod=2 Jun 12 19:21:34.015101 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.015082 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" event={"ID":"f537c329-3857-401f-abae-451b69e9a25a","Type":"ContainerStarted","Data":"9f8331b625462805ef487a5d6bad16c92bc16255b2e5b9cbcdcbb734e7793188"} Jun 12 19:21:34.031233 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.031136 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" podStartSLOduration=1.068137618 podStartE2EDuration="3.031119506s" totalImagesPullingTime="1.962981888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:21:34.03065058 +0000 UTC m=+600.660716802" watchObservedRunningTime="2026-06-12 19:21:34.031119506 +0000 UTC m=+600.661185727" Jun 12 19:21:34.065240 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.065186 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" podStartSLOduration=1.592396719 podStartE2EDuration="3.065172355s" totalImagesPullingTime="1.472775636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:21:34.063015906 +0000 UTC m=+600.693082149" watchObservedRunningTime="2026-06-12 19:21:34.065172355 +0000 UTC m=+600.695238594" Jun 12 19:21:34.257987 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.257960 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:34.266684 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.266636 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vscr9\" (UniqueName: \"kubernetes.io/projected/bde6ab2e-30b8-453a-87fe-243bf7e255e1-kube-api-access-vscr9\") pod \"bde6ab2e-30b8-453a-87fe-243bf7e255e1\" (UID: \"bde6ab2e-30b8-453a-87fe-243bf7e255e1\") " Jun 12 19:21:34.268752 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.268721 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde6ab2e-30b8-453a-87fe-243bf7e255e1-kube-api-access-vscr9" (OuterVolumeSpecName: "kube-api-access-vscr9") pod "bde6ab2e-30b8-453a-87fe-243bf7e255e1" (UID: "bde6ab2e-30b8-453a-87fe-243bf7e255e1"). InnerVolumeSpecName "kube-api-access-vscr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:21:34.367802 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:34.367766 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vscr9\" (UniqueName: \"kubernetes.io/projected/bde6ab2e-30b8-453a-87fe-243bf7e255e1-kube-api-access-vscr9\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:21:35.020647 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.020613 2554 generic.go:356] "Generic (PLEG): container finished" podID="bde6ab2e-30b8-453a-87fe-243bf7e255e1" containerID="36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20" exitCode=0 Jun 12 19:21:35.021124 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.020658 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" Jun 12 19:21:35.021124 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.020704 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" event={"ID":"bde6ab2e-30b8-453a-87fe-243bf7e255e1","Type":"ContainerDied","Data":"36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20"} Jun 12 19:21:35.021124 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.020764 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjsw6" event={"ID":"bde6ab2e-30b8-453a-87fe-243bf7e255e1","Type":"ContainerDied","Data":"71ba7c21bd1c799c39920804ae9d02bbc6c4806b12da1615efb5fab46d92a653"} Jun 12 19:21:35.021124 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.020797 2554 scope.go:117] "RemoveContainer" containerID="36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20" Jun 12 19:21:35.029859 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.029842 2554 scope.go:117] "RemoveContainer" containerID="36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20" Jun 12 19:21:35.030169 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:21:35.030148 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20\": container with ID starting with 36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20 not found: ID does not exist" containerID="36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20" Jun 12 19:21:35.030249 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.030177 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20"} err="failed to get container status \"36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20\": rpc error: code = NotFound desc = could not find container \"36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20\": container with ID starting with 36bf608d4b6298d5f09d5a6f286cf73fd8338e44fbf8949ecfa33c2f261f8b20 not found: ID does not exist" Jun 12 19:21:35.044569 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.044537 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjsw6"] Jun 12 19:21:35.046459 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.046408 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjsw6"] Jun 12 19:21:35.815571 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:35.815531 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bde6ab2e-30b8-453a-87fe-243bf7e255e1" path="/var/lib/kubelet/pods/bde6ab2e-30b8-453a-87fe-243bf7e255e1/volumes" Jun 12 19:21:41.992842 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:41.992791 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:41.993238 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:41.992870 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:42.014525 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:42.014497 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:21:42.076517 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:21:42.076489 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8rvjr" Jun 12 19:22:03.738542 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.738460 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb"] Jun 12 19:22:03.738986 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.738787 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bde6ab2e-30b8-453a-87fe-243bf7e255e1" containerName="registry-server" Jun 12 19:22:03.738986 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.738797 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bde6ab2e-30b8-453a-87fe-243bf7e255e1" containerName="registry-server" Jun 12 19:22:03.738986 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.738843 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bde6ab2e-30b8-453a-87fe-243bf7e255e1" containerName="registry-server" Jun 12 19:22:03.745320 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.745290 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:03.748068 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.748048 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dq444\"" Jun 12 19:22:03.752355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.752324 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb"] Jun 12 19:22:03.770006 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.769977 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvtk\" (UniqueName: \"kubernetes.io/projected/b7a0fb58-b176-4d68-a419-934deb9a9046-kube-api-access-nsvtk\") pod \"authorino-operator-75cc8d5cb7-6wcgb\" (UID: \"b7a0fb58-b176-4d68-a419-934deb9a9046\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:03.871368 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.871328 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvtk\" (UniqueName: \"kubernetes.io/projected/b7a0fb58-b176-4d68-a419-934deb9a9046-kube-api-access-nsvtk\") pod \"authorino-operator-75cc8d5cb7-6wcgb\" (UID: \"b7a0fb58-b176-4d68-a419-934deb9a9046\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:03.886161 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:03.886129 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvtk\" (UniqueName: \"kubernetes.io/projected/b7a0fb58-b176-4d68-a419-934deb9a9046-kube-api-access-nsvtk\") pod \"authorino-operator-75cc8d5cb7-6wcgb\" (UID: \"b7a0fb58-b176-4d68-a419-934deb9a9046\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:04.056070 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:04.055975 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:04.205915 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:04.205891 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb"] Jun 12 19:22:04.208164 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:04.208135 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a0fb58_b176_4d68_a419_934deb9a9046.slice/crio-d59ada72d7a3fd8846f6007e6c33d1980acbde6d60d42f6fa7281a12370a5239 WatchSource:0}: Error finding container d59ada72d7a3fd8846f6007e6c33d1980acbde6d60d42f6fa7281a12370a5239: Status 404 returned error can't find the container with id d59ada72d7a3fd8846f6007e6c33d1980acbde6d60d42f6fa7281a12370a5239 Jun 12 19:22:05.160780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:05.160740 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" event={"ID":"b7a0fb58-b176-4d68-a419-934deb9a9046","Type":"ContainerStarted","Data":"d59ada72d7a3fd8846f6007e6c33d1980acbde6d60d42f6fa7281a12370a5239"} Jun 12 19:22:06.538392 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.538299 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt"] Jun 12 19:22:06.542023 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.542001 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:06.544763 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.544738 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 19:22:06.544862 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.544764 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2t4ll\"" Jun 12 19:22:06.552504 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.552479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt"] Jun 12 19:22:06.598143 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.598106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtnq\" (UniqueName: \"kubernetes.io/projected/149361ab-0f52-497d-8361-d434f2dcaa84-kube-api-access-xwtnq\") pod \"dns-operator-controller-manager-864dd78c4c-dd7xt\" (UID: \"149361ab-0f52-497d-8361-d434f2dcaa84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:06.698761 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.698721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtnq\" (UniqueName: \"kubernetes.io/projected/149361ab-0f52-497d-8361-d434f2dcaa84-kube-api-access-xwtnq\") pod \"dns-operator-controller-manager-864dd78c4c-dd7xt\" (UID: \"149361ab-0f52-497d-8361-d434f2dcaa84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:06.711367 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.711337 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtnq\" (UniqueName: \"kubernetes.io/projected/149361ab-0f52-497d-8361-d434f2dcaa84-kube-api-access-xwtnq\") pod \"dns-operator-controller-manager-864dd78c4c-dd7xt\" (UID: \"149361ab-0f52-497d-8361-d434f2dcaa84\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:06.853138 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.853052 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:06.989543 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:06.989511 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt"] Jun 12 19:22:06.993127 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:06.993103 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149361ab_0f52_497d_8361_d434f2dcaa84.slice/crio-183538ce4f5b7bd555535cc0325f2640412c4038f08a3c0ad686bd0650e41089 WatchSource:0}: Error finding container 183538ce4f5b7bd555535cc0325f2640412c4038f08a3c0ad686bd0650e41089: Status 404 returned error can't find the container with id 183538ce4f5b7bd555535cc0325f2640412c4038f08a3c0ad686bd0650e41089 Jun 12 19:22:07.176610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:07.176566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" event={"ID":"b7a0fb58-b176-4d68-a419-934deb9a9046","Type":"ContainerStarted","Data":"72f7e77229f77b5c32223e1b62fc89afc6d3afd575a7a7827b7e3768f17396f1"} Jun 12 19:22:07.176815 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:07.176752 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:07.177851 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:07.177830 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" event={"ID":"149361ab-0f52-497d-8361-d434f2dcaa84","Type":"ContainerStarted","Data":"183538ce4f5b7bd555535cc0325f2640412c4038f08a3c0ad686bd0650e41089"} Jun 12 19:22:07.201585 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:07.201529 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" podStartSLOduration=2.136805859 podStartE2EDuration="4.2015138s" totalImagesPullingTime="2.064707941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:07.20071382 +0000 UTC m=+633.830780040" watchObservedRunningTime="2026-06-12 19:22:07.2015138 +0000 UTC m=+633.831580019" Jun 12 19:22:09.190239 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:09.190202 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" event={"ID":"149361ab-0f52-497d-8361-d434f2dcaa84","Type":"ContainerStarted","Data":"233180e9e225510203dc5ff4800e1f3a6ea24125debcbcd9634c6fcd1eedf9a2"} Jun 12 19:22:09.190705 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:09.190270 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:10.487783 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.487726 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" podStartSLOduration=2.52854038 podStartE2EDuration="4.487706573s" totalImagesPullingTime="1.959166193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:09.223458036 +0000 UTC m=+635.853524257" watchObservedRunningTime="2026-06-12 19:22:10.487706573 +0000 UTC m=+637.117772793" Jun 12 19:22:10.488214 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.488200 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc"] Jun 12 19:22:10.491554 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.491538 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.494688 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.494666 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jr5gt\"" Jun 12 19:22:10.505928 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.505903 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc"] Jun 12 19:22:10.534084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.534056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl99p\" (UniqueName: \"kubernetes.io/projected/cd87ab72-0883-4674-a63a-b511c6c4e3a6-kube-api-access-tl99p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.534270 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.534131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd87ab72-0883-4674-a63a-b511c6c4e3a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.634962 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.634920 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl99p\" (UniqueName: \"kubernetes.io/projected/cd87ab72-0883-4674-a63a-b511c6c4e3a6-kube-api-access-tl99p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.635159 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.635036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd87ab72-0883-4674-a63a-b511c6c4e3a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.635417 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.635394 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd87ab72-0883-4674-a63a-b511c6c4e3a6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.646728 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.646704 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl99p\" (UniqueName: \"kubernetes.io/projected/cd87ab72-0883-4674-a63a-b511c6c4e3a6-kube-api-access-tl99p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.801691 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.801599 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:10.934402 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:10.934375 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc"] Jun 12 19:22:10.936988 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:10.936958 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd87ab72_0883_4674_a63a_b511c6c4e3a6.slice/crio-3d2d622fd57b07dbe9cf0d7dcec07e187a1572444cc16a754db6c0ab193dbcd0 WatchSource:0}: Error finding container 3d2d622fd57b07dbe9cf0d7dcec07e187a1572444cc16a754db6c0ab193dbcd0: Status 404 returned error can't find the container with id 3d2d622fd57b07dbe9cf0d7dcec07e187a1572444cc16a754db6c0ab193dbcd0 Jun 12 19:22:11.200149 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:11.200105 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" event={"ID":"cd87ab72-0883-4674-a63a-b511c6c4e3a6","Type":"ContainerStarted","Data":"3d2d622fd57b07dbe9cf0d7dcec07e187a1572444cc16a754db6c0ab193dbcd0"} Jun 12 19:22:18.186308 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:18.186281 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6wcgb" Jun 12 19:22:18.232412 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:18.232377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" event={"ID":"cd87ab72-0883-4674-a63a-b511c6c4e3a6","Type":"ContainerStarted","Data":"24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744"} Jun 12 19:22:18.232604 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:18.232524 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:18.260494 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:18.260446 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" podStartSLOduration=1.445021422 podStartE2EDuration="8.260413936s" totalImagesPullingTime="6.815392514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:18.259991589 +0000 UTC m=+644.890057809" watchObservedRunningTime="2026-06-12 19:22:18.260413936 +0000 UTC m=+644.890480155" Jun 12 19:22:20.197355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:20.197321 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dd7xt" Jun 12 19:22:21.358998 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.358960 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d6b89c964-gfhlq"] Jun 12 19:22:21.362554 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.362537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.365331 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.365305 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 19:22:21.365466 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.365345 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 19:22:21.365466 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.365344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 19:22:21.366723 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.366704 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 19:22:21.366839 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.366816 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 19:22:21.366839 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.366819 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hjc2q\"" Jun 12 19:22:21.366973 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.366949 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 19:22:21.367012 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.366950 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 19:22:21.372299 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.372281 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 19:22:21.375278 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.375260 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6b89c964-gfhlq"] Jun 12 19:22:21.433030 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433000 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-oauth-serving-cert\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.433193 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49ff8322-abb4-44ad-a075-fdd793adb412-console-oauth-config\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.433193 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433081 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9q4w\" (UniqueName: \"kubernetes.io/projected/49ff8322-abb4-44ad-a075-fdd793adb412-kube-api-access-s9q4w\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.433193 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49ff8322-abb4-44ad-a075-fdd793adb412-console-serving-cert\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.433193 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433142 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-console-config\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.433338 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433199 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-service-ca\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.433338 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.433232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-trusted-ca-bundle\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534095 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49ff8322-abb4-44ad-a075-fdd793adb412-console-oauth-config\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9q4w\" (UniqueName: \"kubernetes.io/projected/49ff8322-abb4-44ad-a075-fdd793adb412-kube-api-access-s9q4w\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534471 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534177 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49ff8322-abb4-44ad-a075-fdd793adb412-console-serving-cert\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534471 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534208 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-console-config\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534471 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-service-ca\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534471 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-trusted-ca-bundle\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.534471 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.534461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-oauth-serving-cert\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.535065 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.535040 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-console-config\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.535177 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.535087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-service-ca\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.535177 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.535159 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-oauth-serving-cert\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.535499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.535478 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49ff8322-abb4-44ad-a075-fdd793adb412-trusted-ca-bundle\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.536848 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.536823 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49ff8322-abb4-44ad-a075-fdd793adb412-console-serving-cert\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.536949 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.536936 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49ff8322-abb4-44ad-a075-fdd793adb412-console-oauth-config\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.542861 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.542839 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9q4w\" (UniqueName: \"kubernetes.io/projected/49ff8322-abb4-44ad-a075-fdd793adb412-kube-api-access-s9q4w\") pod \"console-5d6b89c964-gfhlq\" (UID: \"49ff8322-abb4-44ad-a075-fdd793adb412\") " pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.673113 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.673075 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:21.805225 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:21.805126 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d6b89c964-gfhlq"] Jun 12 19:22:21.808177 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:21.808151 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ff8322_abb4_44ad_a075_fdd793adb412.slice/crio-baf082404b02c2e2fc653c7f873b01e232fe5db126a3349822bd7aac3f4131d8 WatchSource:0}: Error finding container baf082404b02c2e2fc653c7f873b01e232fe5db126a3349822bd7aac3f4131d8: Status 404 returned error can't find the container with id baf082404b02c2e2fc653c7f873b01e232fe5db126a3349822bd7aac3f4131d8 Jun 12 19:22:22.252327 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:22.252296 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6b89c964-gfhlq" event={"ID":"49ff8322-abb4-44ad-a075-fdd793adb412","Type":"ContainerStarted","Data":"7b87a0b9a81500d9f638372683f8a6cb3323467eff0b77cc656bfe40daa5f337"} Jun 12 19:22:22.252521 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:22.252342 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d6b89c964-gfhlq" event={"ID":"49ff8322-abb4-44ad-a075-fdd793adb412","Type":"ContainerStarted","Data":"baf082404b02c2e2fc653c7f873b01e232fe5db126a3349822bd7aac3f4131d8"} Jun 12 19:22:22.289593 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:22.289547 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d6b89c964-gfhlq" podStartSLOduration=1.2895303710000001 podStartE2EDuration="1.289530371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:22.289480823 +0000 UTC m=+648.919547039" watchObservedRunningTime="2026-06-12 19:22:22.289530371 +0000 UTC m=+648.919596591" Jun 12 19:22:29.238941 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:29.238902 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:30.565884 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.565848 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg"] Jun 12 19:22:30.569047 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.569032 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.594629 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.594605 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg"] Jun 12 19:22:30.709707 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.709669 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzhrz\" (UniqueName: \"kubernetes.io/projected/ad944827-e571-4097-9559-fce8b8e638ac-kube-api-access-kzhrz\") pod \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.709872 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.709729 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad944827-e571-4097-9559-fce8b8e638ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.811206 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.811169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhrz\" (UniqueName: \"kubernetes.io/projected/ad944827-e571-4097-9559-fce8b8e638ac-kube-api-access-kzhrz\") pod \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.811390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.811238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad944827-e571-4097-9559-fce8b8e638ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.811662 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.811641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad944827-e571-4097-9559-fce8b8e638ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.822598 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.822542 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzhrz\" (UniqueName: \"kubernetes.io/projected/ad944827-e571-4097-9559-fce8b8e638ac-kube-api-access-kzhrz\") pod \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:30.879559 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:30.879532 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.002051 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.002005 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg"] Jun 12 19:22:31.005219 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.005194 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg"] Jun 12 19:22:31.015883 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.015857 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc"] Jun 12 19:22:31.016068 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.016043 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" containerName="manager" containerID="cri-o://24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744" gracePeriod=2 Jun 12 19:22:31.022533 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.022506 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc"] Jun 12 19:22:31.030976 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.030941 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts"] Jun 12 19:22:31.031543 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.031438 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" containerName="manager" Jun 12 19:22:31.031543 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.031461 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" containerName="manager" Jun 12 19:22:31.031708 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.031573 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" containerName="manager" Jun 12 19:22:31.034671 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.034651 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.054763 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.054726 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4"] Jun 12 19:22:31.058390 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.058356 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts"] Jun 12 19:22:31.058508 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.058477 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.074809 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.074739 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4"] Jun 12 19:22:31.084233 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.084196 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.087190 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.087158 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.114777 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.114749 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e937d225-b171-42e7-89ca-378c9e53c3da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-chlts\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.114932 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.114794 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-486kn\" (UniqueName: \"kubernetes.io/projected/e937d225-b171-42e7-89ca-378c9e53c3da-kube-api-access-486kn\") pod \"kuadrant-operator-controller-manager-55467d9f7-chlts\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.133911 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.133882 2554 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 12 19:22:31.133911 ip-10-0-136-61 kubenswrapper[2554]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-8hzgg_kuadrant-system_ad944827-e571-4097-9559-fce8b8e638ac_0(3b87603fd27403627caba06d8a7ab657d4366497998c1628792ee539d75b521a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-8hzgg to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3b87603fd27403627caba06d8a7ab657d4366497998c1628792ee539d75b521a" Netns:"/var/run/netns/cc64506f-2a43-4e4d-af77-bceb8ff2447d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-8hzgg;K8S_POD_INFRA_CONTAINER_ID=3b87603fd27403627caba06d8a7ab657d4366497998c1628792ee539d75b521a;K8S_POD_UID=ad944827-e571-4097-9559-fce8b8e638ac" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg/ad944827-e571-4097-9559-fce8b8e638ac]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-8hzgg in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-8hzgg in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg: pods "kuadrant-operator-controller-manager-55467d9f7-8hzgg" not found Jun 12 19:22:31.133911 ip-10-0-136-61 kubenswrapper[2554]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 12 19:22:31.133911 ip-10-0-136-61 kubenswrapper[2554]: > Jun 12 19:22:31.134074 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.133938 2554 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 12 19:22:31.134074 ip-10-0-136-61 kubenswrapper[2554]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-8hzgg_kuadrant-system_ad944827-e571-4097-9559-fce8b8e638ac_0(3b87603fd27403627caba06d8a7ab657d4366497998c1628792ee539d75b521a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-8hzgg to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3b87603fd27403627caba06d8a7ab657d4366497998c1628792ee539d75b521a" Netns:"/var/run/netns/cc64506f-2a43-4e4d-af77-bceb8ff2447d" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-8hzgg;K8S_POD_INFRA_CONTAINER_ID=3b87603fd27403627caba06d8a7ab657d4366497998c1628792ee539d75b521a;K8S_POD_UID=ad944827-e571-4097-9559-fce8b8e638ac" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg/ad944827-e571-4097-9559-fce8b8e638ac]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-8hzgg in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-8hzgg in out of cluster comm: status update failed for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg: pods "kuadrant-operator-controller-manager-55467d9f7-8hzgg" not found Jun 12 19:22:31.134074 ip-10-0-136-61 kubenswrapper[2554]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 12 19:22:31.134074 ip-10-0-136-61 kubenswrapper[2554]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.215948 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.215917 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hx78\" (UniqueName: \"kubernetes.io/projected/e9b4c446-bce3-49ce-a85f-3833f361ad89-kube-api-access-5hx78\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rb8q4\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.216105 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.215964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b4c446-bce3-49ce-a85f-3833f361ad89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rb8q4\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.216105 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.216060 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e937d225-b171-42e7-89ca-378c9e53c3da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-chlts\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.216223 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.216105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-486kn\" (UniqueName: \"kubernetes.io/projected/e937d225-b171-42e7-89ca-378c9e53c3da-kube-api-access-486kn\") pod \"kuadrant-operator-controller-manager-55467d9f7-chlts\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.216541 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.216517 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e937d225-b171-42e7-89ca-378c9e53c3da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-chlts\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.229658 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.229635 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-486kn\" (UniqueName: \"kubernetes.io/projected/e937d225-b171-42e7-89ca-378c9e53c3da-kube-api-access-486kn\") pod \"kuadrant-operator-controller-manager-55467d9f7-chlts\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.246853 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.246833 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.249343 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.249322 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.296078 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.296044 2554 generic.go:356] "Generic (PLEG): container finished" podID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" containerID="24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744" exitCode=0 Jun 12 19:22:31.296217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.296092 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.296217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.296138 2554 scope.go:117] "RemoveContainer" containerID="24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744" Jun 12 19:22:31.296217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.296203 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.298755 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.298726 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.301129 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.301101 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="ad944827-e571-4097-9559-fce8b8e638ac" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.302818 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.302798 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.303396 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.303378 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.304203 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.304191 2554 scope.go:117] "RemoveContainer" containerID="24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744" Jun 12 19:22:31.304412 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.304394 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744\": container with ID starting with 24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744 not found: ID does not exist" containerID="24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744" Jun 12 19:22:31.304526 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.304500 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744"} err="failed to get container status \"24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744\": rpc error: code = NotFound desc = could not find container \"24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744\": container with ID starting with 24e7e924d46951932209ce15e51205ab0cde27c431025e700cd77205ec15f744 not found: ID does not exist" Jun 12 19:22:31.305544 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.305524 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="ad944827-e571-4097-9559-fce8b8e638ac" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.307656 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.307634 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.316964 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.316930 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl99p\" (UniqueName: \"kubernetes.io/projected/cd87ab72-0883-4674-a63a-b511c6c4e3a6-kube-api-access-tl99p\") pod \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " Jun 12 19:22:31.317053 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.316976 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd87ab72-0883-4674-a63a-b511c6c4e3a6-extensions-socket-volume\") pod \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\" (UID: \"cd87ab72-0883-4674-a63a-b511c6c4e3a6\") " Jun 12 19:22:31.317094 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.317061 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b4c446-bce3-49ce-a85f-3833f361ad89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rb8q4\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.317165 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.317133 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hx78\" (UniqueName: \"kubernetes.io/projected/e9b4c446-bce3-49ce-a85f-3833f361ad89-kube-api-access-5hx78\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rb8q4\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.317537 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.317516 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd87ab72-0883-4674-a63a-b511c6c4e3a6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd87ab72-0883-4674-a63a-b511c6c4e3a6" (UID: "cd87ab72-0883-4674-a63a-b511c6c4e3a6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:22:31.317622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.317525 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b4c446-bce3-49ce-a85f-3833f361ad89-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rb8q4\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.318830 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.318810 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd87ab72-0883-4674-a63a-b511c6c4e3a6-kube-api-access-tl99p" (OuterVolumeSpecName: "kube-api-access-tl99p") pod "cd87ab72-0883-4674-a63a-b511c6c4e3a6" (UID: "cd87ab72-0883-4674-a63a-b511c6c4e3a6"). InnerVolumeSpecName "kube-api-access-tl99p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:22:31.327025 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.326974 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hx78\" (UniqueName: \"kubernetes.io/projected/e9b4c446-bce3-49ce-a85f-3833f361ad89-kube-api-access-5hx78\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rb8q4\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.392638 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.392605 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:31.400191 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.400171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:31.418169 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.418144 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad944827-e571-4097-9559-fce8b8e638ac-extensions-socket-volume\") pod \"ad944827-e571-4097-9559-fce8b8e638ac\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " Jun 12 19:22:31.418291 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.418203 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzhrz\" (UniqueName: \"kubernetes.io/projected/ad944827-e571-4097-9559-fce8b8e638ac-kube-api-access-kzhrz\") pod \"ad944827-e571-4097-9559-fce8b8e638ac\" (UID: \"ad944827-e571-4097-9559-fce8b8e638ac\") " Jun 12 19:22:31.418413 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.418386 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad944827-e571-4097-9559-fce8b8e638ac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ad944827-e571-4097-9559-fce8b8e638ac" (UID: "ad944827-e571-4097-9559-fce8b8e638ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:22:31.418507 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.418469 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl99p\" (UniqueName: \"kubernetes.io/projected/cd87ab72-0883-4674-a63a-b511c6c4e3a6-kube-api-access-tl99p\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:31.418507 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.418491 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd87ab72-0883-4674-a63a-b511c6c4e3a6-extensions-socket-volume\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:31.420245 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.420217 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad944827-e571-4097-9559-fce8b8e638ac-kube-api-access-kzhrz" (OuterVolumeSpecName: "kube-api-access-kzhrz") pod "ad944827-e571-4097-9559-fce8b8e638ac" (UID: "ad944827-e571-4097-9559-fce8b8e638ac"). InnerVolumeSpecName "kube-api-access-kzhrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:22:31.523318 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.521937 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzhrz\" (UniqueName: \"kubernetes.io/projected/ad944827-e571-4097-9559-fce8b8e638ac-kube-api-access-kzhrz\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:31.523318 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.521988 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad944827-e571-4097-9559-fce8b8e638ac-extensions-socket-volume\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:31.607242 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.607213 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="ad944827-e571-4097-9559-fce8b8e638ac" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.609980 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.609956 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.617375 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.617344 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4"] Jun 12 19:22:31.620946 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:31.620924 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b4c446_bce3_49ce_a85f_3833f361ad89.slice/crio-171bde112b2b1bfeb9cfafe2610295601762f3e1d3b8e23dd644f31e2d7be621 WatchSource:0}: Error finding container 171bde112b2b1bfeb9cfafe2610295601762f3e1d3b8e23dd644f31e2d7be621: Status 404 returned error can't find the container with id 171bde112b2b1bfeb9cfafe2610295601762f3e1d3b8e23dd644f31e2d7be621 Jun 12 19:22:31.630028 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.630010 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts"] Jun 12 19:22:31.633012 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:31.632992 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode937d225_b171_42e7_89ca_378c9e53c3da.slice/crio-e9eb3824fc145895c91097f03e1991f5aeb9e30e91c3989723c05af901df5097 WatchSource:0}: Error finding container e9eb3824fc145895c91097f03e1991f5aeb9e30e91c3989723c05af901df5097: Status 404 returned error can't find the container with id e9eb3824fc145895c91097f03e1991f5aeb9e30e91c3989723c05af901df5097 Jun 12 19:22:31.673302 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.673282 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:31.673412 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.673333 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:31.678679 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.678660 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:31.715542 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.715502 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="ad944827-e571-4097-9559-fce8b8e638ac" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:31.717922 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:31.717884 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bp6bc\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bp6bc" Jun 12 19:22:31.817257 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.817213 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad944827-e571-4097-9559-fce8b8e638ac" path="/var/lib/kubelet/pods/ad944827-e571-4097-9559-fce8b8e638ac/volumes" Jun 12 19:22:31.817596 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:31.817578 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd87ab72-0883-4674-a63a-b511c6c4e3a6" path="/var/lib/kubelet/pods/cd87ab72-0883-4674-a63a-b511c6c4e3a6/volumes" Jun 12 19:22:32.302826 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.302789 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" event={"ID":"e937d225-b171-42e7-89ca-378c9e53c3da","Type":"ContainerStarted","Data":"14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a"} Jun 12 19:22:32.303028 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.302841 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" event={"ID":"e937d225-b171-42e7-89ca-378c9e53c3da","Type":"ContainerStarted","Data":"e9eb3824fc145895c91097f03e1991f5aeb9e30e91c3989723c05af901df5097"} Jun 12 19:22:32.303028 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.302896 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:32.304505 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.304470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" event={"ID":"e9b4c446-bce3-49ce-a85f-3833f361ad89","Type":"ContainerStarted","Data":"d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff"} Jun 12 19:22:32.304505 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.304503 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:32.304686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.304527 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:32.304686 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.304549 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" event={"ID":"e9b4c446-bce3-49ce-a85f-3833f361ad89","Type":"ContainerStarted","Data":"171bde112b2b1bfeb9cfafe2610295601762f3e1d3b8e23dd644f31e2d7be621"} Jun 12 19:22:32.312038 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.312012 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d6b89c964-gfhlq" Jun 12 19:22:32.326098 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.326053 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" podStartSLOduration=1.326037935 podStartE2EDuration="1.326037935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:32.323394689 +0000 UTC m=+658.953460922" watchObservedRunningTime="2026-06-12 19:22:32.326037935 +0000 UTC m=+658.956104156" Jun 12 19:22:32.345612 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:32.345576 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="ad944827-e571-4097-9559-fce8b8e638ac" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:32.371666 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:32.371617 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" podStartSLOduration=1.371600481 podStartE2EDuration="1.371600481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:32.370959213 +0000 UTC m=+659.001025434" watchObservedRunningTime="2026-06-12 19:22:32.371600481 +0000 UTC m=+659.001666701" Jun 12 19:22:33.815658 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:33.815625 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-8hzgg\" is forbidden: User \"system:node:ip-10-0-136-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-61.ec2.internal' and this object" podUID="ad944827-e571-4097-9559-fce8b8e638ac" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8hzgg" Jun 12 19:22:43.311684 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.311651 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:43.312120 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.311722 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:43.378008 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.377978 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4"] Jun 12 19:22:43.378179 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.378157 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" podUID="e9b4c446-bce3-49ce-a85f-3833f361ad89" containerName="manager" containerID="cri-o://d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff" gracePeriod=10 Jun 12 19:22:43.626141 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.626117 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:43.719881 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.719849 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hx78\" (UniqueName: \"kubernetes.io/projected/e9b4c446-bce3-49ce-a85f-3833f361ad89-kube-api-access-5hx78\") pod \"e9b4c446-bce3-49ce-a85f-3833f361ad89\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " Jun 12 19:22:43.720001 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.719967 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b4c446-bce3-49ce-a85f-3833f361ad89-extensions-socket-volume\") pod \"e9b4c446-bce3-49ce-a85f-3833f361ad89\" (UID: \"e9b4c446-bce3-49ce-a85f-3833f361ad89\") " Jun 12 19:22:43.720330 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.720303 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b4c446-bce3-49ce-a85f-3833f361ad89-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9b4c446-bce3-49ce-a85f-3833f361ad89" (UID: "e9b4c446-bce3-49ce-a85f-3833f361ad89"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:22:43.721864 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.721844 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b4c446-bce3-49ce-a85f-3833f361ad89-kube-api-access-5hx78" (OuterVolumeSpecName: "kube-api-access-5hx78") pod "e9b4c446-bce3-49ce-a85f-3833f361ad89" (UID: "e9b4c446-bce3-49ce-a85f-3833f361ad89"). InnerVolumeSpecName "kube-api-access-5hx78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:22:43.816029 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.816003 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q"] Jun 12 19:22:43.816532 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.816515 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b4c446-bce3-49ce-a85f-3833f361ad89" containerName="manager" Jun 12 19:22:43.816584 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.816537 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b4c446-bce3-49ce-a85f-3833f361ad89" containerName="manager" Jun 12 19:22:43.816643 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.816632 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b4c446-bce3-49ce-a85f-3833f361ad89" containerName="manager" Jun 12 19:22:43.820083 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.820064 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:43.820446 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.820415 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9b4c446-bce3-49ce-a85f-3833f361ad89-extensions-socket-volume\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:43.820497 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.820450 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hx78\" (UniqueName: \"kubernetes.io/projected/e9b4c446-bce3-49ce-a85f-3833f361ad89-kube-api-access-5hx78\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:43.838464 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.838440 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q"] Jun 12 19:22:43.921480 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.921451 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9989a-dfc3-4d45-adc5-a7126c1e8980-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zg5q\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:43.921641 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:43.921538 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l9hw\" (UniqueName: \"kubernetes.io/projected/cab9989a-dfc3-4d45-adc5-a7126c1e8980-kube-api-access-7l9hw\") pod \"kuadrant-operator-controller-manager-86878c769f-9zg5q\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.022766 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.022721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9989a-dfc3-4d45-adc5-a7126c1e8980-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zg5q\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.022942 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.022777 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l9hw\" (UniqueName: \"kubernetes.io/projected/cab9989a-dfc3-4d45-adc5-a7126c1e8980-kube-api-access-7l9hw\") pod \"kuadrant-operator-controller-manager-86878c769f-9zg5q\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.023145 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.023124 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9989a-dfc3-4d45-adc5-a7126c1e8980-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zg5q\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.033216 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.033191 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l9hw\" (UniqueName: \"kubernetes.io/projected/cab9989a-dfc3-4d45-adc5-a7126c1e8980-kube-api-access-7l9hw\") pod \"kuadrant-operator-controller-manager-86878c769f-9zg5q\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.130804 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.130766 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.270043 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.270016 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q"] Jun 12 19:22:44.272169 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:22:44.272147 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab9989a_dfc3_4d45_adc5_a7126c1e8980.slice/crio-066f7df48a04b4cd6ae85c79b62021add66653b19ded26c459b5c616f73859c4 WatchSource:0}: Error finding container 066f7df48a04b4cd6ae85c79b62021add66653b19ded26c459b5c616f73859c4: Status 404 returned error can't find the container with id 066f7df48a04b4cd6ae85c79b62021add66653b19ded26c459b5c616f73859c4 Jun 12 19:22:44.359504 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.359472 2554 generic.go:356] "Generic (PLEG): container finished" podID="e9b4c446-bce3-49ce-a85f-3833f361ad89" containerID="d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff" exitCode=0 Jun 12 19:22:44.359914 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.359516 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" Jun 12 19:22:44.359914 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.359548 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" event={"ID":"e9b4c446-bce3-49ce-a85f-3833f361ad89","Type":"ContainerDied","Data":"d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff"} Jun 12 19:22:44.359914 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.359593 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4" event={"ID":"e9b4c446-bce3-49ce-a85f-3833f361ad89","Type":"ContainerDied","Data":"171bde112b2b1bfeb9cfafe2610295601762f3e1d3b8e23dd644f31e2d7be621"} Jun 12 19:22:44.359914 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.359619 2554 scope.go:117] "RemoveContainer" containerID="d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff" Jun 12 19:22:44.361347 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.361323 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" event={"ID":"cab9989a-dfc3-4d45-adc5-a7126c1e8980","Type":"ContainerStarted","Data":"2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145"} Jun 12 19:22:44.361535 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.361515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" event={"ID":"cab9989a-dfc3-4d45-adc5-a7126c1e8980","Type":"ContainerStarted","Data":"066f7df48a04b4cd6ae85c79b62021add66653b19ded26c459b5c616f73859c4"} Jun 12 19:22:44.361664 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.361644 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:44.368146 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.368131 2554 scope.go:117] "RemoveContainer" containerID="d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff" Jun 12 19:22:44.368364 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:44.368345 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff\": container with ID starting with d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff not found: ID does not exist" containerID="d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff" Jun 12 19:22:44.368441 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.368373 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff"} err="failed to get container status \"d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff\": rpc error: code = NotFound desc = could not find container \"d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff\": container with ID starting with d109e3d37469eadf2311d1225aa68778953983dc323a5901b5685c30b2ef2eff not found: ID does not exist" Jun 12 19:22:44.381069 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.381044 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4"] Jun 12 19:22:44.385566 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.385539 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rb8q4"] Jun 12 19:22:44.403534 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:44.403493 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" podStartSLOduration=1.40348004 podStartE2EDuration="1.40348004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:22:44.402649939 +0000 UTC m=+671.032716161" watchObservedRunningTime="2026-06-12 19:22:44.40348004 +0000 UTC m=+671.033546261" Jun 12 19:22:45.815916 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:45.815876 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b4c446-bce3-49ce-a85f-3833f361ad89" path="/var/lib/kubelet/pods/e9b4c446-bce3-49ce-a85f-3833f361ad89/volumes" Jun 12 19:22:55.370271 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.370239 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:22:55.424846 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.424817 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts"] Jun 12 19:22:55.425082 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.425052 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" podUID="e937d225-b171-42e7-89ca-378c9e53c3da" containerName="manager" containerID="cri-o://14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a" gracePeriod=10 Jun 12 19:22:55.681333 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.681309 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:55.716274 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.716243 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-486kn\" (UniqueName: \"kubernetes.io/projected/e937d225-b171-42e7-89ca-378c9e53c3da-kube-api-access-486kn\") pod \"e937d225-b171-42e7-89ca-378c9e53c3da\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " Jun 12 19:22:55.716440 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.716345 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e937d225-b171-42e7-89ca-378c9e53c3da-extensions-socket-volume\") pod \"e937d225-b171-42e7-89ca-378c9e53c3da\" (UID: \"e937d225-b171-42e7-89ca-378c9e53c3da\") " Jun 12 19:22:55.716771 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.716742 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e937d225-b171-42e7-89ca-378c9e53c3da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e937d225-b171-42e7-89ca-378c9e53c3da" (UID: "e937d225-b171-42e7-89ca-378c9e53c3da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:22:55.718457 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.718414 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e937d225-b171-42e7-89ca-378c9e53c3da-kube-api-access-486kn" (OuterVolumeSpecName: "kube-api-access-486kn") pod "e937d225-b171-42e7-89ca-378c9e53c3da" (UID: "e937d225-b171-42e7-89ca-378c9e53c3da"). InnerVolumeSpecName "kube-api-access-486kn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:22:55.820170 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.820135 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-486kn\" (UniqueName: \"kubernetes.io/projected/e937d225-b171-42e7-89ca-378c9e53c3da-kube-api-access-486kn\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:55.820170 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:55.820169 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e937d225-b171-42e7-89ca-378c9e53c3da-extensions-socket-volume\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:22:56.422985 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.422950 2554 generic.go:356] "Generic (PLEG): container finished" podID="e937d225-b171-42e7-89ca-378c9e53c3da" containerID="14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a" exitCode=0 Jun 12 19:22:56.423418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.423002 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" Jun 12 19:22:56.423418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.423043 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" event={"ID":"e937d225-b171-42e7-89ca-378c9e53c3da","Type":"ContainerDied","Data":"14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a"} Jun 12 19:22:56.423418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.423094 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts" event={"ID":"e937d225-b171-42e7-89ca-378c9e53c3da","Type":"ContainerDied","Data":"e9eb3824fc145895c91097f03e1991f5aeb9e30e91c3989723c05af901df5097"} Jun 12 19:22:56.423418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.423117 2554 scope.go:117] "RemoveContainer" containerID="14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a" Jun 12 19:22:56.431761 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.431557 2554 scope.go:117] "RemoveContainer" containerID="14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a" Jun 12 19:22:56.431820 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:22:56.431806 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a\": container with ID starting with 14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a not found: ID does not exist" containerID="14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a" Jun 12 19:22:56.431859 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.431830 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a"} err="failed to get container status \"14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a\": rpc error: code = NotFound desc = could not find container \"14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a\": container with ID starting with 14e1a1db0ba660dd1c1c9a0184b87e69f16cd19749957462a9b986df8d1dcc0a not found: ID does not exist" Jun 12 19:22:56.442630 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.442609 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts"] Jun 12 19:22:56.446281 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:56.446261 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-chlts"] Jun 12 19:22:57.815763 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:57.815730 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e937d225-b171-42e7-89ca-378c9e53c3da" path="/var/lib/kubelet/pods/e937d225-b171-42e7-89ca-378c9e53c3da/volumes" Jun 12 19:22:59.789054 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.789017 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9"] Jun 12 19:22:59.789632 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.789594 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e937d225-b171-42e7-89ca-378c9e53c3da" containerName="manager" Jun 12 19:22:59.789731 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.789635 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e937d225-b171-42e7-89ca-378c9e53c3da" containerName="manager" Jun 12 19:22:59.789793 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.789762 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e937d225-b171-42e7-89ca-378c9e53c3da" containerName="manager" Jun 12 19:22:59.792535 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.792515 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.795105 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.795085 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lc2mt\"" Jun 12 19:22:59.804458 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.804418 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9"] Jun 12 19:22:59.851628 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851726 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851726 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28bb6\" (UniqueName: \"kubernetes.io/projected/d7149550-3225-4cb0-a3c3-35ca5657517e-kube-api-access-28bb6\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851726 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851828 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851735 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851828 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851828 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851822 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851920 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851852 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.851951 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.851919 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7149550-3225-4cb0-a3c3-35ca5657517e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952261 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952359 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952278 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7149550-3225-4cb0-a3c3-35ca5657517e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952359 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952300 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952450 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952491 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952475 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28bb6\" (UniqueName: \"kubernetes.io/projected/d7149550-3225-4cb0-a3c3-35ca5657517e-kube-api-access-28bb6\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952536 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952515 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952768 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952729 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952768 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952747 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.952874 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.952819 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.953034 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.953015 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7149550-3225-4cb0-a3c3-35ca5657517e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.953124 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.953047 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.953217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.953196 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.954678 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.954662 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.954779 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.954764 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.960955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.960932 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7149550-3225-4cb0-a3c3-35ca5657517e-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:22:59.961837 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:22:59.961814 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28bb6\" (UniqueName: \"kubernetes.io/projected/d7149550-3225-4cb0-a3c3-35ca5657517e-kube-api-access-28bb6\") pod \"maas-default-gateway-openshift-default-687ff6996-6dxx9\" (UID: \"d7149550-3225-4cb0-a3c3-35ca5657517e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:23:00.103272 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.103192 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:23:00.232598 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.232576 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9"] Jun 12 19:23:00.234660 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:23:00.234634 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7149550_3225_4cb0_a3c3_35ca5657517e.slice/crio-0f5c51950e33182b120fa965856b995755d451a0183dfd05ddcd10aa33514e85 WatchSource:0}: Error finding container 0f5c51950e33182b120fa965856b995755d451a0183dfd05ddcd10aa33514e85: Status 404 returned error can't find the container with id 0f5c51950e33182b120fa965856b995755d451a0183dfd05ddcd10aa33514e85 Jun 12 19:23:00.236777 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.236747 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:23:00.236848 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.236809 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:23:00.236848 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.236839 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:23:00.445040 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.445003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" event={"ID":"d7149550-3225-4cb0-a3c3-35ca5657517e","Type":"ContainerStarted","Data":"b693d1c6b22c9b59f8605610a4911654bac112c28052854ce725ff40857a424c"} Jun 12 19:23:00.445203 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.445069 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" event={"ID":"d7149550-3225-4cb0-a3c3-35ca5657517e","Type":"ContainerStarted","Data":"0f5c51950e33182b120fa965856b995755d451a0183dfd05ddcd10aa33514e85"} Jun 12 19:23:00.465155 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:00.465110 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" podStartSLOduration=1.4650953979999999 podStartE2EDuration="1.465095398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:00.463470578 +0000 UTC m=+687.093536794" watchObservedRunningTime="2026-06-12 19:23:00.465095398 +0000 UTC m=+687.095161617" Jun 12 19:23:01.104371 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:01.104341 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:23:01.108477 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:01.108455 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:23:01.449859 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:01.449829 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:23:01.450765 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:01.450744 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:23:15.386751 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.386717 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:23:15.390583 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.390563 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.393235 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.393211 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 19:23:15.393358 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.393237 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7f9z8\"" Jun 12 19:23:15.399029 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.398938 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:23:15.435201 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.435167 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:23:15.490419 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.490388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc6p9\" (UniqueName: \"kubernetes.io/projected/dd57a04c-c2ad-4b91-a678-8f2dacdad512-kube-api-access-gc6p9\") pod \"limitador-limitador-54d6d988d5-m8g4g\" (UID: \"dd57a04c-c2ad-4b91-a678-8f2dacdad512\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.490589 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.490471 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd57a04c-c2ad-4b91-a678-8f2dacdad512-config-file\") pod \"limitador-limitador-54d6d988d5-m8g4g\" (UID: \"dd57a04c-c2ad-4b91-a678-8f2dacdad512\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.591894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.591861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc6p9\" (UniqueName: \"kubernetes.io/projected/dd57a04c-c2ad-4b91-a678-8f2dacdad512-kube-api-access-gc6p9\") pod \"limitador-limitador-54d6d988d5-m8g4g\" (UID: \"dd57a04c-c2ad-4b91-a678-8f2dacdad512\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.592102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.591937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd57a04c-c2ad-4b91-a678-8f2dacdad512-config-file\") pod \"limitador-limitador-54d6d988d5-m8g4g\" (UID: \"dd57a04c-c2ad-4b91-a678-8f2dacdad512\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.592611 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.592594 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd57a04c-c2ad-4b91-a678-8f2dacdad512-config-file\") pod \"limitador-limitador-54d6d988d5-m8g4g\" (UID: \"dd57a04c-c2ad-4b91-a678-8f2dacdad512\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.601727 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.601701 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc6p9\" (UniqueName: \"kubernetes.io/projected/dd57a04c-c2ad-4b91-a678-8f2dacdad512-kube-api-access-gc6p9\") pod \"limitador-limitador-54d6d988d5-m8g4g\" (UID: \"dd57a04c-c2ad-4b91-a678-8f2dacdad512\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.703148 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.703109 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:15.843699 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:15.843663 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:23:15.847198 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:23:15.847165 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd57a04c_c2ad_4b91_a678_8f2dacdad512.slice/crio-14bcd9eb412223934273c6fc7e5698151cb5aca1567e914fe15e542483e6435f WatchSource:0}: Error finding container 14bcd9eb412223934273c6fc7e5698151cb5aca1567e914fe15e542483e6435f: Status 404 returned error can't find the container with id 14bcd9eb412223934273c6fc7e5698151cb5aca1567e914fe15e542483e6435f Jun 12 19:23:16.521304 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:16.521261 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" event={"ID":"dd57a04c-c2ad-4b91-a678-8f2dacdad512","Type":"ContainerStarted","Data":"14bcd9eb412223934273c6fc7e5698151cb5aca1567e914fe15e542483e6435f"} Jun 12 19:23:18.533095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:18.533061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" event={"ID":"dd57a04c-c2ad-4b91-a678-8f2dacdad512","Type":"ContainerStarted","Data":"456ac51ab670099e9ab1de1b471232f8423eca78f54e34006ed9b128aee756ca"} Jun 12 19:23:18.533570 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:18.533127 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:23:18.552296 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:18.552249 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" podStartSLOduration=1.081020413 podStartE2EDuration="3.5522335s" totalImagesPullingTime="2.471213087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:23:18.550564838 +0000 UTC m=+705.180631058" watchObservedRunningTime="2026-06-12 19:23:18.5522335 +0000 UTC m=+705.182299720" Jun 12 19:23:29.539342 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:23:29.539275 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8g4g" Jun 12 19:25:17.430812 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.430779 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:25:17.557079 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.557032 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-bpnbt"] Jun 12 19:25:17.560693 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.560671 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:25:17.563640 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.563601 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fbh8d\"" Jun 12 19:25:17.563640 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.563621 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 19:25:17.572990 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.572965 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-bpnbt"] Jun 12 19:25:17.632051 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.631996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zbcl\" (UniqueName: \"kubernetes.io/projected/ffc51d7a-da6e-4775-abd2-491c99d834de-kube-api-access-7zbcl\") pod \"payload-processing-699b6cd6c-bpnbt\" (UID: \"ffc51d7a-da6e-4775-abd2-491c99d834de\") " pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:25:17.732636 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.732542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zbcl\" (UniqueName: \"kubernetes.io/projected/ffc51d7a-da6e-4775-abd2-491c99d834de-kube-api-access-7zbcl\") pod \"payload-processing-699b6cd6c-bpnbt\" (UID: \"ffc51d7a-da6e-4775-abd2-491c99d834de\") " pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:25:17.741349 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.741317 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zbcl\" (UniqueName: \"kubernetes.io/projected/ffc51d7a-da6e-4775-abd2-491c99d834de-kube-api-access-7zbcl\") pod \"payload-processing-699b6cd6c-bpnbt\" (UID: \"ffc51d7a-da6e-4775-abd2-491c99d834de\") " pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:25:17.878108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:17.878067 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:25:18.064569 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:18.064537 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-bpnbt"] Jun 12 19:25:18.067342 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:25:18.067312 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc51d7a_da6e_4775_abd2_491c99d834de.slice/crio-0597885c60377acecfc779372705f3df0ccddd6ce165e64ef1462a1b10d941ba WatchSource:0}: Error finding container 0597885c60377acecfc779372705f3df0ccddd6ce165e64ef1462a1b10d941ba: Status 404 returned error can't find the container with id 0597885c60377acecfc779372705f3df0ccddd6ce165e64ef1462a1b10d941ba Jun 12 19:25:18.068973 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:18.068957 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:25:18.084412 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:18.084382 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" event={"ID":"ffc51d7a-da6e-4775-abd2-491c99d834de","Type":"ContainerStarted","Data":"0597885c60377acecfc779372705f3df0ccddd6ce165e64ef1462a1b10d941ba"} Jun 12 19:25:21.101492 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:21.101454 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" event={"ID":"ffc51d7a-da6e-4775-abd2-491c99d834de","Type":"ContainerStarted","Data":"df4ad7f4b160773761847136cfdaaddb40c6b38462c13d77aec845ec7afb9e4a"} Jun 12 19:25:21.102025 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:21.101557 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:25:21.123412 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:21.121402 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" podStartSLOduration=1.537478171 podStartE2EDuration="4.121379822s" totalImagesPullingTime="2.583901651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:25:21.119906708 +0000 UTC m=+827.749972929" watchObservedRunningTime="2026-06-12 19:25:21.121379822 +0000 UTC m=+827.751446042" Jun 12 19:25:25.120654 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:25.120553 2554 generic.go:356] "Generic (PLEG): container finished" podID="d7149550-3225-4cb0-a3c3-35ca5657517e" containerID="b693d1c6b22c9b59f8605610a4911654bac112c28052854ce725ff40857a424c" exitCode=0 Jun 12 19:25:25.120654 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:25.120612 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" event={"ID":"d7149550-3225-4cb0-a3c3-35ca5657517e","Type":"ContainerDied","Data":"b693d1c6b22c9b59f8605610a4911654bac112c28052854ce725ff40857a424c"} Jun 12 19:25:25.121080 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:25.121010 2554 scope.go:117] "RemoveContainer" containerID="b693d1c6b22c9b59f8605610a4911654bac112c28052854ce725ff40857a424c" Jun 12 19:25:25.121958 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:25.121928 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:25:25.122041 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:25.122000 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:25:25.122041 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:25.122033 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:25:26.130268 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:26.130233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" event={"ID":"d7149550-3225-4cb0-a3c3-35ca5657517e","Type":"ContainerStarted","Data":"336845924a4cff6a045a2052716a00c7fa7de834827bfc084881b380945f6b3f"} Jun 12 19:25:27.104125 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:27.104086 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:25:27.104947 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:27.104921 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6dxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jun 12 19:25:27.105041 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:27.104979 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" podUID="d7149550-3225-4cb0-a3c3-35ca5657517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jun 12 19:25:28.103818 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:28.103778 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6dxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jun 12 19:25:28.104195 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:28.103849 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" podUID="d7149550-3225-4cb0-a3c3-35ca5657517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jun 12 19:25:29.103888 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:29.103844 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6dxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jun 12 19:25:29.104267 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:29.103907 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" podUID="d7149550-3225-4cb0-a3c3-35ca5657517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jun 12 19:25:30.107001 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:30.106972 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:25:30.107368 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:30.107346 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:25:30.108033 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:30.108014 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6dxx9" Jun 12 19:25:32.107730 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:25:32.107699 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-bpnbt" Jun 12 19:26:14.334633 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.334587 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b"] Jun 12 19:26:14.338025 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.338004 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.341121 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.341093 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 19:26:14.341281 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.341125 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 19:26:14.341281 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.341188 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 19:26:14.341380 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.341282 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x5hqk\"" Jun 12 19:26:14.349038 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.349004 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b"] Jun 12 19:26:14.411933 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.411888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w87s\" (UniqueName: \"kubernetes.io/projected/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-kube-api-access-4w87s\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.412134 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.412003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.412134 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.412032 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.412134 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.412056 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.412134 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.412088 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.412298 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.412157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.513692 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.513657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.513692 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.513698 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.513969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.513720 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.513969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.513745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.513969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.513773 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.513969 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.513891 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w87s\" (UniqueName: \"kubernetes.io/projected/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-kube-api-access-4w87s\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.514174 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.514130 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.514229 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.514169 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.514229 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.514188 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.516218 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.516193 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.516339 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.516321 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.523094 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.523062 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w87s\" (UniqueName: \"kubernetes.io/projected/b96d8b56-97f3-4cb3-9f75-2a7539a0ef70-kube-api-access-4w87s\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b\" (UID: \"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.607634 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.607550 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:26:14.650443 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.650402 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:14.798337 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:14.798299 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b"] Jun 12 19:26:14.801769 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:26:14.801731 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96d8b56_97f3_4cb3_9f75_2a7539a0ef70.slice/crio-62d26d45e1105f70e7a1b7e0ee8f2ce031ffc730d0ba3d725fd11d3c27aab768 WatchSource:0}: Error finding container 62d26d45e1105f70e7a1b7e0ee8f2ce031ffc730d0ba3d725fd11d3c27aab768: Status 404 returned error can't find the container with id 62d26d45e1105f70e7a1b7e0ee8f2ce031ffc730d0ba3d725fd11d3c27aab768 Jun 12 19:26:15.355909 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:15.355872 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" event={"ID":"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70","Type":"ContainerStarted","Data":"62d26d45e1105f70e7a1b7e0ee8f2ce031ffc730d0ba3d725fd11d3c27aab768"} Jun 12 19:26:19.379280 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.379242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" event={"ID":"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70","Type":"ContainerStarted","Data":"49e9c4aba9e450b80714bee966749392aec74939279a0424bc30d38f227c8e08"} Jun 12 19:26:19.841780 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.841748 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg"] Jun 12 19:26:19.844493 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.844474 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.847756 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.847732 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 19:26:19.862389 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.862364 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg"] Jun 12 19:26:19.863350 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.863320 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c442372-fb68-473a-a0f6-dd2c647ca5e4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.863480 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.863361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.863480 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.863396 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.863480 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.863445 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.863638 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.863493 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.863638 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.863518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqj9\" (UniqueName: \"kubernetes.io/projected/8c442372-fb68-473a-a0f6-dd2c647ca5e4-kube-api-access-hkqj9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.963927 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.963887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c442372-fb68-473a-a0f6-dd2c647ca5e4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.963936 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.963969 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.963992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.964031 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964102 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.964057 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqj9\" (UniqueName: \"kubernetes.io/projected/8c442372-fb68-473a-a0f6-dd2c647ca5e4-kube-api-access-hkqj9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964474 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.964444 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964546 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.964509 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.964632 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.964608 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.966439 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.966403 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c442372-fb68-473a-a0f6-dd2c647ca5e4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.966778 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.966757 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c442372-fb68-473a-a0f6-dd2c647ca5e4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:19.978258 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:19.978229 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqj9\" (UniqueName: \"kubernetes.io/projected/8c442372-fb68-473a-a0f6-dd2c647ca5e4-kube-api-access-hkqj9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vxffg\" (UID: \"8c442372-fb68-473a-a0f6-dd2c647ca5e4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:20.154874 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:20.154782 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:20.289807 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:20.289782 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg"] Jun 12 19:26:20.291674 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:26:20.291645 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c442372_fb68_473a_a0f6_dd2c647ca5e4.slice/crio-dc7e4312281369abf92cf02b279328097596bd2551bb8d442a24c0fd05fc86e7 WatchSource:0}: Error finding container dc7e4312281369abf92cf02b279328097596bd2551bb8d442a24c0fd05fc86e7: Status 404 returned error can't find the container with id dc7e4312281369abf92cf02b279328097596bd2551bb8d442a24c0fd05fc86e7 Jun 12 19:26:20.386708 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:20.386681 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" event={"ID":"8c442372-fb68-473a-a0f6-dd2c647ca5e4","Type":"ContainerStarted","Data":"aaaf98fbf5ef89538d1946c2532bd5a0a6c3f3535d45912c8b8d37372af83933"} Jun 12 19:26:20.387084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:20.386744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" event={"ID":"8c442372-fb68-473a-a0f6-dd2c647ca5e4","Type":"ContainerStarted","Data":"dc7e4312281369abf92cf02b279328097596bd2551bb8d442a24c0fd05fc86e7"} Jun 12 19:26:20.467563 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:20.467530 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:26:22.398926 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:22.398837 2554 generic.go:356] "Generic (PLEG): container finished" podID="b96d8b56-97f3-4cb3-9f75-2a7539a0ef70" containerID="49e9c4aba9e450b80714bee966749392aec74939279a0424bc30d38f227c8e08" exitCode=0 Jun 12 19:26:22.399512 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:22.399471 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" event={"ID":"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70","Type":"ContainerDied","Data":"49e9c4aba9e450b80714bee966749392aec74939279a0424bc30d38f227c8e08"} Jun 12 19:26:22.401760 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:22.401733 2554 generic.go:356] "Generic (PLEG): container finished" podID="8c442372-fb68-473a-a0f6-dd2c647ca5e4" containerID="aaaf98fbf5ef89538d1946c2532bd5a0a6c3f3535d45912c8b8d37372af83933" exitCode=0 Jun 12 19:26:22.401860 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:22.401781 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" event={"ID":"8c442372-fb68-473a-a0f6-dd2c647ca5e4","Type":"ContainerDied","Data":"aaaf98fbf5ef89538d1946c2532bd5a0a6c3f3535d45912c8b8d37372af83933"} Jun 12 19:26:24.414643 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.414601 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" event={"ID":"b96d8b56-97f3-4cb3-9f75-2a7539a0ef70","Type":"ContainerStarted","Data":"4504f16bd6c015d65df74d16ebc4d905d7d1f80568210a230de65f334964d249"} Jun 12 19:26:24.416403 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.416377 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" event={"ID":"8c442372-fb68-473a-a0f6-dd2c647ca5e4","Type":"ContainerStarted","Data":"443b06c745bcefdfdd4acc991171894e1fed7eb954312cd0033d25f60331dd9b"} Jun 12 19:26:24.443374 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.443309 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" podStartSLOduration=2.301217875 podStartE2EDuration="10.44328966s" totalImagesPullingTime="5.209538307s" totalInitContainerRuntime="2.932533478s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:26:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:26:24.44281784 +0000 UTC m=+891.072884060" watchObservedRunningTime="2026-06-12 19:26:24.44328966 +0000 UTC m=+891.073355880" Jun 12 19:26:24.463846 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.463791 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" podStartSLOduration=2.598803106 podStartE2EDuration="5.463774016s" totalImagesPullingTime="1.244695814s" totalInitContainerRuntime="1.620275096s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:26:24.462397087 +0000 UTC m=+891.092463320" watchObservedRunningTime="2026-06-12 19:26:24.463774016 +0000 UTC m=+891.093840235" Jun 12 19:26:24.651315 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.651279 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:24.651562 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.651364 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:24.663862 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:24.663833 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:25.432104 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:25.432072 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b" Jun 12 19:26:30.155794 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:30.155753 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:30.156329 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:30.155860 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:30.168586 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:30.168554 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:30.455342 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:30.455311 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vxffg" Jun 12 19:26:33.841204 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:33.841174 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:26:33.843042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:33.843024 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:26:41.865964 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:41.865925 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:26:56.017256 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.017220 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z"] Jun 12 19:26:56.034368 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.034336 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.036340 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.036310 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z"] Jun 12 19:26:56.037387 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.037366 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 12 19:26:56.199206 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.199167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.199455 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.199233 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.199455 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.199278 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.199455 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.199303 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq44d\" (UniqueName: \"kubernetes.io/projected/3bcad9f6-ab72-4e62-b9f8-9e9474054956-kube-api-access-mq44d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.199609 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.199475 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bcad9f6-ab72-4e62-b9f8-9e9474054956-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.199609 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.199530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.300709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bcad9f6-ab72-4e62-b9f8-9e9474054956-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.300709 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.300955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.300955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.300955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.300955 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq44d\" (UniqueName: \"kubernetes.io/projected/3bcad9f6-ab72-4e62-b9f8-9e9474054956-kube-api-access-mq44d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.301154 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.300983 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.301154 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.301087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.301247 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.301168 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.302951 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.302924 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bcad9f6-ab72-4e62-b9f8-9e9474054956-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.303202 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.303184 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bcad9f6-ab72-4e62-b9f8-9e9474054956-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.311118 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.311087 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq44d\" (UniqueName: \"kubernetes.io/projected/3bcad9f6-ab72-4e62-b9f8-9e9474054956-kube-api-access-mq44d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z\" (UID: \"3bcad9f6-ab72-4e62-b9f8-9e9474054956\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.347085 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.347046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:26:56.488100 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.488071 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z"] Jun 12 19:26:56.490374 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:26:56.490350 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcad9f6_ab72_4e62_b9f8_9e9474054956.slice/crio-0feb3f369212194b931ce5f905d13bc00c35fd4aed42ed0612510f9f195eae3b WatchSource:0}: Error finding container 0feb3f369212194b931ce5f905d13bc00c35fd4aed42ed0612510f9f195eae3b: Status 404 returned error can't find the container with id 0feb3f369212194b931ce5f905d13bc00c35fd4aed42ed0612510f9f195eae3b Jun 12 19:26:56.576691 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.576649 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" event={"ID":"3bcad9f6-ab72-4e62-b9f8-9e9474054956","Type":"ContainerStarted","Data":"368a8365fd4b3f065536937a9ed9b386c9c7e579fc785910cdfa07045bdbc081"} Jun 12 19:26:56.576867 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.576700 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" event={"ID":"3bcad9f6-ab72-4e62-b9f8-9e9474054956","Type":"ContainerStarted","Data":"0feb3f369212194b931ce5f905d13bc00c35fd4aed42ed0612510f9f195eae3b"} Jun 12 19:26:56.875767 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:56.875666 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:26:58.587108 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:58.587054 2554 generic.go:356] "Generic (PLEG): container finished" podID="3bcad9f6-ab72-4e62-b9f8-9e9474054956" containerID="368a8365fd4b3f065536937a9ed9b386c9c7e579fc785910cdfa07045bdbc081" exitCode=0 Jun 12 19:26:58.587556 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:58.587133 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" event={"ID":"3bcad9f6-ab72-4e62-b9f8-9e9474054956","Type":"ContainerDied","Data":"368a8365fd4b3f065536937a9ed9b386c9c7e579fc785910cdfa07045bdbc081"} Jun 12 19:26:59.594054 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:59.594017 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" event={"ID":"3bcad9f6-ab72-4e62-b9f8-9e9474054956","Type":"ContainerStarted","Data":"01d2f9790d5b7637afd423b1d856273a6ff9780655d2836542d64eb2c8afcbd9"} Jun 12 19:26:59.614710 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:26:59.614651 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" podStartSLOduration=2.116492705 podStartE2EDuration="3.614631515s" totalImagesPullingTime="211.995365ms" totalInitContainerRuntime="1.286143445s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:26:59.613966338 +0000 UTC m=+926.244032558" watchObservedRunningTime="2026-06-12 19:26:59.614631515 +0000 UTC m=+926.244697736" Jun 12 19:27:06.347745 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:06.347709 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:27:06.348223 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:06.347768 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:27:06.360167 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:06.360139 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:27:06.639438 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:06.639331 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z" Jun 12 19:27:07.419137 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.419102 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt"] Jun 12 19:27:07.423814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.423794 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.426730 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.426711 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 19:27:07.435132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.435108 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt"] Jun 12 19:27:07.491282 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.491248 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7r6\" (UniqueName: \"kubernetes.io/projected/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-kube-api-access-jl7r6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.491499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.491297 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.491499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.491369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.491499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.491414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.491499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.491459 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.491637 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.491522 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592408 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592408 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592499 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7r6\" (UniqueName: \"kubernetes.io/projected/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-kube-api-access-jl7r6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592657 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592654 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592875 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592769 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592875 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592845 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.592974 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.592907 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.594855 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.594825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.595073 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.595054 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.600905 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.600885 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7r6\" (UniqueName: \"kubernetes.io/projected/d54eaa96-8ce3-4dc5-94a0-eb46f0605d86-kube-api-access-jl7r6\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt\" (UID: \"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.734488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.734385 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:27:07.875452 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:07.875391 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt"] Jun 12 19:27:07.877717 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:27:07.877691 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54eaa96_8ce3_4dc5_94a0_eb46f0605d86.slice/crio-36be56ae2a81df9dd43df9588ed6e3a71b65a868ae8a523595678dd3af9c567f WatchSource:0}: Error finding container 36be56ae2a81df9dd43df9588ed6e3a71b65a868ae8a523595678dd3af9c567f: Status 404 returned error can't find the container with id 36be56ae2a81df9dd43df9588ed6e3a71b65a868ae8a523595678dd3af9c567f Jun 12 19:27:08.385493 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:08.385451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:27:08.639079 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:08.638979 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" event={"ID":"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86","Type":"ContainerStarted","Data":"59bdf5d4690d876890804cc3b0aa8905397212271aea3bfc2f5bd0b705287e7d"} Jun 12 19:27:08.639079 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:08.639041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" event={"ID":"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86","Type":"ContainerStarted","Data":"36be56ae2a81df9dd43df9588ed6e3a71b65a868ae8a523595678dd3af9c567f"} Jun 12 19:27:22.470540 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:22.470498 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:27:59.898135 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:59.898102 2554 generic.go:356] "Generic (PLEG): container finished" podID="d54eaa96-8ce3-4dc5-94a0-eb46f0605d86" containerID="59bdf5d4690d876890804cc3b0aa8905397212271aea3bfc2f5bd0b705287e7d" exitCode=0 Jun 12 19:27:59.898562 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:27:59.898177 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" event={"ID":"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86","Type":"ContainerDied","Data":"59bdf5d4690d876890804cc3b0aa8905397212271aea3bfc2f5bd0b705287e7d"} Jun 12 19:28:00.904485 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:00.904420 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" event={"ID":"d54eaa96-8ce3-4dc5-94a0-eb46f0605d86","Type":"ContainerStarted","Data":"306059af62297a1726bd91ff536f177aa6b7fbfae5feb1efbe6c871f714b5ac8"} Jun 12 19:28:00.925400 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:00.925343 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" podStartSLOduration=2.020509607 podStartE2EDuration="53.925325907s" totalImagesPullingTime="181.332676ms" totalInitContainerRuntime="51.723483624s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:28:00.924359282 +0000 UTC m=+987.554425505" watchObservedRunningTime="2026-06-12 19:28:00.925325907 +0000 UTC m=+987.555392127" Jun 12 19:28:07.735371 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:07.735336 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:28:07.735861 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:07.735396 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:28:07.748084 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:07.748056 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:28:07.950516 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:07.950478 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt" Jun 12 19:28:54.572306 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:28:54.571520 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:29:03.270590 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:29:03.270552 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:29:13.876466 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:29:13.876357 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:29:23.372979 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:29:23.372901 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:29:33.263116 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:29:33.263082 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:29:42.487440 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:29:42.487384 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:30:17.268613 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:30:17.268568 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:30:20.661327 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:30:20.661294 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:30:57.015138 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:30:57.015051 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:31:12.877259 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:31:12.877221 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:31:33.879888 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:31:33.879849 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:31:33.883053 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:31:33.883030 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:31:51.673060 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:31:51.673023 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:32:08.072752 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:32:08.072713 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:32:22.671046 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:32:22.670957 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:32:37.874511 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:32:37.874475 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:32:41.674037 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:32:41.673999 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:33:38.767330 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:33:38.767289 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:33:47.872405 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:33:47.872364 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:34:04.665824 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:34:04.665748 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:34:13.172492 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:34:13.172451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:34:30.581237 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:34:30.581198 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:34:38.969518 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:34:38.969476 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:11.358820 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:11.358782 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:20.264488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:20.264451 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:29.175584 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:29.175511 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:36.663684 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:36.663644 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:44.970378 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:44.970336 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:53.771699 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:53.771657 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:35:57.567347 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:35:57.567303 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:36:10.561833 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:36:10.561794 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:36:22.476948 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:36:22.476910 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:36:33.910725 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:36:33.910698 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:36:33.915689 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:36:33.915667 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:36:51.172005 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:36:51.171968 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:36:53.880835 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:36:53.880745 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:37:11.663939 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:37:11.663904 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:37:18.173971 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:37:18.173933 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:37:37.083878 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:37:37.083840 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:37:42.115655 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:37:42.115618 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:37:46.201098 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:37:46.201064 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:37:55.774976 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:37:55.774942 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:03.666586 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:03.666547 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:13.671155 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:13.671112 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:21.773095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:21.773057 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:31.167753 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:31.167654 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:37.686085 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:37.686047 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:46.871511 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:46.871475 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:38:55.221394 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:38:55.221360 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:39:56.837294 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:56.837214 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q"] Jun 12 19:39:56.837801 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:56.837411 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" podUID="cab9989a-dfc3-4d45-adc5-a7126c1e8980" containerName="manager" containerID="cri-o://2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145" gracePeriod=10 Jun 12 19:39:57.082534 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.082510 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:39:57.229095 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.229070 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9989a-dfc3-4d45-adc5-a7126c1e8980-extensions-socket-volume\") pod \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " Jun 12 19:39:57.229247 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.229103 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l9hw\" (UniqueName: \"kubernetes.io/projected/cab9989a-dfc3-4d45-adc5-a7126c1e8980-kube-api-access-7l9hw\") pod \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\" (UID: \"cab9989a-dfc3-4d45-adc5-a7126c1e8980\") " Jun 12 19:39:57.229473 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.229451 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab9989a-dfc3-4d45-adc5-a7126c1e8980-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cab9989a-dfc3-4d45-adc5-a7126c1e8980" (UID: "cab9989a-dfc3-4d45-adc5-a7126c1e8980"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:39:57.231093 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.231070 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab9989a-dfc3-4d45-adc5-a7126c1e8980-kube-api-access-7l9hw" (OuterVolumeSpecName: "kube-api-access-7l9hw") pod "cab9989a-dfc3-4d45-adc5-a7126c1e8980" (UID: "cab9989a-dfc3-4d45-adc5-a7126c1e8980"). InnerVolumeSpecName "kube-api-access-7l9hw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:39:57.330587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.330560 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cab9989a-dfc3-4d45-adc5-a7126c1e8980-extensions-socket-volume\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:39:57.330587 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.330585 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l9hw\" (UniqueName: \"kubernetes.io/projected/cab9989a-dfc3-4d45-adc5-a7126c1e8980-kube-api-access-7l9hw\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:39:57.428181 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.428152 2554 generic.go:356] "Generic (PLEG): container finished" podID="cab9989a-dfc3-4d45-adc5-a7126c1e8980" containerID="2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145" exitCode=0 Jun 12 19:39:57.428294 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.428205 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" Jun 12 19:39:57.428294 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.428237 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" event={"ID":"cab9989a-dfc3-4d45-adc5-a7126c1e8980","Type":"ContainerDied","Data":"2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145"} Jun 12 19:39:57.428375 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.428309 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q" event={"ID":"cab9989a-dfc3-4d45-adc5-a7126c1e8980","Type":"ContainerDied","Data":"066f7df48a04b4cd6ae85c79b62021add66653b19ded26c459b5c616f73859c4"} Jun 12 19:39:57.428375 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.428331 2554 scope.go:117] "RemoveContainer" containerID="2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145" Jun 12 19:39:57.437750 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.437734 2554 scope.go:117] "RemoveContainer" containerID="2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145" Jun 12 19:39:57.437994 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:39:57.437975 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145\": container with ID starting with 2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145 not found: ID does not exist" containerID="2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145" Jun 12 19:39:57.438042 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.438002 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145"} err="failed to get container status \"2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145\": rpc error: code = NotFound desc = could not find container \"2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145\": container with ID starting with 2a696cafa8084578720fa64f8883ac5bf56513e0bb9e664a221bdc91c0beb145 not found: ID does not exist" Jun 12 19:39:57.453100 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.453077 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q"] Jun 12 19:39:57.462020 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.462001 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zg5q"] Jun 12 19:39:57.817059 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:39:57.817028 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab9989a-dfc3-4d45-adc5-a7126c1e8980" path="/var/lib/kubelet/pods/cab9989a-dfc3-4d45-adc5-a7126c1e8980/volumes" Jun 12 19:40:58.016128 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.016092 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk"] Jun 12 19:40:58.018553 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.016495 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab9989a-dfc3-4d45-adc5-a7126c1e8980" containerName="manager" Jun 12 19:40:58.018553 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.016508 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab9989a-dfc3-4d45-adc5-a7126c1e8980" containerName="manager" Jun 12 19:40:58.018553 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.016584 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab9989a-dfc3-4d45-adc5-a7126c1e8980" containerName="manager" Jun 12 19:40:58.019409 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.019393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.023127 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.023106 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jr5gt\"" Jun 12 19:40:58.035974 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.035937 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk"] Jun 12 19:40:58.080974 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.080918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/281b403b-e619-4c11-8ded-c397e1bd7330-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h4mrk\" (UID: \"281b403b-e619-4c11-8ded-c397e1bd7330\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.080974 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.080972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfws2\" (UniqueName: \"kubernetes.io/projected/281b403b-e619-4c11-8ded-c397e1bd7330-kube-api-access-bfws2\") pod \"kuadrant-operator-controller-manager-86878c769f-h4mrk\" (UID: \"281b403b-e619-4c11-8ded-c397e1bd7330\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.182308 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.182261 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/281b403b-e619-4c11-8ded-c397e1bd7330-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h4mrk\" (UID: \"281b403b-e619-4c11-8ded-c397e1bd7330\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.182629 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.182606 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfws2\" (UniqueName: \"kubernetes.io/projected/281b403b-e619-4c11-8ded-c397e1bd7330-kube-api-access-bfws2\") pod \"kuadrant-operator-controller-manager-86878c769f-h4mrk\" (UID: \"281b403b-e619-4c11-8ded-c397e1bd7330\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.183240 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.182843 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/281b403b-e619-4c11-8ded-c397e1bd7330-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h4mrk\" (UID: \"281b403b-e619-4c11-8ded-c397e1bd7330\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.195618 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.195594 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfws2\" (UniqueName: \"kubernetes.io/projected/281b403b-e619-4c11-8ded-c397e1bd7330-kube-api-access-bfws2\") pod \"kuadrant-operator-controller-manager-86878c769f-h4mrk\" (UID: \"281b403b-e619-4c11-8ded-c397e1bd7330\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.329271 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.329173 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.491214 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.491180 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk"] Jun 12 19:40:58.494257 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:40:58.494230 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281b403b_e619_4c11_8ded_c397e1bd7330.slice/crio-47328618b27c04520d9f94562e20ad44a44c38c5ca7382fd261f3f7518f5e132 WatchSource:0}: Error finding container 47328618b27c04520d9f94562e20ad44a44c38c5ca7382fd261f3f7518f5e132: Status 404 returned error can't find the container with id 47328618b27c04520d9f94562e20ad44a44c38c5ca7382fd261f3f7518f5e132 Jun 12 19:40:58.737191 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.737153 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" event={"ID":"281b403b-e619-4c11-8ded-c397e1bd7330","Type":"ContainerStarted","Data":"1e1c63d2f7ef03a3bcef8a109ff907a307099dab66214b527dc8d282781f3cc5"} Jun 12 19:40:58.737372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.737214 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" event={"ID":"281b403b-e619-4c11-8ded-c397e1bd7330","Type":"ContainerStarted","Data":"47328618b27c04520d9f94562e20ad44a44c38c5ca7382fd261f3f7518f5e132"} Jun 12 19:40:58.737372 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.737265 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:40:58.794049 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:40:58.794003 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" podStartSLOduration=1.79398969 podStartE2EDuration="1.79398969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:40:58.79034699 +0000 UTC m=+1765.420413210" watchObservedRunningTime="2026-06-12 19:40:58.79398969 +0000 UTC m=+1765.424055910" Jun 12 19:41:09.744596 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:09.744566 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4mrk" Jun 12 19:41:16.968936 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:16.968899 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:41:21.279922 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:21.279886 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:41:33.941277 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:33.941249 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:41:33.947572 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:33.947550 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:41:47.474446 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:47.470242 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:41:50.901768 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:41:50.901732 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:42:01.872544 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:42:01.872503 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:42:11.472450 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:42:11.472398 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:42:21.079070 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:42:21.079025 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:42:29.880133 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:42:29.880101 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:42:40.578164 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:42:40.578126 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:42:50.276958 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:42:50.276917 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:43:00.002908 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:43:00.002815 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:43:09.078844 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:43:09.078797 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:43:18.403719 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:43:18.403680 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:43:23.071803 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:43:23.071762 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:43:51.259736 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:43:51.259705 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:44:34.163644 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:44:34.163563 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:44:42.969070 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:44:42.969031 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:44:52.561949 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:44:52.561904 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:00.173633 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:00.173601 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:09.566488 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:09.566448 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:21.259919 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:21.259883 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:31.163358 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:31.163310 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:35.865978 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:35.865941 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:43.759179 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:43.759140 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:51.067499 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:51.067457 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:45:58.969039 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:45:58.968998 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:46:09.461066 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:09.461030 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:46:28.761649 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:28.761605 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:46:33.980633 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:33.980598 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:46:33.986843 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:33.986822 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:46:35.769009 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:35.768972 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:46:45.864364 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:45.864324 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:46:53.757162 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:46:53.757121 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:47:11.070130 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:47:11.070086 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:47:18.570210 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:47:18.570170 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:47:28.473168 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:47:28.473086 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:47:35.566630 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:47:35.566592 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:47:45.773814 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:47:45.773773 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:47:53.754866 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:47:53.754826 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:48:03.064175 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:48:03.064133 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:48:15.059772 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:48:15.059728 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:48:25.459032 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:48:25.458995 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:48:37.181573 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:48:37.181537 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:48:48.455759 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:48:48.455715 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:48:52.366295 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:48:52.366201 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:49:02.270355 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:49:02.270316 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:49:06.969842 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:49:06.969809 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:49:23.075049 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:49:23.075012 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:49:32.069894 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:49:32.069856 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:49:41.261178 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:49:41.261146 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:49:47.763309 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:49:47.763261 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:50:09.065253 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:09.065212 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:50:21.565837 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:21.565801 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8g4g"] Jun 12 19:50:22.331548 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.331517 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv"] Jun 12 19:50:22.335188 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.335173 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.338088 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.338068 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6b34ced0-openshift-default-dockercfg-zhxlx\"" Jun 12 19:50:22.356825 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.356790 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv"] Jun 12 19:50:22.492714 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-data\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.492714 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492715 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqh8l\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-kube-api-access-dqh8l\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.492912 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492760 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-envoy\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.492912 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492786 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-podinfo\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.492912 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492805 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-credential-socket\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.492912 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492824 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-token\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.492912 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istiod-ca-cert\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.493077 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.492972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-socket\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.493077 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.493039 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-certs\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.593642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593561 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-data\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.593642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593597 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqh8l\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-kube-api-access-dqh8l\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.593642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593638 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-envoy\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-podinfo\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-credential-socket\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593718 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-token\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istiod-ca-cert\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.593953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-socket\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.594021 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-data\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.594033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-certs\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.594080 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-socket\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594163 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.594154 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-credential-socket\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594634 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.594322 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-certs\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.594850 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.594825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istiod-ca-cert\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.596211 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.596191 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-envoy\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.596612 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.596597 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-podinfo\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.601939 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.601909 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-token\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.602224 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.602208 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqh8l\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-kube-api-access-dqh8l\") pod \"e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.646268 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.646240 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:22.782942 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.782909 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv"] Jun 12 19:50:22.784412 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:50:22.784383 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28d6577_6444_4d06_ab1e_7f426c5cf12e.slice/crio-6d84f0371b5a88cb31743c97ce4089c220d487774b614ac040f2a4f8732c8481 WatchSource:0}: Error finding container 6d84f0371b5a88cb31743c97ce4089c220d487774b614ac040f2a4f8732c8481: Status 404 returned error can't find the container with id 6d84f0371b5a88cb31743c97ce4089c220d487774b614ac040f2a4f8732c8481 Jun 12 19:50:22.786614 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.786578 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:50:22.786726 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.786656 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:50:22.786726 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:22.786702 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:50:23.509934 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:23.509898 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" event={"ID":"e28d6577-6444-4d06-ab1e-7f426c5cf12e","Type":"ContainerStarted","Data":"27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb"} Jun 12 19:50:23.510103 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:23.509951 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" event={"ID":"e28d6577-6444-4d06-ab1e-7f426c5cf12e","Type":"ContainerStarted","Data":"6d84f0371b5a88cb31743c97ce4089c220d487774b614ac040f2a4f8732c8481"} Jun 12 19:50:23.532343 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:23.532299 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" podStartSLOduration=1.5322846490000002 podStartE2EDuration="1.532284649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:50:23.531012331 +0000 UTC m=+2330.161078597" watchObservedRunningTime="2026-06-12 19:50:23.532284649 +0000 UTC m=+2330.162350869" Jun 12 19:50:23.647244 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:23.647203 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:23.653828 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:23.653800 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:24.515395 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:24.515362 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:24.516450 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:24.516409 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:28.836655 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:28.836611 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv"] Jun 12 19:50:28.837101 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:28.836823 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" podUID="e28d6577-6444-4d06-ab1e-7f426c5cf12e" containerName="istio-proxy" containerID="cri-o://27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb" gracePeriod=30 Jun 12 19:50:34.086784 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.086756 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:34.107231 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107126 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-certs\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107231 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107174 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqh8l\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-kube-api-access-dqh8l\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107231 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107204 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istiod-ca-cert\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107703 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107294 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-credential-socket\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107703 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107372 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-envoy\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107703 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107396 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-socket\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107703 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107467 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-data\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107703 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107494 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-podinfo\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.107703 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.107530 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-token\") pod \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\" (UID: \"e28d6577-6444-4d06-ab1e-7f426c5cf12e\") " Jun 12 19:50:34.108099 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.108046 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:34.108332 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.108308 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:34.108453 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.108252 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:50:34.108560 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.108538 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:34.108687 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.108664 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:34.110690 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.110665 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:50:34.110690 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.110674 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:34.110905 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.110884 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-kube-api-access-dqh8l" (OuterVolumeSpecName: "kube-api-access-dqh8l") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "kube-api-access-dqh8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:50:34.110996 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.110980 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e28d6577-6444-4d06-ab1e-7f426c5cf12e" (UID: "e28d6577-6444-4d06-ab1e-7f426c5cf12e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 19:50:34.209071 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209031 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-envoy\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209071 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209067 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-socket\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209071 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209076 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-data\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209084 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-podinfo\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209092 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istio-token\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209100 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-workload-certs\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209109 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqh8l\" (UniqueName: \"kubernetes.io/projected/e28d6577-6444-4d06-ab1e-7f426c5cf12e-kube-api-access-dqh8l\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209119 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e28d6577-6444-4d06-ab1e-7f426c5cf12e-istiod-ca-cert\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.209324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.209127 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e28d6577-6444-4d06-ab1e-7f426c5cf12e-credential-socket\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:34.566925 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.566884 2554 generic.go:356] "Generic (PLEG): container finished" podID="e28d6577-6444-4d06-ab1e-7f426c5cf12e" containerID="27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb" exitCode=0 Jun 12 19:50:34.566925 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.566934 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" Jun 12 19:50:34.567145 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.566970 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" event={"ID":"e28d6577-6444-4d06-ab1e-7f426c5cf12e","Type":"ContainerDied","Data":"27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb"} Jun 12 19:50:34.567145 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.567027 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv" event={"ID":"e28d6577-6444-4d06-ab1e-7f426c5cf12e","Type":"ContainerDied","Data":"6d84f0371b5a88cb31743c97ce4089c220d487774b614ac040f2a4f8732c8481"} Jun 12 19:50:34.567145 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.567049 2554 scope.go:117] "RemoveContainer" containerID="27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb" Jun 12 19:50:34.576506 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.576483 2554 scope.go:117] "RemoveContainer" containerID="27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb" Jun 12 19:50:34.576798 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:50:34.576778 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb\": container with ID starting with 27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb not found: ID does not exist" containerID="27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb" Jun 12 19:50:34.576842 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.576809 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb"} err="failed to get container status \"27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb\": rpc error: code = NotFound desc = could not find container \"27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb\": container with ID starting with 27d270b34ef9c56688390c0b5b9b2a4888e23a4ad636600f7ff53bf7a7c090bb not found: ID does not exist" Jun 12 19:50:34.590254 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.590212 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv"] Jun 12 19:50:34.594972 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.594941 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6b34ced0-openshift-default-64d7d78488-fgltv"] Jun 12 19:50:34.797011 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.796972 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg"] Jun 12 19:50:34.797515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.797492 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28d6577-6444-4d06-ab1e-7f426c5cf12e" containerName="istio-proxy" Jun 12 19:50:34.797515 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.797513 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28d6577-6444-4d06-ab1e-7f426c5cf12e" containerName="istio-proxy" Jun 12 19:50:34.797752 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.797604 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28d6577-6444-4d06-ab1e-7f426c5cf12e" containerName="istio-proxy" Jun 12 19:50:34.802320 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.802293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.805089 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.805061 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2968846c-openshift-default-dockercfg-686xx\"" Jun 12 19:50:34.815409 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.814461 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99czq\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-kube-api-access-99czq\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815417 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-socket\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815483 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-podinfo\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815546 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istiod-ca-cert\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-data\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815656 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815622 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-token\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815935 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-certs\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815935 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815829 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-credential-socket\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.815935 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.815856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-envoy\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.816332 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.816312 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg"] Jun 12 19:50:34.917107 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917074 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-data\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917107 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-token\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-certs\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917186 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-credential-socket\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-envoy\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917232 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99czq\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-kube-api-access-99czq\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917266 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-socket\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-podinfo\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917362 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917337 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istiod-ca-cert\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917724 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917550 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-data\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917724 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917615 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-certs\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917724 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917697 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-socket\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.917904 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.917888 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-credential-socket\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.918697 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.918669 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istiod-ca-cert\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.926166 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.926133 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-envoy\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.926344 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.926268 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-podinfo\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.928335 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.928308 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-token\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:34.928456 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:34.928416 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99czq\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-kube-api-access-99czq\") pod \"e2e-ait-2968846c-openshift-default-66db6f77d-7knrg\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:35.116203 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.116169 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:35.262554 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.262475 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg"] Jun 12 19:50:35.264869 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:50:35.264842 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca0c57f_6a3b_4589_9fc5_986bcecac04f.slice/crio-063f27d38a2e0ab60d28f1368f7a47a6642ad18d1ec94c834bc12794fc11629f WatchSource:0}: Error finding container 063f27d38a2e0ab60d28f1368f7a47a6642ad18d1ec94c834bc12794fc11629f: Status 404 returned error can't find the container with id 063f27d38a2e0ab60d28f1368f7a47a6642ad18d1ec94c834bc12794fc11629f Jun 12 19:50:35.267004 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.266968 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:50:35.267075 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.267042 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:50:35.267114 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.267075 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 19:50:35.573266 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.573167 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" event={"ID":"bca0c57f-6a3b-4589-9fc5-986bcecac04f","Type":"ContainerStarted","Data":"41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed"} Jun 12 19:50:35.573266 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.573229 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" event={"ID":"bca0c57f-6a3b-4589-9fc5-986bcecac04f","Type":"ContainerStarted","Data":"063f27d38a2e0ab60d28f1368f7a47a6642ad18d1ec94c834bc12794fc11629f"} Jun 12 19:50:35.594278 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.594215 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" podStartSLOduration=1.594190271 podStartE2EDuration="1.594190271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:50:35.591826874 +0000 UTC m=+2342.221893095" watchObservedRunningTime="2026-06-12 19:50:35.594190271 +0000 UTC m=+2342.224256494" Jun 12 19:50:35.818332 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:35.818295 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28d6577-6444-4d06-ab1e-7f426c5cf12e" path="/var/lib/kubelet/pods/e28d6577-6444-4d06-ab1e-7f426c5cf12e/volumes" Jun 12 19:50:36.117295 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:36.117255 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:36.123232 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:36.123205 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:36.579567 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:36.579531 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:36.580473 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:36.580452 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:42.189763 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:42.189716 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg"] Jun 12 19:50:42.190184 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:42.189930 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" podUID="bca0c57f-6a3b-4589-9fc5-986bcecac04f" containerName="istio-proxy" containerID="cri-o://41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed" gracePeriod=30 Jun 12 19:50:47.457593 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.457511 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:47.533862 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.533815 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-socket\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534033 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.533912 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-podinfo\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534033 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.533939 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-token\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534033 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534004 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istiod-ca-cert\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534054 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-certs\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534076 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-credential-socket\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534117 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-envoy\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534133 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:47.534217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534144 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99czq\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-kube-api-access-99czq\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534217 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534212 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-data\") pod \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\" (UID: \"bca0c57f-6a3b-4589-9fc5-986bcecac04f\") " Jun 12 19:50:47.534556 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534333 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:47.534556 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534406 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 19:50:47.534680 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534572 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-data" (OuterVolumeSpecName: "istio-data") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:47.534680 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534641 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:47.534680 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534656 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istiod-ca-cert\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.534680 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534676 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-certs\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.534884 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.534688 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-workload-socket\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.536457 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.536405 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 19:50:47.536610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.536590 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-kube-api-access-99czq" (OuterVolumeSpecName: "kube-api-access-99czq") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "kube-api-access-99czq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:50:47.536838 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.536815 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:50:47.536910 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.536881 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-token" (OuterVolumeSpecName: "istio-token") pod "bca0c57f-6a3b-4589-9fc5-986bcecac04f" (UID: "bca0c57f-6a3b-4589-9fc5-986bcecac04f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:50:47.635570 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.635532 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-credential-socket\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.635570 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.635565 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-envoy\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.635787 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.635578 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99czq\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-kube-api-access-99czq\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.635787 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.635591 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-data\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.635787 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.635603 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-podinfo\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.635787 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.635614 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bca0c57f-6a3b-4589-9fc5-986bcecac04f-istio-token\") on node \"ip-10-0-136-61.ec2.internal\" DevicePath \"\"" Jun 12 19:50:47.639610 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.639579 2554 generic.go:356] "Generic (PLEG): container finished" podID="bca0c57f-6a3b-4589-9fc5-986bcecac04f" containerID="41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed" exitCode=0 Jun 12 19:50:47.639771 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.639633 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" Jun 12 19:50:47.639771 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.639666 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" event={"ID":"bca0c57f-6a3b-4589-9fc5-986bcecac04f","Type":"ContainerDied","Data":"41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed"} Jun 12 19:50:47.639771 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.639747 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg" event={"ID":"bca0c57f-6a3b-4589-9fc5-986bcecac04f","Type":"ContainerDied","Data":"063f27d38a2e0ab60d28f1368f7a47a6642ad18d1ec94c834bc12794fc11629f"} Jun 12 19:50:47.639917 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.639774 2554 scope.go:117] "RemoveContainer" containerID="41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed" Jun 12 19:50:47.649324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.649305 2554 scope.go:117] "RemoveContainer" containerID="41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed" Jun 12 19:50:47.649658 ip-10-0-136-61 kubenswrapper[2554]: E0612 19:50:47.649630 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed\": container with ID starting with 41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed not found: ID does not exist" containerID="41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed" Jun 12 19:50:47.649733 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.649670 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed"} err="failed to get container status \"41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed\": rpc error: code = NotFound desc = could not find container \"41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed\": container with ID starting with 41964e80ab98b0e1a14337c63b6bee1c7ee7fa59ffd2356d62c156e19f2047ed not found: ID does not exist" Jun 12 19:50:47.661846 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.661811 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg"] Jun 12 19:50:47.663569 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.663547 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2968846c-openshift-default-66db6f77d-7knrg"] Jun 12 19:50:47.815901 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:47.815816 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca0c57f-6a3b-4589-9fc5-986bcecac04f" path="/var/lib/kubelet/pods/bca0c57f-6a3b-4589-9fc5-986bcecac04f/volumes" Jun 12 19:50:58.685154 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:58.685124 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d9895d9db-78f45_16c67791-e148-41e7-9b5f-caa89518a290/nginx/0.log" Jun 12 19:50:59.927157 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:59.927129 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-gw4rz_316d8cce-bee4-4c46-a151-8e78842a0781/copy-manifests/0.log" Jun 12 19:50:59.933872 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:50:59.933848 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-gw4rz_316d8cce-bee4-4c46-a151-8e78842a0781/manager/0.log" Jun 12 19:51:01.557300 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:01.557270 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6wcgb_b7a0fb58-b176-4d68-a419-934deb9a9046/manager/0.log" Jun 12 19:51:01.664447 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:01.664398 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dd7xt_149361ab-0f52-497d-8361-d434f2dcaa84/manager/0.log" Jun 12 19:51:01.928581 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:01.928539 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8rvjr_f537c329-3857-401f-abae-451b69e9a25a/registry-server/0.log" Jun 12 19:51:02.047980 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:02.047948 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h4mrk_281b403b-e619-4c11-8ded-c397e1bd7330/manager/0.log" Jun 12 19:51:02.176706 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:02.176671 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8g4g_dd57a04c-c2ad-4b91-a678-8f2dacdad512/limitador/0.log" Jun 12 19:51:02.639766 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:02.639736 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pfb99_5135d09a-4c18-4881-94ad-036ac29d035c/istio-proxy/0.log" Jun 12 19:51:03.090411 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:03.090380 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/1.log" Jun 12 19:51:03.315357 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:03.315327 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-bpnbt_ffc51d7a-da6e-4775-abd2-491c99d834de/payload-processing/0.log" Jun 12 19:51:03.748684 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:03.748654 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b_b96d8b56-97f3-4cb3-9f75-2a7539a0ef70/storage-initializer/0.log" Jun 12 19:51:03.755708 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:03.755689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-stz7b_b96d8b56-97f3-4cb3-9f75-2a7539a0ef70/main/0.log" Jun 12 19:51:03.858524 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:03.858494 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vxffg_8c442372-fb68-473a-a0f6-dd2c647ca5e4/main/0.log" Jun 12 19:51:03.864651 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:03.864631 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vxffg_8c442372-fb68-473a-a0f6-dd2c647ca5e4/storage-initializer/0.log" Jun 12 19:51:04.087008 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:04.086929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z_3bcad9f6-ab72-4e62-b9f8-9e9474054956/storage-initializer/0.log" Jun 12 19:51:04.094211 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:04.094184 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c6bt4z_3bcad9f6-ab72-4e62-b9f8-9e9474054956/main/0.log" Jun 12 19:51:04.202107 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:04.202082 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt_d54eaa96-8ce3-4dc5-94a0-eb46f0605d86/main/0.log" Jun 12 19:51:04.208906 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:04.208886 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-2xqzt_d54eaa96-8ce3-4dc5-94a0-eb46f0605d86/storage-initializer/0.log" Jun 12 19:51:12.086767 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:12.086741 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f488f_d1aa761a-48ed-4e86-a2a9-9b60abdac1c3/global-pull-secret-syncer/0.log" Jun 12 19:51:12.220335 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:12.220298 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cbmgc_7d3d6997-1ae1-41d6-a227-0da75ce73ac0/konnectivity-agent/0.log" Jun 12 19:51:12.327408 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:12.327375 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-61.ec2.internal_95b28959981f75938365112db4b98b52/haproxy/0.log" Jun 12 19:51:17.334292 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:17.334258 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6wcgb_b7a0fb58-b176-4d68-a419-934deb9a9046/manager/0.log" Jun 12 19:51:17.368756 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:17.368723 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dd7xt_149361ab-0f52-497d-8361-d434f2dcaa84/manager/0.log" Jun 12 19:51:17.442939 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:17.442907 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8rvjr_f537c329-3857-401f-abae-451b69e9a25a/registry-server/0.log" Jun 12 19:51:17.515391 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:17.515357 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h4mrk_281b403b-e619-4c11-8ded-c397e1bd7330/manager/0.log" Jun 12 19:51:17.544933 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:17.544904 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8g4g_dd57a04c-c2ad-4b91-a678-8f2dacdad512/limitador/0.log" Jun 12 19:51:19.599359 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.599325 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6sxw_cf393f55-dc15-493e-a254-62b71f58a42b/node-exporter/0.log" Jun 12 19:51:19.617324 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.617221 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6sxw_cf393f55-dc15-493e-a254-62b71f58a42b/kube-rbac-proxy/0.log" Jun 12 19:51:19.639970 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.639941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6sxw_cf393f55-dc15-493e-a254-62b71f58a42b/init-textfile/0.log" Jun 12 19:51:19.761792 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.761750 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-fvm98_d2f0ce90-aad5-4183-af7a-eab66ba42849/kube-rbac-proxy-main/0.log" Jun 12 19:51:19.789319 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.789286 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-fvm98_d2f0ce90-aad5-4183-af7a-eab66ba42849/kube-rbac-proxy-self/0.log" Jun 12 19:51:19.816889 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.816860 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-fvm98_d2f0ce90-aad5-4183-af7a-eab66ba42849/openshift-state-metrics/0.log" Jun 12 19:51:19.862478 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.862450 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/prometheus/0.log" Jun 12 19:51:19.885099 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.885024 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/config-reloader/0.log" Jun 12 19:51:19.916109 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.916068 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/thanos-sidecar/0.log" Jun 12 19:51:19.941410 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.941383 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/kube-rbac-proxy-web/0.log" Jun 12 19:51:19.971231 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.971197 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/kube-rbac-proxy/0.log" Jun 12 19:51:19.995001 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:19.994978 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/kube-rbac-proxy-thanos/0.log" Jun 12 19:51:20.017754 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:20.017729 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_935aca99-422a-4d86-b059-9097d41009a6/init-config-reloader/0.log" Jun 12 19:51:20.050676 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:20.050647 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-lsqnw_19fdeafb-a4d2-4be3-b65b-b77f30b6796a/prometheus-operator/0.log" Jun 12 19:51:20.071089 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:20.071056 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-lsqnw_19fdeafb-a4d2-4be3-b65b-b77f30b6796a/kube-rbac-proxy/0.log" Jun 12 19:51:20.098283 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:20.098250 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-ff2bv_214b534e-0a92-45ea-8946-0267ad1ba440/prometheus-operator-admission-webhook/0.log" Jun 12 19:51:21.658325 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:21.658298 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-rg4zt_a45f4e07-d7bb-4658-b88c-7d7dbd88bb7a/networking-console-plugin/0.log" Jun 12 19:51:22.911804 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:22.911766 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d6b89c964-gfhlq_49ff8322-abb4-44ad-a075-fdd793adb412/console/0.log" Jun 12 19:51:23.548887 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.548853 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh"] Jun 12 19:51:23.549311 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.549292 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca0c57f-6a3b-4589-9fc5-986bcecac04f" containerName="istio-proxy" Jun 12 19:51:23.549311 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.549310 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca0c57f-6a3b-4589-9fc5-986bcecac04f" containerName="istio-proxy" Jun 12 19:51:23.549510 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.549495 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca0c57f-6a3b-4589-9fc5-986bcecac04f" containerName="istio-proxy" Jun 12 19:51:23.552891 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.552868 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.555562 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.555528 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fd56\"/\"openshift-service-ca.crt\"" Jun 12 19:51:23.555562 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.555552 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9fd56\"/\"kube-root-ca.crt\"" Jun 12 19:51:23.555710 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.555620 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9fd56\"/\"default-dockercfg-m8dvh\"" Jun 12 19:51:23.561877 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.561832 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh"] Jun 12 19:51:23.648235 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.648188 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6qm7\" (UniqueName: \"kubernetes.io/projected/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-kube-api-access-r6qm7\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.648235 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.648244 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-lib-modules\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.648537 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.648389 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-sys\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.648537 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.648495 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-podres\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.648537 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.648535 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-proc\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-podres\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749132 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749140 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-proc\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6qm7\" (UniqueName: \"kubernetes.io/projected/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-kube-api-access-r6qm7\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749189 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-lib-modules\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-sys\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749254 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-proc\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749329 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-lib-modules\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749322 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-sys\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.749396 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.749265 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-podres\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.757819 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.757778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6qm7\" (UniqueName: \"kubernetes.io/projected/8f0bf4be-cd19-4323-8d0e-9c7216dd6304-kube-api-access-r6qm7\") pod \"perf-node-gather-daemonset-dl9xh\" (UID: \"8f0bf4be-cd19-4323-8d0e-9c7216dd6304\") " pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:23.864622 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:23.864507 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:24.005193 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.005159 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh"] Jun 12 19:51:24.008011 ip-10-0-136-61 kubenswrapper[2554]: W0612 19:51:24.007986 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f0bf4be_cd19_4323_8d0e_9c7216dd6304.slice/crio-201da0026aa884ae060eb5dd48cb11b0d63c2151a7eab2bc647b6c81032d0b67 WatchSource:0}: Error finding container 201da0026aa884ae060eb5dd48cb11b0d63c2151a7eab2bc647b6c81032d0b67: Status 404 returned error can't find the container with id 201da0026aa884ae060eb5dd48cb11b0d63c2151a7eab2bc647b6c81032d0b67 Jun 12 19:51:24.833898 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.833855 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" event={"ID":"8f0bf4be-cd19-4323-8d0e-9c7216dd6304","Type":"ContainerStarted","Data":"f1fe77b9dbf30a40fc687e5127b35c96552ef9eef820c89543d857a6c4f82627"} Jun 12 19:51:24.834074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.833921 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:24.834074 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.833937 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" event={"ID":"8f0bf4be-cd19-4323-8d0e-9c7216dd6304","Type":"ContainerStarted","Data":"201da0026aa884ae060eb5dd48cb11b0d63c2151a7eab2bc647b6c81032d0b67"} Jun 12 19:51:24.850459 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.850324 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" podStartSLOduration=1.850306608 podStartE2EDuration="1.850306608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:51:24.849726488 +0000 UTC m=+2391.479792708" watchObservedRunningTime="2026-06-12 19:51:24.850306608 +0000 UTC m=+2391.480372828" Jun 12 19:51:24.854931 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.854907 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bzkjg_29b86679-82f5-4b22-b237-6baf60380db9/dns/0.log" Jun 12 19:51:24.877998 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:24.877949 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bzkjg_29b86679-82f5-4b22-b237-6baf60380db9/kube-rbac-proxy/0.log" Jun 12 19:51:25.036594 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:25.036568 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zz8tb_5174921b-e915-4fa0-9a87-4a64bb1515c0/dns-node-resolver/0.log" Jun 12 19:51:25.586110 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:25.586078 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f7qhc_6661ec26-5225-42d0-8e1f-60a5c03e3d86/node-ca/0.log" Jun 12 19:51:26.565642 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:26.565615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pfb99_5135d09a-4c18-4881-94ad-036ac29d035c/istio-proxy/0.log" Jun 12 19:51:26.741149 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:26.741117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/0.log" Jun 12 19:51:26.776359 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:26.776323 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/1.log" Jun 12 19:51:26.866201 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:26.866103 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-bpnbt_ffc51d7a-da6e-4775-abd2-491c99d834de/payload-processing/0.log" Jun 12 19:51:27.555038 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:27.555008 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pnmjv_2aa3df4b-c6bd-4343-b1c2-9a96b1b261f9/serve-healthcheck-canary/0.log" Jun 12 19:51:28.121585 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:28.121524 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m756s_b7fb28b7-e3f7-4e56-8c52-a839a6a51a28/kube-rbac-proxy/0.log" Jun 12 19:51:28.144813 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:28.144781 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m756s_b7fb28b7-e3f7-4e56-8c52-a839a6a51a28/exporter/0.log" Jun 12 19:51:28.170819 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:28.170794 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m756s_b7fb28b7-e3f7-4e56-8c52-a839a6a51a28/extractor/0.log" Jun 12 19:51:30.613181 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:30.613147 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d9895d9db-78f45_16c67791-e148-41e7-9b5f-caa89518a290/nginx/0.log" Jun 12 19:51:30.849822 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:30.849796 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9fd56/perf-node-gather-daemonset-dl9xh" Jun 12 19:51:31.139398 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:31.139364 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-gw4rz_316d8cce-bee4-4c46-a151-8e78842a0781/manager/0.log" Jun 12 19:51:31.162377 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:31.162353 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc6d65868-gw4rz_316d8cce-bee4-4c46-a151-8e78842a0781/copy-manifests/0.log" Jun 12 19:51:33.022417 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:33.022381 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d7db986fb-vkcvn_6a7b082c-3a76-4c77-b72a-e0c38957e8d2/manager/0.log" Jun 12 19:51:34.011712 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:34.011683 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:51:34.019506 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:34.019480 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7k5_bbc409d9-e3b2-43d7-968e-e13a8445d96d/ovn-acl-logging/0.log" Jun 12 19:51:37.095306 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:37.095247 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pfb99_5135d09a-4c18-4881-94ad-036ac29d035c/istio-proxy/0.log" Jun 12 19:51:37.243418 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:37.243383 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/0.log" Jun 12 19:51:37.275058 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:37.275014 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/1.log" Jun 12 19:51:37.348277 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:37.348189 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-bpnbt_ffc51d7a-da6e-4775-abd2-491c99d834de/payload-processing/0.log" Jun 12 19:51:38.450200 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:38.450170 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pfb99_5135d09a-4c18-4881-94ad-036ac29d035c/istio-proxy/0.log" Jun 12 19:51:38.521169 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:38.521140 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-p48kb_fa391f77-363f-4b0a-ad54-b39e2532b005/migrator/0.log" Jun 12 19:51:38.546820 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:38.546789 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-p48kb_fa391f77-363f-4b0a-ad54-b39e2532b005/graceful-termination/0.log" Jun 12 19:51:38.604209 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:38.604179 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/0.log" Jun 12 19:51:38.636744 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:38.636703 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/1.log" Jun 12 19:51:38.711712 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:38.711630 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-bpnbt_ffc51d7a-da6e-4775-abd2-491c99d834de/payload-processing/0.log" Jun 12 19:51:40.106466 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.102174 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2qdwr_f5ad77ff-8c99-45ef-9728-1a8233f1f21c/kube-multus/0.log" Jun 12 19:51:40.324881 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.324852 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/kube-multus-additional-cni-plugins/0.log" Jun 12 19:51:40.348294 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.348268 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/egress-router-binary-copy/0.log" Jun 12 19:51:40.372204 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.372122 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/cni-plugins/0.log" Jun 12 19:51:40.373174 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.373156 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795pfb99_5135d09a-4c18-4881-94ad-036ac29d035c/istio-proxy/0.log" Jun 12 19:51:40.396685 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.396661 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/bond-cni-plugin/0.log" Jun 12 19:51:40.422602 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.422575 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/routeoverride-cni/0.log" Jun 12 19:51:40.448854 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.448825 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/whereabouts-cni-bincopy/0.log" Jun 12 19:51:40.475554 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.475526 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d6lfh_b0ad4453-8ecb-480d-b737-430da77a060e/whereabouts-cni/0.log" Jun 12 19:51:40.512746 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.512716 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/0.log" Jun 12 19:51:40.542924 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.542888 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6dxx9_d7149550-3225-4cb0-a3c3-35ca5657517e/istio-proxy/1.log" Jun 12 19:51:40.611468 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.611418 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-bpnbt_ffc51d7a-da6e-4775-abd2-491c99d834de/payload-processing/0.log" Jun 12 19:51:40.695796 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.695767 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qnq2v_b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828/network-metrics-daemon/0.log" Jun 12 19:51:40.725648 ip-10-0-136-61 kubenswrapper[2554]: I0612 19:51:40.725615 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qnq2v_b0b0c0c6-ec40-4b20-aceb-e9f9bcd94828/kube-rbac-proxy/0.log"