Jun 03 22:59:59.821523 ip-10-0-134-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 22:59:59.821536 ip-10-0-134-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 22:59:59.821546 ip-10-0-134-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 22:59:59.821866 ip-10-0-134-57 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 23:00:09.917976 ip-10-0-134-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 23:00:09.917993 ip-10-0-134-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8917fe6671b4451fb84e68bf4cfe1a0e -- Jun 03 23:02:38.987113 ip-10-0-134-57 systemd[1]: Starting Kubernetes Kubelet... Jun 03 23:02:39.448532 ip-10-0-134-57 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:02:39.448532 ip-10-0-134-57 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 23:02:39.448532 ip-10-0-134-57 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:02:39.448532 ip-10-0-134-57 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 23:02:39.448532 ip-10-0-134-57 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:02:39.450611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.450520 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 23:02:39.455610 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455590 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:39.455610 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455609 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455613 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455618 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455622 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455625 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455628 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455631 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455634 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455637 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455645 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455648 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455651 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455653 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455656 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455659 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455661 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455663 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455666 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455669 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:39.455680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455671 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455674 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455677 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455679 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455682 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455684 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455687 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455690 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455693 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455696 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455698 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455714 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455717 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455720 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455723 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455726 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455728 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455731 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455733 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455736 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:39.456152 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455738 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455740 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455743 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455745 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455748 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455750 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455753 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455755 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455758 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455760 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455763 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455765 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455768 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455772 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455776 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455779 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455785 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455789 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455792 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:39.456632 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455795 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455797 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455800 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455803 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455806 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455810 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455812 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455815 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455817 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455820 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455822 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455825 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455828 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455831 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455833 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455837 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455840 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455842 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455844 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455847 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:39.457112 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455850 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455852 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455855 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455858 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455860 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455863 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455865 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455869 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455872 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455875 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455877 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455880 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455883 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455885 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455888 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455890 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455893 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455896 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.455899 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457398 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:39.457594 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457406 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457410 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457413 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457416 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457419 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457421 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457424 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457427 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457431 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457435 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457438 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457441 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457444 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457447 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457450 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457453 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457455 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457458 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457461 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:39.458103 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457466 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457469 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457471 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457475 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457478 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457480 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457483 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457486 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457488 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457491 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457494 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457496 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457499 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457502 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457504 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457507 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457509 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457512 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457515 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:39.458573 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457517 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457521 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457524 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457527 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457530 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457532 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457535 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457538 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457541 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457543 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457546 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457548 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457550 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457554 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457556 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457559 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457562 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457564 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457567 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:39.459155 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457570 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457573 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457575 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457578 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457580 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457583 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457585 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457588 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457591 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457593 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457597 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457601 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457604 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457607 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457610 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457613 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457615 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457618 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457621 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457624 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:39.459633 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457626 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457629 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457632 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457634 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457639 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457642 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457645 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457647 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457650 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457653 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457655 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457658 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457660 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457663 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457666 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457668 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457671 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457673 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457676 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.457678 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:39.460177 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458118 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458124 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458127 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458130 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458133 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458136 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458138 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458141 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458143 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458146 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458148 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458151 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458153 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458156 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458158 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458161 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458165 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458169 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458173 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458177 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:39.460678 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458180 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458183 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458187 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458190 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458193 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458196 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458199 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458202 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458204 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458207 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458209 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458212 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458215 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458217 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458221 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458225 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458227 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458230 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458232 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:39.461191 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458235 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458237 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458240 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458243 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458245 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458247 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458250 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458252 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458255 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458259 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458262 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458265 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458268 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458271 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458273 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458276 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458278 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458281 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458284 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458286 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:39.461679 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458289 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458291 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458294 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458297 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458299 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458301 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458305 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458307 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458310 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458312 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458314 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458317 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458320 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458323 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458325 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458327 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458330 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458332 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458335 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458337 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:39.462189 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458339 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458343 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458346 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458349 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458351 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458355 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458358 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458360 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458362 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458365 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458367 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458370 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458372 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458375 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458377 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458380 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458382 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458385 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.458387 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458475 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 23:02:39.462722 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458487 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458497 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458504 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458508 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458511 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458515 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458519 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458523 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458526 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458530 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458533 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458536 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458539 2567 flags.go:64] FLAG: --cgroup-root="" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458544 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458547 2567 flags.go:64] FLAG: --client-ca-file="" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458550 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458553 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458557 2567 flags.go:64] FLAG: --cluster-domain="" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458560 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458563 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458566 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458569 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458573 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 23:02:39.463249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458576 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458580 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458583 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458586 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458589 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458592 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458595 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458598 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458604 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458609 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458611 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458614 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458617 2567 flags.go:64] FLAG: --enable-server="true" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458621 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458635 2567 flags.go:64] FLAG: --event-burst="100" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458639 2567 flags.go:64] FLAG: --event-qps="50" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458641 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458644 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458648 2567 flags.go:64] FLAG: --eviction-hard="" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458652 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458655 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458658 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458662 2567 flags.go:64] FLAG: --eviction-soft="" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458665 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458668 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 23:02:39.463823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458671 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458675 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458678 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458680 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458683 2567 flags.go:64] FLAG: --feature-gates="" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458687 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458690 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458693 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458696 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458717 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458720 2567 flags.go:64] FLAG: --help="false" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458723 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458727 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458729 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458732 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458737 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458742 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458745 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458748 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458751 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458753 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458757 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458760 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458762 2567 flags.go:64] FLAG: --kube-reserved="" Jun 03 23:02:39.464427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458765 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458768 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458772 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458775 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458778 2567 flags.go:64] FLAG: --lock-file="" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458783 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458786 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458789 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458794 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458797 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458800 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458803 2567 flags.go:64] FLAG: --logging-format="text" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458806 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458809 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458812 2567 flags.go:64] FLAG: --manifest-url="" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458815 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458819 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458822 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458827 2567 flags.go:64] FLAG: --max-pods="110" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458829 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458833 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458836 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458839 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458843 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458846 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 23:02:39.465048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458849 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458858 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458860 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458863 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458866 2567 flags.go:64] FLAG: --pod-cidr="" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458869 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458875 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458878 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458881 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458883 2567 flags.go:64] FLAG: --port="10250" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458886 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458889 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c3c9c1a5827ca489" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458892 2567 flags.go:64] FLAG: --qos-reserved="" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458897 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458900 2567 flags.go:64] FLAG: --register-node="true" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458903 2567 flags.go:64] FLAG: --register-with-taints="" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458907 2567 flags.go:64] FLAG: --registry-burst="10" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458910 2567 flags.go:64] FLAG: --registry-qps="5" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458913 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458915 2567 flags.go:64] FLAG: --reserved-memory="" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458920 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458923 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458925 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458929 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458932 2567 flags.go:64] FLAG: --runonce="false" Jun 03 23:02:39.465669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458934 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458937 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458940 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458943 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458946 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458950 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458953 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458956 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458959 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458963 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458965 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458968 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458971 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458974 2567 flags.go:64] FLAG: --system-cgroups="" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458977 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458982 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458984 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458987 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458991 2567 flags.go:64] FLAG: --tls-min-version="" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458994 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.458998 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459001 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459004 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459006 2567 flags.go:64] FLAG: --v="2" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459011 2567 flags.go:64] FLAG: --version="false" Jun 03 23:02:39.466304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459015 2567 flags.go:64] FLAG: --vmodule="" Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459018 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459022 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459145 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459148 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459151 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459154 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459157 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459160 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459164 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459168 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459171 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459177 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459179 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459182 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459185 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459187 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459190 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459193 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459196 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:39.466974 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459199 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459202 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459204 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459206 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459211 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459214 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459217 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459220 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459223 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459226 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459228 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459231 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459233 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459236 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459238 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459241 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459243 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459246 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459248 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:39.467472 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459251 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459253 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459255 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459258 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459260 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459264 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459267 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459269 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459272 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459275 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459277 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459280 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459285 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459288 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459290 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459293 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459296 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459298 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459300 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:39.467950 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459303 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459306 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459309 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459312 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459314 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459316 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459319 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459321 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459324 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459326 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459329 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459331 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459333 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459337 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459340 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459343 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459346 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459350 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459353 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459355 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:39.468431 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459358 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459360 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459362 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459365 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459368 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459370 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459373 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459375 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459377 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459380 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459382 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459385 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459388 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459390 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459393 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459395 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459398 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459400 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459402 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459405 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:39.468932 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459407 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.459410 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.459415 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.467399 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.467420 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.468471 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.468483 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468564 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468569 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468572 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468575 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468578 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468580 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468583 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:39.469580 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468586 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468588 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468591 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468593 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468596 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468599 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468601 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468604 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468607 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468609 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468613 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468624 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468627 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468630 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468633 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468636 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468640 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468644 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468648 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:39.470129 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468651 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468654 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468656 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468665 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468668 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468670 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468673 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468675 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468678 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468680 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468683 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468685 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468688 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468691 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468694 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468696 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468699 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468719 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468722 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468724 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468727 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:39.470879 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468730 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468732 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468735 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468738 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468740 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468743 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468746 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468749 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468753 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468756 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468759 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468762 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468765 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468768 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468771 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468779 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468783 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468785 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468788 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:39.471389 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468790 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468793 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468796 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468798 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468801 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468803 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468806 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468808 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468811 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468813 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468816 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468818 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468821 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468823 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468826 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468828 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468831 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468833 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468835 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468838 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:39.471887 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468841 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468843 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468846 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468849 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468851 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468854 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468857 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468859 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468861 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468869 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468872 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.468875 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.468880 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469686 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469727 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:02:39.472363 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469735 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469744 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469751 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469759 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469766 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469772 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469780 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469787 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469794 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469801 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469812 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469816 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469821 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469824 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469828 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469833 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469841 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469847 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469853 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:02:39.472798 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469858 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469862 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469867 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469872 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469882 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469886 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469890 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469895 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469932 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469937 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469941 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469945 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469949 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469954 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469958 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469962 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469972 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469977 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469981 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469986 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:02:39.473260 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469990 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469994 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.469999 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470003 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470007 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470012 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470016 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470021 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470025 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470035 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470040 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470044 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470050 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470056 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470063 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470069 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470074 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470079 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470083 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:02:39.473790 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470088 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470093 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470132 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470137 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470142 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470147 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470152 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470156 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470160 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470164 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470169 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470173 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470177 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470181 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470190 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470195 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470200 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470204 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470208 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470212 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:02:39.474298 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470216 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470220 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470224 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470228 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470232 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470237 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470241 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470250 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470255 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470259 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470263 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470267 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470273 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470277 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470281 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470315 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470320 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:02:39.474815 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:39.470324 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:02:39.475227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.470334 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:02:39.475227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.470932 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 23:02:39.475227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.473577 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 23:02:39.475227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.475223 2567 server.go:1019] "Starting client certificate rotation" Jun 03 23:02:39.475369 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.475343 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:02:39.475418 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.475395 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:02:39.479206 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.479185 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:02:39.480486 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.480468 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:02:39.491812 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.491792 2567 log.go:25] "Validated CRI v1 runtime API" Jun 03 23:02:39.496831 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.496814 2567 log.go:25] "Validated CRI v1 image API" Jun 03 23:02:39.497613 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.497598 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 23:02:39.500469 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.500448 2567 fs.go:135] Filesystem UUIDs: map[61443734-be34-4e19-a37e-13ea1d7ab507:/dev/nvme0n1p3 676ac596-8644-4cc2-85e2-bc81f1014665:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 03 23:02:39.500541 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.500468 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 23:02:39.507822 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.507689 2567 manager.go:216] Machine: {Timestamp:2026-06-03 23:02:39.506184291 +0000 UTC m=+0.378860143 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087560 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ffb7222d2a3d0f355d310db9db45f SystemUUID:ec2ffb72-22d2-a3d0-f355-d310db9db45f BootID:8917fe66-71b4-451f-b84e-68bf4cfe1a0e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:6a:02:25:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:6a:02:25:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:d9:43:6b:b0:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 23:02:39.507822 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.507815 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 23:02:39.507935 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.507904 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 23:02:39.508206 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.508187 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:02:39.509883 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.509854 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 23:02:39.510027 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.509886 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 23:02:39.510679 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.510669 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 23:02:39.510726 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.510682 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 23:02:39.510726 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.510690 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:02:39.511509 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.511499 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:02:39.512733 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.512722 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 23:02:39.517227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517214 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:02:39.517354 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517345 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 23:02:39.517387 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517375 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 03 23:02:39.517417 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517393 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 23:02:39.517446 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517434 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 23:02:39.517446 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517444 2567 kubelet.go:398] "Adding apiserver pod source" Jun 03 23:02:39.517532 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.517454 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 23:02:39.518065 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.518052 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:02:39.518107 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.518072 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:02:39.527676 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.527356 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 23:02:39.529902 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.529883 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kkxcx" Jun 03 23:02:39.529983 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.529922 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 23:02:39.529983 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.529969 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 23:02:39.531412 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.531393 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 23:02:39.531458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531414 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 23:02:39.531458 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.531421 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 23:02:39.531458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531436 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 23:02:39.531458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531446 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 23:02:39.531458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531453 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531463 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531470 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531479 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531485 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531493 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531500 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531510 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 23:02:39.531594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.531517 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 23:02:39.532478 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.532468 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 23:02:39.532508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.532481 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 23:02:39.535192 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.535176 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kkxcx" Jun 03 23:02:39.537320 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.537305 2567 server.go:1268] "Started kubelet" Jun 03 23:02:39.537407 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.537382 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 23:02:39.537596 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.537495 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 23:02:39.537698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.537616 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 23:02:39.538391 ip-10-0-134-57 systemd[1]: Started Kubernetes Kubelet. Jun 03 23:02:39.539186 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.539168 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 23:02:39.540067 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.540052 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 03 23:02:39.540902 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.540882 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 23:02:39.544998 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.544981 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 23:02:39.546343 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.546329 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 23:02:39.546343 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.546334 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 23:02:39.546793 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.546495 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:39.547127 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547108 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 23:02:39.547237 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547110 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 23:02:39.547237 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547165 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 23:02:39.547237 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547210 2567 factory.go:55] Registering systemd factory Jun 03 23:02:39.547237 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547238 2567 factory.go:223] Registration of the systemd container factory successfully Jun 03 23:02:39.547404 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547313 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 03 23:02:39.547404 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547323 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 03 23:02:39.547478 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547466 2567 factory.go:153] Registering CRI-O factory Jun 03 23:02:39.547512 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547481 2567 factory.go:223] Registration of the crio container factory successfully Jun 03 23:02:39.547544 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547521 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 23:02:39.547674 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547546 2567 factory.go:103] Registering Raw factory Jun 03 23:02:39.547722 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.547680 2567 manager.go:1196] Started watching for new ooms in manager Jun 03 23:02:39.548114 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.548098 2567 manager.go:349] Starting recovery of all containers Jun 03 23:02:39.553736 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.553695 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:39.557113 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.557080 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-57.ec2.internal\" not found" node="ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.560753 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.560734 2567 manager.go:354] Recovery completed Jun 03 23:02:39.566658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.566641 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.568667 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.568653 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.568756 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.568682 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.568756 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.568697 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.569284 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569270 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 23:02:39.569337 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569284 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.569337 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569283 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 23:02:39.569431 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569357 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:02:39.569942 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569927 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.569997 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569953 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.569997 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.569963 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.571310 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.571297 2567 policy_none.go:49] "None policy: Start" Jun 03 23:02:39.571373 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.571316 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 23:02:39.571373 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.571330 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 23:02:39.573029 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.573017 2567 policy_none.go:47] "Start" Jun 03 23:02:39.614433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614415 2567 manager.go:337] "Starting Device Plugin manager" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.614457 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614469 2567 server.go:87] "Starting device plugin registration server" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614754 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614770 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614867 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614953 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.614961 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.616595 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.616650 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.628271 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.629760 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.629794 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.629815 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.629845 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 23:02:39.635938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.632830 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:39.715383 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.715289 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.716272 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.716255 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.716375 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.716285 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.716375 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.716303 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.716375 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.716330 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.727043 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.727021 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.727095 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.727047 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-57.ec2.internal\": node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:39.730656 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.730637 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal"] Jun 03 23:02:39.730728 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.730718 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.731528 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.731513 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.731601 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.731541 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.731601 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.731558 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.734234 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734222 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.734375 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734355 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.734443 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734394 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.734960 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734936 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.735061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734972 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.735061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734983 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.735061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.734943 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.735061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.735047 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.735061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.735058 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.737215 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.737199 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.737312 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.737225 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:02:39.737897 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.737878 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:02:39.737987 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.737909 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:02:39.737987 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.737921 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:02:39.748286 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.748268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61ecd56d755653003648b18cd86621d4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-57.ec2.internal\" (UID: \"61ecd56d755653003648b18cd86621d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.748368 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.748298 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f80e1e7d9c79b3fcf36263933b1043d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"0f80e1e7d9c79b3fcf36263933b1043d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.748368 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.748325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f80e1e7d9c79b3fcf36263933b1043d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"0f80e1e7d9c79b3fcf36263933b1043d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.754434 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.754417 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-57.ec2.internal\" not found" node="ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.758433 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.758418 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-57.ec2.internal\" not found" node="ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.787102 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.787079 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:39.848859 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.848826 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f80e1e7d9c79b3fcf36263933b1043d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"0f80e1e7d9c79b3fcf36263933b1043d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.848859 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.848856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f80e1e7d9c79b3fcf36263933b1043d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"0f80e1e7d9c79b3fcf36263933b1043d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.849038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.848874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61ecd56d755653003648b18cd86621d4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-57.ec2.internal\" (UID: \"61ecd56d755653003648b18cd86621d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.849038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.848916 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61ecd56d755653003648b18cd86621d4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-57.ec2.internal\" (UID: \"61ecd56d755653003648b18cd86621d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.849038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.848929 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f80e1e7d9c79b3fcf36263933b1043d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"0f80e1e7d9c79b3fcf36263933b1043d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.849038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:39.848929 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0f80e1e7d9c79b3fcf36263933b1043d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal\" (UID: \"0f80e1e7d9c79b3fcf36263933b1043d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:39.887633 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.887599 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:39.988761 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:39.988647 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.061277 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.061233 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:40.062357 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.062333 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jun 03 23:02:40.089607 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:40.089577 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.190163 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:40.190122 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.290732 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:40.290620 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.391204 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:40.391171 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.474661 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.474635 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 23:02:40.475292 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.474816 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:02:40.475292 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.474834 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:02:40.491953 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:40.491926 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.517912 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.517876 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:40.541687 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.541613 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 22:57:39 +0000 UTC" deadline="2027-11-22 05:44:09.035220331 +0000 UTC" Jun 03 23:02:40.541687 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.541642 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12870h41m28.49358127s" Jun 03 23:02:40.592990 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:40.592963 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-57.ec2.internal\" not found" Jun 03 23:02:40.605374 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:40.605344 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f80e1e7d9c79b3fcf36263933b1043d.slice/crio-c112fd1555aa1433c1c5eab3f76423c772f2de13bdcc0325c1a0b9b30e763cfd WatchSource:0}: Error finding container c112fd1555aa1433c1c5eab3f76423c772f2de13bdcc0325c1a0b9b30e763cfd: Status 404 returned error can't find the container with id c112fd1555aa1433c1c5eab3f76423c772f2de13bdcc0325c1a0b9b30e763cfd Jun 03 23:02:40.605623 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:40.605596 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ecd56d755653003648b18cd86621d4.slice/crio-740b99a6ab28cfa50a895847b45ef5a6ba01531aa419c3a9570030fc21d1d729 WatchSource:0}: Error finding container 740b99a6ab28cfa50a895847b45ef5a6ba01531aa419c3a9570030fc21d1d729: Status 404 returned error can't find the container with id 740b99a6ab28cfa50a895847b45ef5a6ba01531aa419c3a9570030fc21d1d729 Jun 03 23:02:40.609954 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.609934 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:02:40.632541 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.632489 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" event={"ID":"0f80e1e7d9c79b3fcf36263933b1043d","Type":"ContainerStarted","Data":"c112fd1555aa1433c1c5eab3f76423c772f2de13bdcc0325c1a0b9b30e763cfd"} Jun 03 23:02:40.633578 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.633553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" event={"ID":"61ecd56d755653003648b18cd86621d4","Type":"ContainerStarted","Data":"740b99a6ab28cfa50a895847b45ef5a6ba01531aa419c3a9570030fc21d1d729"} Jun 03 23:02:40.664217 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.664192 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:40.746556 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.746532 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" Jun 03 23:02:40.759334 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.759314 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:02:40.760528 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.760512 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" Jun 03 23:02:40.767175 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:40.767156 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:02:41.374648 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.374622 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:41.518191 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.518161 2567 apiserver.go:52] "Watching apiserver" Jun 03 23:02:41.529333 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.529300 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 23:02:41.529685 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.529662 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-6h7xs","openshift-dns/node-resolver-n6lhv","openshift-image-registry/node-ca-5fbtc","openshift-multus/multus-additional-cni-plugins-2g4cx","openshift-multus/multus-przxk","openshift-network-diagnostics/network-check-target-dw424","kube-system/global-pull-secret-syncer-cwvbb","kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal","openshift-multus/network-metrics-daemon-fc8rp","openshift-network-operator/iptables-alerter-r6nwn","openshift-ovn-kubernetes/ovnkube-node-k9njd","kube-system/konnectivity-agent-24zzr"] Jun 03 23:02:41.532332 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.532309 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.534408 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.534382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.535473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.535449 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.535473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.535465 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 23:02:41.535692 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.535675 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.535797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.535681 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wzxmp\"" Jun 03 23:02:41.538463 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.538446 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.538592 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.538573 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mwr7j\"" Jun 03 23:02:41.538689 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.538670 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.538813 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.538799 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.539162 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.539149 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.540901 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.540882 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-przxk" Jun 03 23:02:41.543398 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.543164 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:41.543398 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.543244 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:41.544511 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.544490 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q9bjb\"" Jun 03 23:02:41.545070 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.545052 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.545169 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.545099 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 23:02:41.545406 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.545382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.545505 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.545409 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.545955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.545937 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 23:02:41.546269 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.546249 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-drfxj\"" Jun 03 23:02:41.546387 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.546291 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 23:02:41.546387 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.546334 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 23:02:41.546762 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.546742 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.546852 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.546747 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rsrmr\"" Jun 03 23:02:41.546852 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.546800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.547046 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.547028 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 23:02:41.547311 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.547291 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 23:02:41.547690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.547669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.549898 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.549880 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.551243 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.551216 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.551335 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.551252 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.551816 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.551794 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h8j6s\"" Jun 03 23:02:41.552379 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.552337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.553558 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.553538 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 23:02:41.553647 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.553577 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bblxh\"" Jun 03 23:02:41.553647 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.553631 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 23:02:41.553741 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.553540 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.553895 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.553875 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.554754 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.554736 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:41.554858 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.554808 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:41.554922 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.554876 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 23:02:41.554973 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.554882 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7nfr7\"" Jun 03 23:02:41.557048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.557027 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.557146 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.557096 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:41.558004 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.557943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 23:02:41.559243 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559222 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 23:02:41.559337 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559225 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 23:02:41.559337 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559266 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 23:02:41.559472 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559454 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 23:02:41.559652 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559618 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 23:02:41.559789 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559719 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x6lf8\"" Jun 03 23:02:41.559871 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559846 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5bj\" (UniqueName: \"kubernetes.io/projected/dcf6da7b-a661-447d-9dfe-2d16944051b5-kube-api-access-7l5bj\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.559947 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-run\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.559947 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559914 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rcl\" (UniqueName: \"kubernetes.io/projected/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-kube-api-access-f5rcl\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.559947 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559939 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-system-cni-dir\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.560071 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.560071 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pz6k\" (UniqueName: \"kubernetes.io/projected/1abf7841-3cac-42c7-8f1b-4443501435a1-kube-api-access-4pz6k\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.560071 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.559993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxpz6\" (UniqueName: \"kubernetes.io/projected/f73352de-0015-447c-bf09-723378f5647b-kube-api-access-xxpz6\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.560071 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560011 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-hostroot\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560245 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-conf-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560245 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-cnibin\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.560245 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560142 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-netns\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560245 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-cni-bin\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560245 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-daemon-config\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-modprobe-d\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-tmp\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-os-release\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560347 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcf6da7b-a661-447d-9dfe-2d16944051b5-cni-binary-copy\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-socket-dir-parent\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-lib-modules\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlm2\" (UniqueName: \"kubernetes.io/projected/0083f679-5603-4b7f-8098-d478a2f9b68a-kube-api-access-twlm2\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560443 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560463 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysctl-conf\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560477 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-system-cni-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-cnibin\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-os-release\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560536 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-multus-certs\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysctl-d\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560580 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-host\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-tuned\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f73352de-0015-447c-bf09-723378f5647b-iptables-alerter-script\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f73352de-0015-447c-bf09-723378f5647b-host-slash\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-etc-kubernetes\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-kubernetes\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-systemd\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-sys\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.560828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mx26\" (UniqueName: \"kubernetes.io/projected/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-kube-api-access-5mx26\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7ae724e-2e2f-46f4-ac73-8234b2e7906e-agent-certs\") pod \"konnectivity-agent-24zzr\" (UID: \"d7ae724e-2e2f-46f4-ac73-8234b2e7906e\") " pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-k8s-cni-cncf-io\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-cni-multus\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560962 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysconfig\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.560995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7ae724e-2e2f-46f4-ac73-8234b2e7906e-konnectivity-ca\") pod \"konnectivity-agent-24zzr\" (UID: \"d7ae724e-2e2f-46f4-ac73-8234b2e7906e\") " pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0083f679-5603-4b7f-8098-d478a2f9b68a-hosts-file\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561056 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0083f679-5603-4b7f-8098-d478a2f9b68a-tmp-dir\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-host\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-cni-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-var-lib-kubelet\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-serviceca\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561219 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561290 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.561611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.561329 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-kubelet\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.579568 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.579540 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:02:41.628746 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.628661 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2n8kp" Jun 03 23:02:41.638011 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.637986 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2n8kp" Jun 03 23:02:41.648437 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.648405 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 23:02:41.661626 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-run-netns\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.661814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661631 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-etc-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.661814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2km\" (UniqueName: \"kubernetes.io/projected/06857080-8cde-4d5c-8e54-5547cce76b6c-kube-api-access-6n2km\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.661814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzt2\" (UniqueName: \"kubernetes.io/projected/c28a052e-9899-4ca0-97ed-55589e7f4841-kube-api-access-8kzt2\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:41.661814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-socket-dir-parent\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.661814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-socket-dir-parent\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-system-cni-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661937 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-cnibin\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-os-release\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.661984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysctl-d\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662008 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-tuned\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662028 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662027 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-system-cni-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckpn4\" (UniqueName: \"kubernetes.io/projected/4c003bf9-a316-4a89-9f81-2f0f7a350822-kube-api-access-ckpn4\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.662073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662072 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-kubernetes\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662088 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-os-release\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-systemd\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mx26\" (UniqueName: \"kubernetes.io/projected/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-kube-api-access-5mx26\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-systemd\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662169 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7ae724e-2e2f-46f4-ac73-8234b2e7906e-konnectivity-ca\") pod \"konnectivity-agent-24zzr\" (UID: \"d7ae724e-2e2f-46f4-ac73-8234b2e7906e\") " pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysctl-d\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rcl\" (UniqueName: \"kubernetes.io/projected/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-kube-api-access-f5rcl\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662251 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-cni-multus\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysconfig\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0083f679-5603-4b7f-8098-d478a2f9b68a-tmp-dir\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-kubernetes\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-cni-multus\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysconfig\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.662671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-cnibin\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662808 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662877 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0083f679-5603-4b7f-8098-d478a2f9b68a-tmp-dir\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662915 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-sys-fs\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-node-log\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7ae724e-2e2f-46f4-ac73-8234b2e7906e-konnectivity-ca\") pod \"konnectivity-agent-24zzr\" (UID: \"d7ae724e-2e2f-46f4-ac73-8234b2e7906e\") " pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.662999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-cni-netd\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-var-lib-kubelet\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663102 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-env-overrides\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663124 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-kubelet\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663152 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5bj\" (UniqueName: \"kubernetes.io/projected/dcf6da7b-a661-447d-9dfe-2d16944051b5-kube-api-access-7l5bj\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663156 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-var-lib-kubelet\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663190 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-run\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-kubelet\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663221 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663249 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pz6k\" (UniqueName: \"kubernetes.io/projected/1abf7841-3cac-42c7-8f1b-4443501435a1-kube-api-access-4pz6k\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.663321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-run\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-etc-selinux\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-systemd-units\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-slash\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663353 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-conf-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-cnibin\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663393 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-device-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663417 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-systemd\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-ovn\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663464 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663490 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-netns\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-daemon-config\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-modprobe-d\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663609 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-tmp\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663639 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-socket-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663665 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-registration-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663780 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-netns\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.664179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-var-lib-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-cnibin\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663831 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663840 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663864 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-conf-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.663924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcf6da7b-a661-447d-9dfe-2d16944051b5-cni-binary-copy\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-lib-modules\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664093 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlm2\" (UniqueName: \"kubernetes.io/projected/0083f679-5603-4b7f-8098-d478a2f9b68a-kube-api-access-twlm2\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664099 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-modprobe-d\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-ovnkube-config\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-daemon-config\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7ae724e-2e2f-46f4-ac73-8234b2e7906e-agent-certs\") pod \"konnectivity-agent-24zzr\" (UID: \"d7ae724e-2e2f-46f4-ac73-8234b2e7906e\") " pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664222 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-lib-modules\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664278 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysctl-conf\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664308 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-multus-certs\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664334 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-host\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664365 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-kubelet-config\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcf6da7b-a661-447d-9dfe-2d16944051b5-cni-binary-copy\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664392 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-ovnkube-script-lib\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664421 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f73352de-0015-447c-bf09-723378f5647b-iptables-alerter-script\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664446 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f73352de-0015-447c-bf09-723378f5647b-host-slash\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-etc-kubernetes\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-sys\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0083f679-5603-4b7f-8098-d478a2f9b68a-hosts-file\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664531 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-sysctl-conf\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-system-cni-dir\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664587 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-system-cni-dir\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664637 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0083f679-5603-4b7f-8098-d478a2f9b68a-hosts-file\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664685 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-multus-certs\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-host\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.665778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f73352de-0015-447c-bf09-723378f5647b-host-slash\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-sys\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664879 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-k8s-cni-cncf-io\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-etc-kubernetes\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664942 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-host\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-dbus\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.664995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665002 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-run-k8s-cni-cncf-io\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665049 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-cni-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-host\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-serviceca\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665101 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-cni-bin\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-multus-cni-dir\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665161 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06857080-8cde-4d5c-8e54-5547cce76b6c-ovn-node-metrics-cert\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665205 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f73352de-0015-447c-bf09-723378f5647b-iptables-alerter-script\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxpz6\" (UniqueName: \"kubernetes.io/projected/f73352de-0015-447c-bf09-723378f5647b-kube-api-access-xxpz6\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.666473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-hostroot\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-kubelet\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665467 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-hostroot\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665468 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-log-socket\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-serviceca\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665504 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-cni-bin\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-os-release\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665563 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcf6da7b-a661-447d-9dfe-2d16944051b5-host-var-lib-cni-bin\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665624 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1abf7841-3cac-42c7-8f1b-4443501435a1-os-release\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.665888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1abf7841-3cac-42c7-8f1b-4443501435a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.666490 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-etc-tuned\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.667110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.666648 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-tmp\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.667546 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.667296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7ae724e-2e2f-46f4-ac73-8234b2e7906e-agent-certs\") pod \"konnectivity-agent-24zzr\" (UID: \"d7ae724e-2e2f-46f4-ac73-8234b2e7906e\") " pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.695581 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.695548 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:41.695581 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.695581 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:41.695581 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.695596 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:41.695904 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.695681 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:02:42.195656727 +0000 UTC m=+3.068332557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:41.695980 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.695946 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5bj\" (UniqueName: \"kubernetes.io/projected/dcf6da7b-a661-447d-9dfe-2d16944051b5-kube-api-access-7l5bj\") pod \"multus-przxk\" (UID: \"dcf6da7b-a661-447d-9dfe-2d16944051b5\") " pod="openshift-multus/multus-przxk" Jun 03 23:02:41.696484 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.696461 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pz6k\" (UniqueName: \"kubernetes.io/projected/1abf7841-3cac-42c7-8f1b-4443501435a1-kube-api-access-4pz6k\") pod \"multus-additional-cni-plugins-2g4cx\" (UID: \"1abf7841-3cac-42c7-8f1b-4443501435a1\") " pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.696484 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.696471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mx26\" (UniqueName: \"kubernetes.io/projected/8e15829c-7b4b-4638-9fdf-d3f242d4f42f-kube-api-access-5mx26\") pod \"tuned-6h7xs\" (UID: \"8e15829c-7b4b-4638-9fdf-d3f242d4f42f\") " pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.697670 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.697650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rcl\" (UniqueName: \"kubernetes.io/projected/119ffaff-1d2f-4fd7-8f1d-24db7f0aa517-kube-api-access-f5rcl\") pod \"node-ca-5fbtc\" (UID: \"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517\") " pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.698171 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.698153 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxpz6\" (UniqueName: \"kubernetes.io/projected/f73352de-0015-447c-bf09-723378f5647b-kube-api-access-xxpz6\") pod \"iptables-alerter-r6nwn\" (UID: \"f73352de-0015-447c-bf09-723378f5647b\") " pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.704263 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.704237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlm2\" (UniqueName: \"kubernetes.io/projected/0083f679-5603-4b7f-8098-d478a2f9b68a-kube-api-access-twlm2\") pod \"node-resolver-n6lhv\" (UID: \"0083f679-5603-4b7f-8098-d478a2f9b68a\") " pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.766323 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-run-netns\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766350 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-etc-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2km\" (UniqueName: \"kubernetes.io/projected/06857080-8cde-4d5c-8e54-5547cce76b6c-kube-api-access-6n2km\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766401 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzt2\" (UniqueName: \"kubernetes.io/projected/c28a052e-9899-4ca0-97ed-55589e7f4841-kube-api-access-8kzt2\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-run-netns\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckpn4\" (UniqueName: \"kubernetes.io/projected/4c003bf9-a316-4a89-9f81-2f0f7a350822-kube-api-access-ckpn4\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766477 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.766508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766500 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-sys-fs\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-etc-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766524 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766548 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-node-log\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-cni-netd\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766597 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-env-overrides\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-etc-selinux\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.766648 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766665 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-systemd-units\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766675 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-cni-netd\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766688 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-slash\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766732 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-node-log\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.766741 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:42.266719909 +0000 UTC m=+3.139395727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766758 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-systemd-units\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.766768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-device-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-etc-selinux\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766789 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-systemd\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-device-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766811 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-slash\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-ovn\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766836 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766852 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-sys-fs\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766865 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-socket-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-ovn\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766895 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-systemd\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-registration-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766925 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-var-lib-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-registration-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766950 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766980 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-ovnkube-config\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-run-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-kubelet-config\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c003bf9-a316-4a89-9f81-2f0f7a350822-socket-dir\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767035 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-ovnkube-script-lib\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-dbus\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767101 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-cni-bin\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767150 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-env-overrides\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767159 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06857080-8cde-4d5c-8e54-5547cce76b6c-ovn-node-metrics-cert\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-kubelet\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-log-socket\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-log-socket\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767275 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-kubelet\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.766981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-var-lib-openvswitch\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767394 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-dbus\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06857080-8cde-4d5c-8e54-5547cce76b6c-host-cni-bin\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.767658 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.767470 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:41.768291 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767473 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-ovnkube-config\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.768291 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/06857080-8cde-4d5c-8e54-5547cce76b6c-ovnkube-script-lib\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.768291 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.767478 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-kubelet-config\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:41.768291 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:41.767519 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:42.2675034 +0000 UTC m=+3.140179233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:41.769506 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.769483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/06857080-8cde-4d5c-8e54-5547cce76b6c-ovn-node-metrics-cert\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.779617 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.779593 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckpn4\" (UniqueName: \"kubernetes.io/projected/4c003bf9-a316-4a89-9f81-2f0f7a350822-kube-api-access-ckpn4\") pod \"aws-ebs-csi-driver-node-n66fl\" (UID: \"4c003bf9-a316-4a89-9f81-2f0f7a350822\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.779862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.779842 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2km\" (UniqueName: \"kubernetes.io/projected/06857080-8cde-4d5c-8e54-5547cce76b6c-kube-api-access-6n2km\") pod \"ovnkube-node-k9njd\" (UID: \"06857080-8cde-4d5c-8e54-5547cce76b6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:41.781737 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.781699 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzt2\" (UniqueName: \"kubernetes.io/projected/c28a052e-9899-4ca0-97ed-55589e7f4841-kube-api-access-8kzt2\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:41.827851 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.827819 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:02:41.846226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.846203 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r6nwn" Jun 03 23:02:41.854412 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.854390 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6lhv" Jun 03 23:02:41.865293 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.865265 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5fbtc" Jun 03 23:02:41.869045 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.869022 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" Jun 03 23:02:41.876823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.876805 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-przxk" Jun 03 23:02:41.884417 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.884397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" Jun 03 23:02:41.891415 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.891394 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:02:41.899235 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.899211 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" Jun 03 23:02:41.903849 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:41.903829 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:02:42.270332 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.270232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:42.270332 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.270304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:42.270563 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.270337 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:42.270563 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270398 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:42.270563 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270452 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:42.270563 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270464 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:43.270448897 +0000 UTC m=+4.143124718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:42.270563 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270508 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:43.270490026 +0000 UTC m=+4.143165854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:42.270845 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270588 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:42.270845 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270599 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:42.270845 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270608 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:42.270845 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.270634 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:02:43.270626425 +0000 UTC m=+4.143302262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:42.434549 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.434320 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06857080_8cde_4d5c_8e54_5547cce76b6c.slice/crio-9afbec9f50b95f9dc5131105dfac754f83d59009c2f8178ddc8be82d7ead7c90 WatchSource:0}: Error finding container 9afbec9f50b95f9dc5131105dfac754f83d59009c2f8178ddc8be82d7ead7c90: Status 404 returned error can't find the container with id 9afbec9f50b95f9dc5131105dfac754f83d59009c2f8178ddc8be82d7ead7c90 Jun 03 23:02:42.435341 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.435320 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119ffaff_1d2f_4fd7_8f1d_24db7f0aa517.slice/crio-c04680dce111c2eefea824ccf0150921650767092c5c76b5e4fbe402d5fd60b5 WatchSource:0}: Error finding container c04680dce111c2eefea824ccf0150921650767092c5c76b5e4fbe402d5fd60b5: Status 404 returned error can't find the container with id c04680dce111c2eefea824ccf0150921650767092c5c76b5e4fbe402d5fd60b5 Jun 03 23:02:42.436169 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.436141 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf6da7b_a661_447d_9dfe_2d16944051b5.slice/crio-1afbd7b833f240ee9b0867b9040fe5b49a7b3fdc9510d7b3d8c3eceb1c94adb1 WatchSource:0}: Error finding container 1afbd7b833f240ee9b0867b9040fe5b49a7b3fdc9510d7b3d8c3eceb1c94adb1: Status 404 returned error can't find the container with id 1afbd7b833f240ee9b0867b9040fe5b49a7b3fdc9510d7b3d8c3eceb1c94adb1 Jun 03 23:02:42.459624 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.459596 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ae724e_2e2f_46f4_ac73_8234b2e7906e.slice/crio-3877302caf32544a9a52fcdfad98f11a257d051874c0e3e8632f1b97130929fd WatchSource:0}: Error finding container 3877302caf32544a9a52fcdfad98f11a257d051874c0e3e8632f1b97130929fd: Status 404 returned error can't find the container with id 3877302caf32544a9a52fcdfad98f11a257d051874c0e3e8632f1b97130929fd Jun 03 23:02:42.460576 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.460552 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73352de_0015_447c_bf09_723378f5647b.slice/crio-96dd4132b269d6ebee4460e488372fa4b602dc12e61fd723be2d4593244c8b27 WatchSource:0}: Error finding container 96dd4132b269d6ebee4460e488372fa4b602dc12e61fd723be2d4593244c8b27: Status 404 returned error can't find the container with id 96dd4132b269d6ebee4460e488372fa4b602dc12e61fd723be2d4593244c8b27 Jun 03 23:02:42.461122 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.461075 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e15829c_7b4b_4638_9fdf_d3f242d4f42f.slice/crio-00cbd43207dc50d3825c47b516591ee4d2a22e78c59939f3e53c9b439bab01db WatchSource:0}: Error finding container 00cbd43207dc50d3825c47b516591ee4d2a22e78c59939f3e53c9b439bab01db: Status 404 returned error can't find the container with id 00cbd43207dc50d3825c47b516591ee4d2a22e78c59939f3e53c9b439bab01db Jun 03 23:02:42.461878 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.461859 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abf7841_3cac_42c7_8f1b_4443501435a1.slice/crio-fc881ccbeaf1081fcac97b0f73625a068a5ab7ccc418ed9aa34862b03ee1d9e9 WatchSource:0}: Error finding container fc881ccbeaf1081fcac97b0f73625a068a5ab7ccc418ed9aa34862b03ee1d9e9: Status 404 returned error can't find the container with id fc881ccbeaf1081fcac97b0f73625a068a5ab7ccc418ed9aa34862b03ee1d9e9 Jun 03 23:02:42.462842 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:02:42.462723 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0083f679_5603_4b7f_8098_d478a2f9b68a.slice/crio-ee25923ffbe9917cc8782b776d7067989d1c288623a506e96b442529dc3da279 WatchSource:0}: Error finding container ee25923ffbe9917cc8782b776d7067989d1c288623a506e96b442529dc3da279: Status 404 returned error can't find the container with id ee25923ffbe9917cc8782b776d7067989d1c288623a506e96b442529dc3da279 Jun 03 23:02:42.630808 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.630780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:42.631201 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:42.630885 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:42.640557 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.640528 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5fbtc" event={"ID":"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517","Type":"ContainerStarted","Data":"c04680dce111c2eefea824ccf0150921650767092c5c76b5e4fbe402d5fd60b5"} Jun 03 23:02:42.641611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.641572 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:57:41 +0000 UTC" deadline="2028-02-24 06:08:07.58720408 +0000 UTC" Jun 03 23:02:42.641611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.641597 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15127h5m24.945610063s" Jun 03 23:02:42.642596 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.642571 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"9afbec9f50b95f9dc5131105dfac754f83d59009c2f8178ddc8be82d7ead7c90"} Jun 03 23:02:42.644500 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.644475 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6lhv" event={"ID":"0083f679-5603-4b7f-8098-d478a2f9b68a","Type":"ContainerStarted","Data":"ee25923ffbe9917cc8782b776d7067989d1c288623a506e96b442529dc3da279"} Jun 03 23:02:42.646930 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.646904 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerStarted","Data":"fc881ccbeaf1081fcac97b0f73625a068a5ab7ccc418ed9aa34862b03ee1d9e9"} Jun 03 23:02:42.648184 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.648159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6nwn" event={"ID":"f73352de-0015-447c-bf09-723378f5647b","Type":"ContainerStarted","Data":"96dd4132b269d6ebee4460e488372fa4b602dc12e61fd723be2d4593244c8b27"} Jun 03 23:02:42.650446 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.650421 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-24zzr" event={"ID":"d7ae724e-2e2f-46f4-ac73-8234b2e7906e","Type":"ContainerStarted","Data":"3877302caf32544a9a52fcdfad98f11a257d051874c0e3e8632f1b97130929fd"} Jun 03 23:02:42.652578 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.652554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" event={"ID":"61ecd56d755653003648b18cd86621d4","Type":"ContainerStarted","Data":"07c19e22bf52bec0bbec1dedac771b0a08c533c0138f6e3cdb7db44467297ae3"} Jun 03 23:02:42.654204 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.654181 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" event={"ID":"4c003bf9-a316-4a89-9f81-2f0f7a350822","Type":"ContainerStarted","Data":"84682edc3039c13e8328303499fdc06f27d4b40cf731fccd43b590ace75ef531"} Jun 03 23:02:42.655268 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.655248 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" event={"ID":"8e15829c-7b4b-4638-9fdf-d3f242d4f42f","Type":"ContainerStarted","Data":"00cbd43207dc50d3825c47b516591ee4d2a22e78c59939f3e53c9b439bab01db"} Jun 03 23:02:42.656224 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.656203 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-przxk" event={"ID":"dcf6da7b-a661-447d-9dfe-2d16944051b5","Type":"ContainerStarted","Data":"1afbd7b833f240ee9b0867b9040fe5b49a7b3fdc9510d7b3d8c3eceb1c94adb1"} Jun 03 23:02:42.670459 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:42.670417 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-57.ec2.internal" podStartSLOduration=2.67040248 podStartE2EDuration="2.67040248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:42.670064213 +0000 UTC m=+3.542740052" watchObservedRunningTime="2026-06-03 23:02:42.67040248 +0000 UTC m=+3.543078319" Jun 03 23:02:43.280267 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.280225 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:43.280473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.280285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:43.280473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.280333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:43.280473 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.280464 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:43.280645 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.280529 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:45.280509342 +0000 UTC m=+6.153185170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:43.280969 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.280950 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:43.281047 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.280977 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:43.281047 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.280990 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:43.281147 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.281048 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:02:45.281018848 +0000 UTC m=+6.153694673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:43.281147 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.281106 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:43.281147 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.281138 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:45.281126863 +0000 UTC m=+6.153802687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:43.634520 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.634438 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:43.634968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.634543 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:43.634968 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.634613 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:43.634968 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:43.634776 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:43.642467 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.642389 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 22:57:41 +0000 UTC" deadline="2027-11-26 02:38:49.924409956 +0000 UTC" Jun 03 23:02:43.642467 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.642438 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12963h36m6.281975955s" Jun 03 23:02:43.680793 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.680749 2567 generic.go:356] "Generic (PLEG): container finished" podID="0f80e1e7d9c79b3fcf36263933b1043d" containerID="c2e2f7d35914ef51034cc747336a52c6d42199e2a1ffe7a586f0047d1e1a983b" exitCode=0 Jun 03 23:02:43.680970 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:43.680923 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" event={"ID":"0f80e1e7d9c79b3fcf36263933b1043d","Type":"ContainerDied","Data":"c2e2f7d35914ef51034cc747336a52c6d42199e2a1ffe7a586f0047d1e1a983b"} Jun 03 23:02:44.630562 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:44.630526 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:44.630808 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:44.630670 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:44.717584 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:44.717545 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" event={"ID":"0f80e1e7d9c79b3fcf36263933b1043d","Type":"ContainerStarted","Data":"222bc74872a397f8491528001190c6f7e7c140e61ed15d1b30c41e15a6f8f34b"} Jun 03 23:02:44.754957 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:44.754896 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-57.ec2.internal" podStartSLOduration=4.75487596 podStartE2EDuration="4.75487596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:02:44.754624485 +0000 UTC m=+5.627300328" watchObservedRunningTime="2026-06-03 23:02:44.75487596 +0000 UTC m=+5.627551800" Jun 03 23:02:45.299349 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:45.299309 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:45.299547 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:45.299395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:45.299547 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:45.299428 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:45.299664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.299556 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:45.299664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.299623 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:49.299604672 +0000 UTC m=+10.172280497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:45.300061 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.300038 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:45.300142 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.300099 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:49.300083656 +0000 UTC m=+10.172759477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:45.300204 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.300179 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:45.300204 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.300194 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:45.300303 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.300206 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:45.300303 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.300240 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:02:49.300229218 +0000 UTC m=+10.172905044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:45.633175 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:45.633096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:45.633336 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.633219 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:45.633621 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:45.633599 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:45.633750 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:45.633694 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:46.631061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:46.631026 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:46.631539 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:46.631176 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:47.630984 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:47.630951 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:47.631159 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:47.630962 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:47.631159 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:47.631084 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:47.631597 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:47.631190 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:48.631101 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:48.631060 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:48.631256 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:48.631203 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:49.331977 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:49.331934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:49.332157 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:49.331998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:49.332157 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:49.332048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:49.332251 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332198 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:49.332296 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332265 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:57.332246903 +0000 UTC m=+18.204922737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:49.332727 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332689 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:49.332831 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332733 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:49.332831 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332747 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:49.332831 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332795 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:02:57.332779009 +0000 UTC m=+18.205454843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:49.332996 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332843 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:49.332996 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.332903 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:02:57.33288921 +0000 UTC m=+18.205565027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:49.633225 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:49.633147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:49.633748 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.633279 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:49.633748 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:49.633651 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:49.633855 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:49.633744 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:50.631048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:50.630520 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:50.631048 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:50.630679 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:51.631278 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:51.630802 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:51.631278 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:51.630802 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:51.631278 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:51.630951 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:51.631278 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:51.630970 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:52.630289 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:52.630247 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:52.630479 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:52.630388 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:53.630785 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:53.630747 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:53.630785 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:53.630790 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:53.631343 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:53.630895 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:53.631343 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:53.631315 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:54.630244 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:54.630199 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:54.630487 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:54.630325 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:55.630323 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:55.630282 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:55.630820 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:55.630337 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:55.630820 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:55.630451 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:55.630820 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:55.630587 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:56.630038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:56.629997 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:56.630220 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:56.630148 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:57.393777 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:57.393729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:57.393815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:57.393850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.393898 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.393962 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.393979 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.393959044 +0000 UTC m=+34.266634864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.394018 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.394035 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.393999667 +0000 UTC m=+34.266675502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.394044 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.394069 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:57.394253 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.394134 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:03:13.394100021 +0000 UTC m=+34.266775859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:02:57.632227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:57.632192 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:57.632412 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:57.632365 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:57.632500 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.632448 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:02:57.632955 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:57.632930 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:58.630595 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:58.630559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:02:58.631100 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:58.630717 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:02:59.630840 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:59.630806 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:02:59.631289 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:59.630905 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:02:59.631289 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:02:59.631001 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:02:59.631289 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:02:59.631129 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:00.630655 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:00.630617 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:00.630858 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:00.630775 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:01.630717 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.630452 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:01.630877 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:01.630847 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:01.631439 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.630475 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:01.631439 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:01.631029 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:01.755585 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.755553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" event={"ID":"4c003bf9-a316-4a89-9f81-2f0f7a350822","Type":"ContainerStarted","Data":"1e297a388f0c2116499004aa44bfbef03ad5d5a2030b6b44c74b4b8a12abcb2b"} Jun 03 23:03:01.757115 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.757092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" event={"ID":"8e15829c-7b4b-4638-9fdf-d3f242d4f42f","Type":"ContainerStarted","Data":"0f968e23643df8a7cc28ce051a809b257e52b0ee4c0c36a02a0d193982aa94cd"} Jun 03 23:03:01.758597 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.758566 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-przxk" event={"ID":"dcf6da7b-a661-447d-9dfe-2d16944051b5","Type":"ContainerStarted","Data":"4dd8b1c6603f4b151bbc0e67f79e5533ffff82809d1e034a4311fe60ac074973"} Jun 03 23:03:01.759969 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.759938 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5fbtc" event={"ID":"119ffaff-1d2f-4fd7-8f1d-24db7f0aa517","Type":"ContainerStarted","Data":"ae2ec611748627ccd6f81ebc72b4380e169314a48723e7ffc7cc7403eb27af0a"} Jun 03 23:03:01.762224 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.762202 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:03:01.762556 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.762539 2567 generic.go:356] "Generic (PLEG): container finished" podID="06857080-8cde-4d5c-8e54-5547cce76b6c" containerID="95cbe0660e002dc7a24442494c9de6b9c943dd8e9953ae0d748d019d75e2da70" exitCode=1 Jun 03 23:03:01.762622 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.762605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"5bdb8fb917c19bad99acccfaf28cab8087cbeaf982bd5d7c8f9b54a96b402735"} Jun 03 23:03:01.762693 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.762675 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerDied","Data":"95cbe0660e002dc7a24442494c9de6b9c943dd8e9953ae0d748d019d75e2da70"} Jun 03 23:03:01.762820 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.762744 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"ce31b1e0c6fbda83ad8b9e527f50feef3dca8b500a06d3bafffe3bdc7ca2fd23"} Jun 03 23:03:01.764089 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.764070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6lhv" event={"ID":"0083f679-5603-4b7f-8098-d478a2f9b68a","Type":"ContainerStarted","Data":"22cd43de6b390261bb4db2f643a0f4c8d4969b200bfbcb0aa9b1da4684c804d6"} Jun 03 23:03:01.765519 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.765500 2567 generic.go:356] "Generic (PLEG): container finished" podID="1abf7841-3cac-42c7-8f1b-4443501435a1" containerID="e1af76e675ed14c55a9c19d7e2af47b1d71d166c7c25c815e2bf633c4466ca3b" exitCode=0 Jun 03 23:03:01.765598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.765574 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerDied","Data":"e1af76e675ed14c55a9c19d7e2af47b1d71d166c7c25c815e2bf633c4466ca3b"} Jun 03 23:03:01.766849 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.766833 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-24zzr" event={"ID":"d7ae724e-2e2f-46f4-ac73-8234b2e7906e","Type":"ContainerStarted","Data":"d7a7ff570828ba2376c2ecd0f5033cafa02366b0a6b0a509eb20545dc0161a65"} Jun 03 23:03:01.776907 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.776872 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6h7xs" podStartSLOduration=4.079760364 podStartE2EDuration="22.776860545s" totalImagesPullingTime="18.697100181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:01.776299065 +0000 UTC m=+22.648974907" watchObservedRunningTime="2026-06-03 23:03:01.776860545 +0000 UTC m=+22.649536384" Jun 03 23:03:01.791521 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.791480 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5fbtc" podStartSLOduration=4.087125659 podStartE2EDuration="22.791465793s" totalImagesPullingTime="18.704340134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:01.790951989 +0000 UTC m=+22.663627829" watchObservedRunningTime="2026-06-03 23:03:01.791465793 +0000 UTC m=+22.664141633" Jun 03 23:03:01.808948 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.808904 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-przxk" podStartSLOduration=4.064618339 podStartE2EDuration="22.808889863s" totalImagesPullingTime="18.744271524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:01.808358312 +0000 UTC m=+22.681034151" watchObservedRunningTime="2026-06-03 23:03:01.808889863 +0000 UTC m=+22.681565703" Jun 03 23:03:01.839222 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.839179 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n6lhv" podStartSLOduration=4.125319535 podStartE2EDuration="22.839165084s" totalImagesPullingTime="18.713845549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:01.839131248 +0000 UTC m=+22.711807087" watchObservedRunningTime="2026-06-03 23:03:01.839165084 +0000 UTC m=+22.711840914" Jun 03 23:03:01.839743 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:01.839698 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-24zzr" podStartSLOduration=4.142542924 podStartE2EDuration="22.839689089s" totalImagesPullingTime="18.697146165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:01.823473974 +0000 UTC m=+22.696149816" watchObservedRunningTime="2026-06-03 23:03:01.839689089 +0000 UTC m=+22.712364928" Jun 03 23:03:02.423357 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.423195 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 23:03:02.626568 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.626446 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T23:03:02.423351879Z","UUID":"eb005dc1-33bf-46cd-b696-8211f15713ab","Handler":null,"Name":"","Endpoint":""} Jun 03 23:03:02.629511 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.629485 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 23:03:02.629686 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.629534 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 23:03:02.630304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.630277 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:02.630442 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:02.630403 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:02.773185 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.773157 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:03:02.773656 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.773601 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"d156c7202793b1608826829d4589b368ea96fd14743eec3dc2f4e1fa65566af2"} Jun 03 23:03:02.773734 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.773667 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"e83713a239e4287be4bc0c8092cac06599f5db080e2c909975fa411dcf7061ba"} Jun 03 23:03:02.773785 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.773738 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"69dc0c393b1ed7ddcb088dee4f26968dedcfc133c807a84db1a8421962a37c21"} Jun 03 23:03:02.775265 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.775218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r6nwn" event={"ID":"f73352de-0015-447c-bf09-723378f5647b","Type":"ContainerStarted","Data":"daedab070afcc816107ff2c08a47e794836ec65266d0c76a0375d8547e0a45b1"} Jun 03 23:03:02.777087 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.777061 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" event={"ID":"4c003bf9-a316-4a89-9f81-2f0f7a350822","Type":"ContainerStarted","Data":"1a4cc3cada89a40696ab1b7caf7c6c4353d3230e5929cec232df83f2d26ed846"} Jun 03 23:03:02.791996 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:02.791941 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r6nwn" podStartSLOduration=5.095154946 podStartE2EDuration="23.791923672s" totalImagesPullingTime="18.696768726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:02.791513861 +0000 UTC m=+23.664189701" watchObservedRunningTime="2026-06-03 23:03:02.791923672 +0000 UTC m=+23.664599512" Jun 03 23:03:03.630810 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:03.630762 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:03.630960 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:03.630779 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:03.630960 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:03.630912 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:03.630960 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:03.630952 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:03.782474 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:03.782423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" event={"ID":"4c003bf9-a316-4a89-9f81-2f0f7a350822","Type":"ContainerStarted","Data":"af2049ce374f7aea65320237df20a82b0776fa709d619ba403d3f351ba58b083"} Jun 03 23:03:03.804998 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:03.804939 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n66fl" podStartSLOduration=4.131194648 podStartE2EDuration="24.804918776s" totalImagesPullingTime="20.673724128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:03.804503089 +0000 UTC m=+24.677178929" watchObservedRunningTime="2026-06-03 23:03:03.804918776 +0000 UTC m=+24.677594617" Jun 03 23:03:04.630653 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:04.630622 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:04.630835 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:04.630786 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:04.787991 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:04.787961 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:03:04.788547 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:04.788430 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"68938ab5b2e23085cde60fcaa3bf41d3510b3b6d109e9c3afc2da84e8902a010"} Jun 03 23:03:04.935213 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:04.934528 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:03:04.935367 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:04.935215 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:03:05.630354 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:05.630312 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:05.630523 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:05.630433 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:05.630523 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:05.630502 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:05.630655 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:05.630620 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:05.790407 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:05.790369 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:03:05.790999 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:05.790930 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-24zzr" Jun 03 23:03:06.631006 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.630822 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:06.631208 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:06.631112 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:06.795770 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.795740 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:03:06.796346 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.796204 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"88628a86bb6c8eaf63b373221219b145b220804f3fffdf3d930181a8b3e843af"} Jun 03 23:03:06.796480 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.796461 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:03:06.796666 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.796650 2567 scope.go:117] "RemoveContainer" containerID="95cbe0660e002dc7a24442494c9de6b9c943dd8e9953ae0d748d019d75e2da70" Jun 03 23:03:06.798543 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.798512 2567 generic.go:356] "Generic (PLEG): container finished" podID="1abf7841-3cac-42c7-8f1b-4443501435a1" containerID="128cffdd069cc10babefb07a341e29716f326fe4f05b292e1fd394f59d75e68e" exitCode=0 Jun 03 23:03:06.798659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.798607 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerDied","Data":"128cffdd069cc10babefb07a341e29716f326fe4f05b292e1fd394f59d75e68e"} Jun 03 23:03:06.814996 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:06.814975 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:03:07.630094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.630061 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:07.630094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.630096 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:07.630323 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:07.630190 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:07.630323 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:07.630296 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:07.804069 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.803845 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:03:07.804466 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.804389 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" event={"ID":"06857080-8cde-4d5c-8e54-5547cce76b6c","Type":"ContainerStarted","Data":"8a0b1c74af23b149bf9e405b01f7d2d14be4bab77e3ed6323f0a846fa9414f6a"} Jun 03 23:03:07.804655 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.804625 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:03:07.804823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.804689 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:03:07.806623 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.806603 2567 generic.go:356] "Generic (PLEG): container finished" podID="1abf7841-3cac-42c7-8f1b-4443501435a1" containerID="bea89bef00096827e172e3161dd80000942ea7df27e62774b7f567b2e489845e" exitCode=0 Jun 03 23:03:07.806771 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.806687 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerDied","Data":"bea89bef00096827e172e3161dd80000942ea7df27e62774b7f567b2e489845e"} Jun 03 23:03:07.823928 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.823910 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:03:07.837965 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:07.837919 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" podStartSLOduration=10.058187251 podStartE2EDuration="28.837906275s" totalImagesPullingTime="18.779719024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:07.837637729 +0000 UTC m=+28.710313581" watchObservedRunningTime="2026-06-03 23:03:07.837906275 +0000 UTC m=+28.710582115" Jun 03 23:03:08.624461 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.624385 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwvbb"] Jun 03 23:03:08.624599 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.624491 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:08.624599 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:08.624575 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:08.628082 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.627950 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dw424"] Jun 03 23:03:08.628082 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.628055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:08.628256 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:08.628152 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:08.628540 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.628525 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fc8rp"] Jun 03 23:03:08.628625 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.628614 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:08.628734 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:08.628692 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:08.811640 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.811595 2567 generic.go:356] "Generic (PLEG): container finished" podID="1abf7841-3cac-42c7-8f1b-4443501435a1" containerID="ec053f33308021d07875edb680e9f32109a8578dab2eba81903470e4aa5feb04" exitCode=0 Jun 03 23:03:08.812426 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:08.811691 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerDied","Data":"ec053f33308021d07875edb680e9f32109a8578dab2eba81903470e4aa5feb04"} Jun 03 23:03:10.048063 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:10.048025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:10.174743 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:10.174683 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:10.630411 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:10.630376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:10.630603 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:10.630377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:10.630603 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:10.630517 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:10.630603 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:10.630510 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:10.630603 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:10.630582 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:10.630864 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:10.630679 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:10.967045 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:10.967010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:11.062178 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:11.062143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:11.132028 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:11.131996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:12.631545 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:12.630959 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:12.631545 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:12.631005 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:12.631545 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:12.631005 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:12.631545 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:12.631095 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fc8rp" podUID="c28a052e-9899-4ca0-97ed-55589e7f4841" Jun 03 23:03:12.631545 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:12.631193 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwvbb" podUID="ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284" Jun 03 23:03:12.631545 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:12.631279 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dw424" podUID="aec88443-ac3f-434e-aebf-43529b5e34dd" Jun 03 23:03:12.776781 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:12.776580 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:12.898111 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:12.897998 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:12.996392 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:12.996363 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:13.416938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.416854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:13.416938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.416912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:13.416938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.416932 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417011 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417024 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417029 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417042 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417055 2567 projected.go:196] Error preparing data for projected volume kube-api-access-vl5nd for pod openshift-network-diagnostics/network-check-target-dw424: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417081 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs podName:c28a052e-9899-4ca0-97ed-55589e7f4841 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:45.417066051 +0000 UTC m=+66.289741870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs") pod "network-metrics-daemon-fc8rp" (UID: "c28a052e-9899-4ca0-97ed-55589e7f4841") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417092 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret podName:ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:45.417087022 +0000 UTC m=+66.289762839 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret") pod "global-pull-secret-syncer-cwvbb" (UID: "ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:03:13.417183 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:13.417102 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd podName:aec88443-ac3f-434e-aebf-43529b5e34dd nodeName:}" failed. No retries permitted until 2026-06-03 23:03:45.417096694 +0000 UTC m=+66.289772511 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vl5nd" (UniqueName: "kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd") pod "network-check-target-dw424" (UID: "aec88443-ac3f-434e-aebf-43529b5e34dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:03:13.827277 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.827250 2567 generic.go:356] "Generic (PLEG): container finished" podID="1abf7841-3cac-42c7-8f1b-4443501435a1" containerID="581911b5058b9f8f9e15ec6d1395d53e537371dbdefe00a3efcad8c43b38d882" exitCode=0 Jun 03 23:03:13.827627 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.827288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerDied","Data":"581911b5058b9f8f9e15ec6d1395d53e537371dbdefe00a3efcad8c43b38d882"} Jun 03 23:03:13.910156 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.910136 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-57.ec2.internal" event="NodeReady" Jun 03 23:03:13.910299 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.910272 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 23:03:13.933249 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.933227 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:13.946462 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.946430 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64cd5fbb9b-hgg5g"] Jun 03 23:03:13.961026 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.960999 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tn4rt"] Jun 03 23:03:13.961223 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.961192 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:13.964263 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.964231 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 23:03:13.964681 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.964629 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 23:03:13.964925 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.964811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 23:03:13.968676 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.965340 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gw87n\"" Jun 03 23:03:13.972569 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.972549 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 23:03:13.975320 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.975297 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-clp57"] Jun 03 23:03:13.975737 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.975518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:13.978473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.978451 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 23:03:13.978587 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.978515 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2gws\"" Jun 03 23:03:13.978730 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.978690 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 23:03:13.991385 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.991366 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64cd5fbb9b-hgg5g"] Jun 03 23:03:13.991476 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.991396 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tn4rt"] Jun 03 23:03:13.991476 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.991422 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clp57"] Jun 03 23:03:13.991555 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.991484 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:13.994046 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.994026 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 23:03:13.994161 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.994044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 23:03:13.994205 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.994177 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zn6wk\"" Jun 03 23:03:13.994272 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.994259 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 23:03:13.998615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:13.998595 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:14.087529 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.087445 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:14.121564 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121530 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-installation-pull-secrets\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.121564 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-bound-sa-token\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.121774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3910fc8a-96c5-43be-b753-81859eeca4d9-config-volume\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.121774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-certificates\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.121774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmcj\" (UniqueName: \"kubernetes.io/projected/3910fc8a-96c5-43be-b753-81859eeca4d9-kube-api-access-nrmcj\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.121774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/114f9b46-1e69-4668-933c-b2109df0ddf3-ca-trust-extracted\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.121774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3910fc8a-96c5-43be-b753-81859eeca4d9-tmp-dir\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.121774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121764 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81a75ce0-3dea-40c6-859e-8d3c77766c39-cert\") pod \"ingress-canary-clp57\" (UID: \"81a75ce0-3dea-40c6-859e-8d3c77766c39\") " pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.121950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.121950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4gh\" (UniqueName: \"kubernetes.io/projected/81a75ce0-3dea-40c6-859e-8d3c77766c39-kube-api-access-ff4gh\") pod \"ingress-canary-clp57\" (UID: \"81a75ce0-3dea-40c6-859e-8d3c77766c39\") " pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.121950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121848 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-trusted-ca\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.121950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121868 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.121950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121913 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-image-registry-private-configuration\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.122137 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.121970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmtwb\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-kube-api-access-kmtwb\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.187887 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.187856 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:14.223158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223126 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223177 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-image-registry-private-configuration\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223219 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmtwb\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-kube-api-access-kmtwb\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223237 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-installation-pull-secrets\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-bound-sa-token\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223272 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3910fc8a-96c5-43be-b753-81859eeca4d9-config-volume\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.223274 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.223294 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fbb9b-hgg5g: secret "image-registry-tls" not found Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223293 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-certificates\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223324 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmcj\" (UniqueName: \"kubernetes.io/projected/3910fc8a-96c5-43be-b753-81859eeca4d9-kube-api-access-nrmcj\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.223350 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls podName:114f9b46-1e69-4668-933c-b2109df0ddf3 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:14.723328287 +0000 UTC m=+35.596004108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls") pod "image-registry-64cd5fbb9b-hgg5g" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3") : secret "image-registry-tls" not found Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/114f9b46-1e69-4668-933c-b2109df0ddf3-ca-trust-extracted\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223413 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3910fc8a-96c5-43be-b753-81859eeca4d9-tmp-dir\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.223433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223436 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81a75ce0-3dea-40c6-859e-8d3c77766c39-cert\") pod \"ingress-canary-clp57\" (UID: \"81a75ce0-3dea-40c6-859e-8d3c77766c39\") " pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.223906 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.223906 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4gh\" (UniqueName: \"kubernetes.io/projected/81a75ce0-3dea-40c6-859e-8d3c77766c39-kube-api-access-ff4gh\") pod \"ingress-canary-clp57\" (UID: \"81a75ce0-3dea-40c6-859e-8d3c77766c39\") " pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.223906 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-trusted-ca\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.223906 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.223803 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:14.223906 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.223810 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3910fc8a-96c5-43be-b753-81859eeca4d9-tmp-dir\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.223906 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.223879 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls podName:3910fc8a-96c5-43be-b753-81859eeca4d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:14.723859711 +0000 UTC m=+35.596535554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls") pod "dns-default-tn4rt" (UID: "3910fc8a-96c5-43be-b753-81859eeca4d9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:14.224200 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.224004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3910fc8a-96c5-43be-b753-81859eeca4d9-config-volume\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.224200 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.224071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-certificates\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.224324 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.224198 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/114f9b46-1e69-4668-933c-b2109df0ddf3-ca-trust-extracted\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.225187 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.225105 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-trusted-ca\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.227582 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.227562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-installation-pull-secrets\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.227582 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.227572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81a75ce0-3dea-40c6-859e-8d3c77766c39-cert\") pod \"ingress-canary-clp57\" (UID: \"81a75ce0-3dea-40c6-859e-8d3c77766c39\") " pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.227582 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.227572 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-image-registry-private-configuration\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.235448 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.235423 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-bound-sa-token\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.235750 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.235729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmtwb\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-kube-api-access-kmtwb\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.235839 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.235736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmcj\" (UniqueName: \"kubernetes.io/projected/3910fc8a-96c5-43be-b753-81859eeca4d9-kube-api-access-nrmcj\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.236155 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.236133 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4gh\" (UniqueName: \"kubernetes.io/projected/81a75ce0-3dea-40c6-859e-8d3c77766c39-kube-api-access-ff4gh\") pod \"ingress-canary-clp57\" (UID: \"81a75ce0-3dea-40c6-859e-8d3c77766c39\") " pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.287818 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.287781 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:14.347920 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.347842 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-clp57" Jun 03 23:03:14.387781 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.387754 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:14.523475 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.523444 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-clp57"] Jun 03 23:03:14.527676 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:14.527643 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a75ce0_3dea_40c6_859e_8d3c77766c39.slice/crio-7742c85e8b0ed28f1b808dc6603ee984286eb96a3a4944a429950973acf84e54 WatchSource:0}: Error finding container 7742c85e8b0ed28f1b808dc6603ee984286eb96a3a4944a429950973acf84e54: Status 404 returned error can't find the container with id 7742c85e8b0ed28f1b808dc6603ee984286eb96a3a4944a429950973acf84e54 Jun 03 23:03:14.630176 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.630143 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:14.630378 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.630254 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:14.630378 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.630281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:14.633273 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.633247 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:03:14.633414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.633281 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:03:14.633414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.633288 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:03:14.633414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.633251 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:03:14.634304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.634288 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skdgk\"" Jun 03 23:03:14.634392 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.634358 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-256x8\"" Jun 03 23:03:14.728566 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.728530 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:14.728750 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.728579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:14.728750 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.728693 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:14.728750 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.728719 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:14.728750 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.728729 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fbb9b-hgg5g: secret "image-registry-tls" not found Jun 03 23:03:14.728904 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.728779 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls podName:114f9b46-1e69-4668-933c-b2109df0ddf3 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:15.728766587 +0000 UTC m=+36.601442407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls") pod "image-registry-64cd5fbb9b-hgg5g" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3") : secret "image-registry-tls" not found Jun 03 23:03:14.728904 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:14.728792 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls podName:3910fc8a-96c5-43be-b753-81859eeca4d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:15.728786056 +0000 UTC m=+36.601461878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls") pod "dns-default-tn4rt" (UID: "3910fc8a-96c5-43be-b753-81859eeca4d9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:14.833238 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.833202 2567 generic.go:356] "Generic (PLEG): container finished" podID="1abf7841-3cac-42c7-8f1b-4443501435a1" containerID="97d643e537e62a18b89dfa22f5d8f4b5b137947528bf4fefc4ebe868dfa7a087" exitCode=0 Jun 03 23:03:14.833689 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.833279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerDied","Data":"97d643e537e62a18b89dfa22f5d8f4b5b137947528bf4fefc4ebe868dfa7a087"} Jun 03 23:03:14.834542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:14.834510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clp57" event={"ID":"81a75ce0-3dea-40c6-859e-8d3c77766c39","Type":"ContainerStarted","Data":"7742c85e8b0ed28f1b808dc6603ee984286eb96a3a4944a429950973acf84e54"} Jun 03 23:03:15.113593 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:15.113392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:15.735416 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:15.735377 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:15.735664 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:15.735426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:15.735664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:15.735521 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:15.735664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:15.735532 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fbb9b-hgg5g: secret "image-registry-tls" not found Jun 03 23:03:15.735664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:15.735531 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:15.735664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:15.735583 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls podName:114f9b46-1e69-4668-933c-b2109df0ddf3 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.735569688 +0000 UTC m=+38.608245507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls") pod "image-registry-64cd5fbb9b-hgg5g" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3") : secret "image-registry-tls" not found Jun 03 23:03:15.735664 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:15.735596 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls podName:3910fc8a-96c5-43be-b753-81859eeca4d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:17.735590066 +0000 UTC m=+38.608265884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls") pod "dns-default-tn4rt" (UID: "3910fc8a-96c5-43be-b753-81859eeca4d9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:15.840599 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:15.840549 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" event={"ID":"1abf7841-3cac-42c7-8f1b-4443501435a1","Type":"ContainerStarted","Data":"94a110b1481216c262d54b2d2127dabdb8284f90a90f0a9b8b512c7d69cbd80f"} Jun 03 23:03:15.866893 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:15.866660 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2g4cx" podStartSLOduration=8.52637829 podStartE2EDuration="36.866636278s" totalImagesPullingTime="28.340257988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:15.865954493 +0000 UTC m=+36.738630369" watchObservedRunningTime="2026-06-03 23:03:15.866636278 +0000 UTC m=+36.739312120" Jun 03 23:03:15.973835 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:15.973797 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:16.036882 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:16.036808 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:16.187314 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:16.187273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:16.289192 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:16.289094 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:17.751068 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:17.751032 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:17.751564 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:17.751081 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:17.751564 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:17.751169 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:17.751564 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:17.751171 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:17.751564 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:17.751179 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fbb9b-hgg5g: secret "image-registry-tls" not found Jun 03 23:03:17.751564 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:17.751234 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls podName:3910fc8a-96c5-43be-b753-81859eeca4d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:21.751218419 +0000 UTC m=+42.623894237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls") pod "dns-default-tn4rt" (UID: "3910fc8a-96c5-43be-b753-81859eeca4d9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:17.751564 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:17.751308 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls podName:114f9b46-1e69-4668-933c-b2109df0ddf3 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:21.751287637 +0000 UTC m=+42.623963474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls") pod "image-registry-64cd5fbb9b-hgg5g" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3") : secret "image-registry-tls" not found Jun 03 23:03:18.848676 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:18.848638 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-clp57" event={"ID":"81a75ce0-3dea-40c6-859e-8d3c77766c39","Type":"ContainerStarted","Data":"6f053633fa0a0b731859d56867af8f6024db503aa1351822681bd1bdb0c57db5"} Jun 03 23:03:18.865918 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:18.865855 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-clp57" podStartSLOduration=2.609013203 podStartE2EDuration="5.865840287s" totalImagesPullingTime="3.256827084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:18.864723233 +0000 UTC m=+39.737399070" watchObservedRunningTime="2026-06-03 23:03:18.865840287 +0000 UTC m=+39.738516124" Jun 03 23:03:19.430168 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:19.430133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:19.503123 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:19.503092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:19.889551 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:19.889516 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:19.960888 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:19.960859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:20.126398 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.126368 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:20.186586 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.186513 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:20.454265 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.454172 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:20.477335 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.477298 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858"] Jun 03 23:03:20.487269 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.487233 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" Jun 03 23:03:20.490122 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.490101 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 23:03:20.491447 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.491425 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 23:03:20.492689 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.492669 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858"] Jun 03 23:03:20.495607 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.495576 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wstqn\"" Jun 03 23:03:20.571151 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.571117 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:20.577145 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.577126 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv2qj\" (UniqueName: \"kubernetes.io/projected/8f0fba53-e401-405c-b25b-82f896c7768d-kube-api-access-dv2qj\") pod \"migrator-955ffdf5f-52858\" (UID: \"8f0fba53-e401-405c-b25b-82f896c7768d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" Jun 03 23:03:20.669258 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.669228 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:20.678615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.678586 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv2qj\" (UniqueName: \"kubernetes.io/projected/8f0fba53-e401-405c-b25b-82f896c7768d-kube-api-access-dv2qj\") pod \"migrator-955ffdf5f-52858\" (UID: \"8f0fba53-e401-405c-b25b-82f896c7768d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" Jun 03 23:03:20.689653 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.689627 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv2qj\" (UniqueName: \"kubernetes.io/projected/8f0fba53-e401-405c-b25b-82f896c7768d-kube-api-access-dv2qj\") pod \"migrator-955ffdf5f-52858\" (UID: \"8f0fba53-e401-405c-b25b-82f896c7768d\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" Jun 03 23:03:20.796870 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.796785 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" Jun 03 23:03:20.955471 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:20.955292 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858"] Jun 03 23:03:20.965304 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:20.965272 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0fba53_e401_405c_b25b_82f896c7768d.slice/crio-930f83a60bc6d76ee7a46a18ec0be890a55345cd9b1b7c937a5923ef6df3f786 WatchSource:0}: Error finding container 930f83a60bc6d76ee7a46a18ec0be890a55345cd9b1b7c937a5923ef6df3f786: Status 404 returned error can't find the container with id 930f83a60bc6d76ee7a46a18ec0be890a55345cd9b1b7c937a5923ef6df3f786 Jun 03 23:03:21.437540 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.437505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6lhv_0083f679-5603-4b7f-8098-d478a2f9b68a/dns-node-resolver/0.log" Jun 03 23:03:21.718993 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.718900 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2f4tb"] Jun 03 23:03:21.734221 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.734191 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2f4tb"] Jun 03 23:03:21.734399 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.734290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.737303 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.737276 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 23:03:21.737461 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.737324 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 23:03:21.738358 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.738321 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 23:03:21.738495 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.738326 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 23:03:21.738574 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.738557 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7p9wc\"" Jun 03 23:03:21.755548 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.755522 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:21.791893 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.791861 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:21.792064 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.791912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:21.792064 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:21.792010 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:03:21.792064 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:21.792023 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:21.792064 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:21.792042 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fbb9b-hgg5g: secret "image-registry-tls" not found Jun 03 23:03:21.792247 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:21.792100 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls podName:3910fc8a-96c5-43be-b753-81859eeca4d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:29.792078542 +0000 UTC m=+50.664754374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls") pod "dns-default-tn4rt" (UID: "3910fc8a-96c5-43be-b753-81859eeca4d9") : secret "dns-default-metrics-tls" not found Jun 03 23:03:21.792247 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:21.792120 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls podName:114f9b46-1e69-4668-933c-b2109df0ddf3 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:29.792110735 +0000 UTC m=+50.664786553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls") pod "image-registry-64cd5fbb9b-hgg5g" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3") : secret "image-registry-tls" not found Jun 03 23:03:21.824535 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.824495 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:21.856695 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.856663 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" event={"ID":"8f0fba53-e401-405c-b25b-82f896c7768d","Type":"ContainerStarted","Data":"930f83a60bc6d76ee7a46a18ec0be890a55345cd9b1b7c937a5923ef6df3f786"} Jun 03 23:03:21.893151 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.893116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpqw\" (UniqueName: \"kubernetes.io/projected/c5402024-e82e-4fd4-a6a5-a171e87976ba-kube-api-access-vbpqw\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.893321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.893158 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5402024-e82e-4fd4-a6a5-a171e87976ba-signing-key\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.893321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.893236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5402024-e82e-4fd4-a6a5-a171e87976ba-signing-cabundle\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.994624 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.994532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5402024-e82e-4fd4-a6a5-a171e87976ba-signing-key\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.994624 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.994607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5402024-e82e-4fd4-a6a5-a171e87976ba-signing-cabundle\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.995168 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.994698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpqw\" (UniqueName: \"kubernetes.io/projected/c5402024-e82e-4fd4-a6a5-a171e87976ba-kube-api-access-vbpqw\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.995480 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.995454 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c5402024-e82e-4fd4-a6a5-a171e87976ba-signing-cabundle\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:21.998200 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:21.998178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c5402024-e82e-4fd4-a6a5-a171e87976ba-signing-key\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:22.003814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:22.003791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpqw\" (UniqueName: \"kubernetes.io/projected/c5402024-e82e-4fd4-a6a5-a171e87976ba-kube-api-access-vbpqw\") pod \"service-ca-7d74d578b8-2f4tb\" (UID: \"c5402024-e82e-4fd4-a6a5-a171e87976ba\") " pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:22.046355 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:22.046313 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" Jun 03 23:03:22.196873 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:22.196843 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2f4tb"] Jun 03 23:03:22.200257 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:22.200231 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5402024_e82e_4fd4_a6a5_a171e87976ba.slice/crio-2063acfd72dfb156486373a78cca157952d66075b22a0a3c91d33ead89d24e55 WatchSource:0}: Error finding container 2063acfd72dfb156486373a78cca157952d66075b22a0a3c91d33ead89d24e55: Status 404 returned error can't find the container with id 2063acfd72dfb156486373a78cca157952d66075b22a0a3c91d33ead89d24e55 Jun 03 23:03:22.237375 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:22.237346 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5fbtc_119ffaff-1d2f-4fd7-8f1d-24db7f0aa517/node-ca/0.log" Jun 03 23:03:22.753629 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:22.753574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:22.860682 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:22.860646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" event={"ID":"c5402024-e82e-4fd4-a6a5-a171e87976ba","Type":"ContainerStarted","Data":"2063acfd72dfb156486373a78cca157952d66075b22a0a3c91d33ead89d24e55"} Jun 03 23:03:23.040734 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:23.040694 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clp57_81a75ce0-3dea-40c6-859e-8d3c77766c39/serve-healthcheck-canary/0.log" Jun 03 23:03:23.865579 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:23.865539 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" event={"ID":"8f0fba53-e401-405c-b25b-82f896c7768d","Type":"ContainerStarted","Data":"e03a9643e1fba6f9c4befe161c8dd4b0c5aa7a792fbb775a2daccc95a9fa3dcb"} Jun 03 23:03:23.865776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:23.865604 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" event={"ID":"8f0fba53-e401-405c-b25b-82f896c7768d","Type":"ContainerStarted","Data":"039fcfca8a9637862e896d04d96b269d5fc8e028d3d0470d52f08617a6f99fb7"} Jun 03 23:03:23.887491 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:23.887434 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-52858" podStartSLOduration=1.851990713 podStartE2EDuration="3.887415693s" totalImagesPullingTime="2.03542498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:23.88668005 +0000 UTC m=+44.759355905" watchObservedRunningTime="2026-06-03 23:03:23.887415693 +0000 UTC m=+44.760091536" Jun 03 23:03:24.869985 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:24.869950 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" event={"ID":"c5402024-e82e-4fd4-a6a5-a171e87976ba","Type":"ContainerStarted","Data":"1bf9b422ac19726ec7743438fbe043ca511c09b31aaa76215c6026f864e0f474"} Jun 03 23:03:24.887250 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:24.887193 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-2f4tb" podStartSLOduration=1.355201796 podStartE2EDuration="3.887178537s" totalImagesPullingTime="2.531976741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:24.886915661 +0000 UTC m=+45.759591502" watchObservedRunningTime="2026-06-03 23:03:24.887178537 +0000 UTC m=+45.759854377" Jun 03 23:03:25.430797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:25.430763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:26.250321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:26.250285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:26.460013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:26.459981 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:26.561906 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:26.561827 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:26.625210 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:26.625170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:26.719574 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:26.719540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:26.914472 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:26.914396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:27.014972 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:27.014938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:27.747719 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:27.747668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:27.823574 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:27.823542 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:28.342636 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:28.342601 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:28.445925 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:28.445881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:28.545384 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:28.545348 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:28.941635 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:28.941606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:29.146662 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.146617 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:29.351358 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.351324 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:29.860525 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.860492 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:29.860743 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.860541 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") pod \"image-registry-64cd5fbb9b-hgg5g\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:29.860743 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:29.860650 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 23:03:29.860743 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:29.860661 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64cd5fbb9b-hgg5g: secret "image-registry-tls" not found Jun 03 23:03:29.860743 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:29.860732 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls podName:114f9b46-1e69-4668-933c-b2109df0ddf3 nodeName:}" failed. No retries permitted until 2026-06-03 23:03:45.860697173 +0000 UTC m=+66.733372991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls") pod "image-registry-64cd5fbb9b-hgg5g" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3") : secret "image-registry-tls" not found Jun 03 23:03:29.864353 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.864323 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3910fc8a-96c5-43be-b753-81859eeca4d9-metrics-tls\") pod \"dns-default-tn4rt\" (UID: \"3910fc8a-96c5-43be-b753-81859eeca4d9\") " pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:29.885751 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.885723 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:29.940133 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:29.940106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:30.047987 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:30.047957 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tn4rt"] Jun 03 23:03:30.051616 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:30.051588 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3910fc8a_96c5_43be_b753_81859eeca4d9.slice/crio-385d1d85ab3cb807705e04eaff536a9d7bf2f54932707e9a3bfef11e5ca6c310 WatchSource:0}: Error finding container 385d1d85ab3cb807705e04eaff536a9d7bf2f54932707e9a3bfef11e5ca6c310: Status 404 returned error can't find the container with id 385d1d85ab3cb807705e04eaff536a9d7bf2f54932707e9a3bfef11e5ca6c310 Jun 03 23:03:30.059984 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:30.059953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:30.339987 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:30.339867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:30.587676 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:30.587640 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:30.886388 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:30.886304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tn4rt" event={"ID":"3910fc8a-96c5-43be-b753-81859eeca4d9","Type":"ContainerStarted","Data":"385d1d85ab3cb807705e04eaff536a9d7bf2f54932707e9a3bfef11e5ca6c310"} Jun 03 23:03:30.947254 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:30.947213 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:31.008985 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:31.008952 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:31.143227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:31.143145 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:31.346318 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:31.346278 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:32.341498 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.341411 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:32.456737 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.456687 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:32.744056 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.744024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:32.894628 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.894592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tn4rt" event={"ID":"3910fc8a-96c5-43be-b753-81859eeca4d9","Type":"ContainerStarted","Data":"2c4cb541348f275893e49f7bcd55ebf5bcbf2ca491b090f02c1f649cb39b972f"} Jun 03 23:03:32.894842 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.894684 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tn4rt" event={"ID":"3910fc8a-96c5-43be-b753-81859eeca4d9","Type":"ContainerStarted","Data":"2b239774bb4279374b1d7de189c6d24553ed98f84d756324130fd972e123a494"} Jun 03 23:03:32.894842 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.894746 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:32.912683 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.912624 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tn4rt" podStartSLOduration=18.082131398 podStartE2EDuration="19.912606162s" totalImagesPullingTime="1.830474764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:32.911323303 +0000 UTC m=+53.783999146" watchObservedRunningTime="2026-06-03 23:03:32.912606162 +0000 UTC m=+53.785282003" Jun 03 23:03:32.943681 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:32.943648 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:33.152335 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:33.152293 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:33.341983 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:33.341947 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:33.907496 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:33.907460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:34.338807 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:34.338720 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:34.556043 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:34.556007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:34.613741 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:34.613694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:34.739888 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:34.739848 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:34.941265 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:34.941178 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:35.147738 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:35.147694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:35.255963 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:35.255886 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:35.352466 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:35.352431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:35.411409 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:35.411375 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:35.484682 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:35.484651 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:35.912421 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:35.912390 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.065880 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.065842 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.282063 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.281971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.382863 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.382832 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.545672 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.545571 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.686637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.686606 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.787274 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.787244 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:36.950284 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:36.950247 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:37.079526 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:37.079496 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:37.341448 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:37.341366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:38.697938 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:38.697900 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:38.762211 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:38.762176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:39.826153 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:39.826125 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k9njd" Jun 03 23:03:42.774116 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:42.774079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:42.849223 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:42.849188 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:42.901045 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:42.901016 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tn4rt" Jun 03 23:03:43.034522 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.034432 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp"] Jun 03 23:03:43.039478 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.039454 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs"] Jun 03 23:03:43.039602 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.039577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.043334 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.043315 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.044158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.044135 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 23:03:43.044577 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.044560 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 23:03:43.044681 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.044581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 23:03:43.047500 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.047483 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 23:03:43.047793 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.047778 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v766b\"" Jun 03 23:03:43.051313 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.051292 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 23:03:43.051771 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.051748 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp"] Jun 03 23:03:43.054078 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.054060 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs"] Jun 03 23:03:43.065745 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.065719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-tmp\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.065915 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.065839 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-klusterlet-config\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.065915 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.065874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnncc\" (UniqueName: \"kubernetes.io/projected/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-kube-api-access-qnncc\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.119904 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.119868 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64cd5fbb9b-hgg5g"] Jun 03 23:03:43.120099 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:03:43.120079 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" podUID="114f9b46-1e69-4668-933c-b2109df0ddf3" Jun 03 23:03:43.140350 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.140313 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-fppqh"] Jun 03 23:03:43.143327 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.143308 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hl7df"] Jun 03 23:03:43.143443 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.143425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:03:43.146193 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.146173 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cfpvk\"" Jun 03 23:03:43.146882 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.146864 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.147368 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.147338 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 23:03:43.150923 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.147866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 23:03:43.153190 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.153169 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 23:03:43.153316 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.153297 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 23:03:43.153422 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.153360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd8zh\"" Jun 03 23:03:43.153422 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.153370 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 23:03:43.153522 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.153475 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 23:03:43.163133 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.163111 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl7df"] Jun 03 23:03:43.163879 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.163858 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-fppqh"] Jun 03 23:03:43.166303 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.166282 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-tmp\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.166402 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.166326 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-klusterlet-config\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.166402 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.166361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf4zm\" (UniqueName: \"kubernetes.io/projected/abcd00ab-8e6b-4605-a49f-f09813ef6c37-kube-api-access-kf4zm\") pod \"managed-serviceaccount-addon-agent-6d8f686c64-t28qs\" (UID: \"abcd00ab-8e6b-4605-a49f-f09813ef6c37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.166402 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.166382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnncc\" (UniqueName: \"kubernetes.io/projected/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-kube-api-access-qnncc\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.166542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.166427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abcd00ab-8e6b-4605-a49f-f09813ef6c37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d8f686c64-t28qs\" (UID: \"abcd00ab-8e6b-4605-a49f-f09813ef6c37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.166739 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.166719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-tmp\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.170194 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.170174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-klusterlet-config\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.182299 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.182275 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:43.184106 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.184081 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnncc\" (UniqueName: \"kubernetes.io/projected/820b4d2f-d00e-4850-89d5-ff0ed31a23a1-kube-api-access-qnncc\") pod \"klusterlet-addon-workmgr-b58cd985b-lr6jp\" (UID: \"820b4d2f-d00e-4850-89d5-ff0ed31a23a1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.232499 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.232469 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64699c8c76-7wfc7"] Jun 03 23:03:43.236282 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.236267 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.253192 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.253165 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64699c8c76-7wfc7"] Jun 03 23:03:43.267797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.267769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-registry-tls\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.267952 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.267808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5mtb\" (UniqueName: \"kubernetes.io/projected/25db501a-9cc1-41a3-8a67-73fc9224bb31-kube-api-access-x5mtb\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.267952 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.267837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24a1f585-f985-4d31-95b3-0dabeaed934c-installation-pull-secrets\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.267952 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.267891 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24a1f585-f985-4d31-95b3-0dabeaed934c-ca-trust-extracted\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.267952 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.267924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abcd00ab-8e6b-4605-a49f-f09813ef6c37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d8f686c64-t28qs\" (UID: \"abcd00ab-8e6b-4605-a49f-f09813ef6c37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.268090 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.267999 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9qn\" (UniqueName: \"kubernetes.io/projected/e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73-kube-api-access-cf9qn\") pod \"downloads-56b467f5ff-fppqh\" (UID: \"e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73\") " pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:03:43.268090 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268049 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24a1f585-f985-4d31-95b3-0dabeaed934c-trusted-ca\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.268090 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268067 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-bound-sa-token\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.268201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268094 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf4zm\" (UniqueName: \"kubernetes.io/projected/abcd00ab-8e6b-4605-a49f-f09813ef6c37-kube-api-access-kf4zm\") pod \"managed-serviceaccount-addon-agent-6d8f686c64-t28qs\" (UID: \"abcd00ab-8e6b-4605-a49f-f09813ef6c37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.268201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25db501a-9cc1-41a3-8a67-73fc9224bb31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.268201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268144 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24a1f585-f985-4d31-95b3-0dabeaed934c-registry-certificates\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.268201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268163 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25db501a-9cc1-41a3-8a67-73fc9224bb31-crio-socket\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.268201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268189 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24a1f585-f985-4d31-95b3-0dabeaed934c-image-registry-private-configuration\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.268374 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g95w7\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-kube-api-access-g95w7\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.268374 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25db501a-9cc1-41a3-8a67-73fc9224bb31-data-volume\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.268374 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.268304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25db501a-9cc1-41a3-8a67-73fc9224bb31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.270514 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.270495 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abcd00ab-8e6b-4605-a49f-f09813ef6c37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d8f686c64-t28qs\" (UID: \"abcd00ab-8e6b-4605-a49f-f09813ef6c37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.287751 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.287664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf4zm\" (UniqueName: \"kubernetes.io/projected/abcd00ab-8e6b-4605-a49f-f09813ef6c37-kube-api-access-kf4zm\") pod \"managed-serviceaccount-addon-agent-6d8f686c64-t28qs\" (UID: \"abcd00ab-8e6b-4605-a49f-f09813ef6c37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.289335 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.289292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:43.350399 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.350368 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:43.365611 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.365582 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" Jun 03 23:03:43.368904 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.368880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-registry-tls\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.368915 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5mtb\" (UniqueName: \"kubernetes.io/projected/25db501a-9cc1-41a3-8a67-73fc9224bb31-kube-api-access-x5mtb\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.369030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.368943 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24a1f585-f985-4d31-95b3-0dabeaed934c-installation-pull-secrets\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369129 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369083 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24a1f585-f985-4d31-95b3-0dabeaed934c-ca-trust-extracted\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369187 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369129 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9qn\" (UniqueName: \"kubernetes.io/projected/e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73-kube-api-access-cf9qn\") pod \"downloads-56b467f5ff-fppqh\" (UID: \"e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73\") " pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:03:43.369187 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369163 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24a1f585-f985-4d31-95b3-0dabeaed934c-trusted-ca\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369297 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-bound-sa-token\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369297 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25db501a-9cc1-41a3-8a67-73fc9224bb31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.369411 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369388 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24a1f585-f985-4d31-95b3-0dabeaed934c-registry-certificates\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25db501a-9cc1-41a3-8a67-73fc9224bb31-crio-socket\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.369473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/24a1f585-f985-4d31-95b3-0dabeaed934c-ca-trust-extracted\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369471 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24a1f585-f985-4d31-95b3-0dabeaed934c-image-registry-private-configuration\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g95w7\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-kube-api-access-g95w7\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.369580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25db501a-9cc1-41a3-8a67-73fc9224bb31-crio-socket\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.369852 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25db501a-9cc1-41a3-8a67-73fc9224bb31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.369933 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369909 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25db501a-9cc1-41a3-8a67-73fc9224bb31-data-volume\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.369994 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.369965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25db501a-9cc1-41a3-8a67-73fc9224bb31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.370135 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.370109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24a1f585-f985-4d31-95b3-0dabeaed934c-trusted-ca\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.370394 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.370347 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25db501a-9cc1-41a3-8a67-73fc9224bb31-data-volume\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.370644 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.370396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/24a1f585-f985-4d31-95b3-0dabeaed934c-registry-certificates\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.371804 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.371776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-registry-tls\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.372281 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.372232 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/24a1f585-f985-4d31-95b3-0dabeaed934c-image-registry-private-configuration\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.372378 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.372358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/24a1f585-f985-4d31-95b3-0dabeaed934c-installation-pull-secrets\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.373990 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.372754 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25db501a-9cc1-41a3-8a67-73fc9224bb31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.392436 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.392414 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-bound-sa-token\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.392826 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.392789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9qn\" (UniqueName: \"kubernetes.io/projected/e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73-kube-api-access-cf9qn\") pod \"downloads-56b467f5ff-fppqh\" (UID: \"e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73\") " pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:03:43.394642 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.394618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5mtb\" (UniqueName: \"kubernetes.io/projected/25db501a-9cc1-41a3-8a67-73fc9224bb31-kube-api-access-x5mtb\") pod \"insights-runtime-extractor-hl7df\" (UID: \"25db501a-9cc1-41a3-8a67-73fc9224bb31\") " pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.394977 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.394957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g95w7\" (UniqueName: \"kubernetes.io/projected/24a1f585-f985-4d31-95b3-0dabeaed934c-kube-api-access-g95w7\") pod \"image-registry-64699c8c76-7wfc7\" (UID: \"24a1f585-f985-4d31-95b3-0dabeaed934c\") " pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.403030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.403001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:43.456424 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.455998 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:03:43.461595 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.461518 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl7df" Jun 03 23:03:43.532492 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.532452 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp"] Jun 03 23:03:43.537169 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:43.537140 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820b4d2f_d00e_4850_89d5_ff0ed31a23a1.slice/crio-14733b8c434540c97ec7fe6e160c1ac9150558e3aabb507bd56f8c4e136337b5 WatchSource:0}: Error finding container 14733b8c434540c97ec7fe6e160c1ac9150558e3aabb507bd56f8c4e136337b5: Status 404 returned error can't find the container with id 14733b8c434540c97ec7fe6e160c1ac9150558e3aabb507bd56f8c4e136337b5 Jun 03 23:03:43.540646 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.540624 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:43.547954 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.547893 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs"] Jun 03 23:03:43.552158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.551899 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gw87n\"" Jun 03 23:03:43.553339 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:43.553299 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabcd00ab_8e6b_4605_a49f_f09813ef6c37.slice/crio-57d93465d54697daf90ef49ad761ca0aad2b98988b41883bc87ee4531d8320c9 WatchSource:0}: Error finding container 57d93465d54697daf90ef49ad761ca0aad2b98988b41883bc87ee4531d8320c9: Status 404 returned error can't find the container with id 57d93465d54697daf90ef49ad761ca0aad2b98988b41883bc87ee4531d8320c9 Jun 03 23:03:43.559785 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.559745 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.626746 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.626573 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:43.648232 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.648161 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-fppqh"] Jun 03 23:03:43.653014 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:43.652623 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a91dcf_af4f_4a76_8a7c_e20e7efc6f73.slice/crio-2dc0da4901142a7d2b3acbfb8ee84d7ae930b9aca594c6513bc3b15ed8926fde WatchSource:0}: Error finding container 2dc0da4901142a7d2b3acbfb8ee84d7ae930b9aca594c6513bc3b15ed8926fde: Status 404 returned error can't find the container with id 2dc0da4901142a7d2b3acbfb8ee84d7ae930b9aca594c6513bc3b15ed8926fde Jun 03 23:03:43.690227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.690203 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl7df"] Jun 03 23:03:43.692828 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:43.692789 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25db501a_9cc1_41a3_8a67_73fc9224bb31.slice/crio-fe38a624d9cd2b3c9bb681f2c657a5236604ba0047bc5cb43947e7e0f7128e72 WatchSource:0}: Error finding container fe38a624d9cd2b3c9bb681f2c657a5236604ba0047bc5cb43947e7e0f7128e72: Status 404 returned error can't find the container with id fe38a624d9cd2b3c9bb681f2c657a5236604ba0047bc5cb43947e7e0f7128e72 Jun 03 23:03:43.693133 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.693109 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:43.739072 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.739025 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64699c8c76-7wfc7"] Jun 03 23:03:43.744638 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:43.744612 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a1f585_f985_4d31_95b3_0dabeaed934c.slice/crio-59b1d2ba150db5039dd52d46ffbb974e6cacef411915578756cda78ffd74e102 WatchSource:0}: Error finding container 59b1d2ba150db5039dd52d46ffbb974e6cacef411915578756cda78ffd74e102: Status 404 returned error can't find the container with id 59b1d2ba150db5039dd52d46ffbb974e6cacef411915578756cda78ffd74e102 Jun 03 23:03:43.931812 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.931770 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl7df" event={"ID":"25db501a-9cc1-41a3-8a67-73fc9224bb31","Type":"ContainerStarted","Data":"989553ed70b2bb025327723d1de8e605018bf30066993e95f7a1f3f607780a20"} Jun 03 23:03:43.932213 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.931840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl7df" event={"ID":"25db501a-9cc1-41a3-8a67-73fc9224bb31","Type":"ContainerStarted","Data":"fe38a624d9cd2b3c9bb681f2c657a5236604ba0047bc5cb43947e7e0f7128e72"} Jun 03 23:03:43.932943 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.932919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" event={"ID":"abcd00ab-8e6b-4605-a49f-f09813ef6c37","Type":"ContainerStarted","Data":"57d93465d54697daf90ef49ad761ca0aad2b98988b41883bc87ee4531d8320c9"} Jun 03 23:03:43.933954 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.933930 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" event={"ID":"820b4d2f-d00e-4850-89d5-ff0ed31a23a1","Type":"ContainerStarted","Data":"14733b8c434540c97ec7fe6e160c1ac9150558e3aabb507bd56f8c4e136337b5"} Jun 03 23:03:43.935388 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.935366 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" event={"ID":"24a1f585-f985-4d31-95b3-0dabeaed934c","Type":"ContainerStarted","Data":"f2fec1ab55117d20c7896e6619152e9bd826ce32a7c0601145f662ed1c7ba7c6"} Jun 03 23:03:43.935487 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.935404 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" event={"ID":"24a1f585-f985-4d31-95b3-0dabeaed934c","Type":"ContainerStarted","Data":"59b1d2ba150db5039dd52d46ffbb974e6cacef411915578756cda78ffd74e102"} Jun 03 23:03:43.935540 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.935486 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:03:43.936440 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.936420 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-fppqh" event={"ID":"e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73","Type":"ContainerStarted","Data":"2dc0da4901142a7d2b3acbfb8ee84d7ae930b9aca594c6513bc3b15ed8926fde"} Jun 03 23:03:43.936553 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.936451 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:43.955132 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.955075 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" podStartSLOduration=0.955055594 podStartE2EDuration="955.055594ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:43.954797489 +0000 UTC m=+64.827473345" watchObservedRunningTime="2026-06-03 23:03:43.955055594 +0000 UTC m=+64.827731437" Jun 03 23:03:43.960965 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:43.960946 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:44.078923 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.078829 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-image-registry-private-configuration\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.078923 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.078908 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-certificates\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.079152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.078942 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmtwb\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-kube-api-access-kmtwb\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.079152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.078974 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-installation-pull-secrets\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.079152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.079024 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-bound-sa-token\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.079152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.079071 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-trusted-ca\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.079152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.079098 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/114f9b46-1e69-4668-933c-b2109df0ddf3-ca-trust-extracted\") pod \"114f9b46-1e69-4668-933c-b2109df0ddf3\" (UID: \"114f9b46-1e69-4668-933c-b2109df0ddf3\") " Jun 03 23:03:44.079391 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.079298 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:03:44.079529 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.079505 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/114f9b46-1e69-4668-933c-b2109df0ddf3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:03:44.079630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.079554 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:03:44.081368 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.081341 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:03:44.085641 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.081307 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-kube-api-access-kmtwb" (OuterVolumeSpecName: "kube-api-access-kmtwb") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "kube-api-access-kmtwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:03:44.085776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.085720 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:03:44.085776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.085741 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "114f9b46-1e69-4668-933c-b2109df0ddf3" (UID: "114f9b46-1e69-4668-933c-b2109df0ddf3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:03:44.180380 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180337 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-image-registry-private-configuration\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.180380 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180371 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-certificates\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.180380 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180383 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmtwb\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-kube-api-access-kmtwb\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.180380 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180392 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/114f9b46-1e69-4668-933c-b2109df0ddf3-installation-pull-secrets\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.180739 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180402 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-bound-sa-token\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.180739 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180411 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/114f9b46-1e69-4668-933c-b2109df0ddf3-trusted-ca\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.180739 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.180420 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/114f9b46-1e69-4668-933c-b2109df0ddf3-ca-trust-extracted\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:44.497183 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.497141 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:44.611443 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.611353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:44.710028 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.709985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:44.944558 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.941021 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64cd5fbb9b-hgg5g" Jun 03 23:03:44.987774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.986352 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64cd5fbb9b-hgg5g"] Jun 03 23:03:44.988833 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:44.988779 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64cd5fbb9b-hgg5g"] Jun 03 23:03:45.090562 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.090427 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/114f9b46-1e69-4668-933c-b2109df0ddf3-registry-tls\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:03:45.494879 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.494842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:45.495060 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.494912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:45.495060 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.494960 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:45.497925 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.497889 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:03:45.499151 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.499126 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:03:45.499314 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.499130 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:03:45.508309 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.508284 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:03:45.514951 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.514891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c28a052e-9899-4ca0-97ed-55589e7f4841-metrics-certs\") pod \"network-metrics-daemon-fc8rp\" (UID: \"c28a052e-9899-4ca0-97ed-55589e7f4841\") " pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:45.517385 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.517283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284-original-pull-secret\") pod \"global-pull-secret-syncer-cwvbb\" (UID: \"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284\") " pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:45.525608 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.525542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl5nd\" (UniqueName: \"kubernetes.io/projected/aec88443-ac3f-434e-aebf-43529b5e34dd-kube-api-access-vl5nd\") pod \"network-check-target-dw424\" (UID: \"aec88443-ac3f-434e-aebf-43529b5e34dd\") " pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:45.543870 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.543629 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-256x8\"" Jun 03 23:03:45.546376 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.546168 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwvbb" Jun 03 23:03:45.551328 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.550882 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:45.554006 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.553811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skdgk\"" Jun 03 23:03:45.562325 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.562088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fc8rp" Jun 03 23:03:45.637630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.637395 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114f9b46-1e69-4668-933c-b2109df0ddf3" path="/var/lib/kubelet/pods/114f9b46-1e69-4668-933c-b2109df0ddf3/volumes" Jun 03 23:03:45.777380 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.776138 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwvbb"] Jun 03 23:03:45.782511 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:45.782477 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5e4523_ba1b_4d5d_8047_8e5c6bc3b284.slice/crio-9e83bc2fe8d9c33a259c1f481431b5c16a911d43d844e25cefc0697f8587454c WatchSource:0}: Error finding container 9e83bc2fe8d9c33a259c1f481431b5c16a911d43d844e25cefc0697f8587454c: Status 404 returned error can't find the container with id 9e83bc2fe8d9c33a259c1f481431b5c16a911d43d844e25cefc0697f8587454c Jun 03 23:03:45.791738 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.791524 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dw424"] Jun 03 23:03:45.800480 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:45.800448 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec88443_ac3f_434e_aebf_43529b5e34dd.slice/crio-156f1b70da582e6b964480bcf74c57f703ab651d8208f9eaa7ccd40989452621 WatchSource:0}: Error finding container 156f1b70da582e6b964480bcf74c57f703ab651d8208f9eaa7ccd40989452621: Status 404 returned error can't find the container with id 156f1b70da582e6b964480bcf74c57f703ab651d8208f9eaa7ccd40989452621 Jun 03 23:03:45.815146 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.814392 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fc8rp"] Jun 03 23:03:45.821021 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:03:45.820991 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28a052e_9899_4ca0_97ed_55589e7f4841.slice/crio-d82895b0c303d8b148619109491a5e7a10181ff3fa0e404277dca43506738d6f WatchSource:0}: Error finding container d82895b0c303d8b148619109491a5e7a10181ff3fa0e404277dca43506738d6f: Status 404 returned error can't find the container with id d82895b0c303d8b148619109491a5e7a10181ff3fa0e404277dca43506738d6f Jun 03 23:03:45.952581 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.952494 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc8rp" event={"ID":"c28a052e-9899-4ca0-97ed-55589e7f4841","Type":"ContainerStarted","Data":"d82895b0c303d8b148619109491a5e7a10181ff3fa0e404277dca43506738d6f"} Jun 03 23:03:45.955791 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.955718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwvbb" event={"ID":"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284","Type":"ContainerStarted","Data":"9e83bc2fe8d9c33a259c1f481431b5c16a911d43d844e25cefc0697f8587454c"} Jun 03 23:03:45.959265 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.959198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl7df" event={"ID":"25db501a-9cc1-41a3-8a67-73fc9224bb31","Type":"ContainerStarted","Data":"8db218448f20e9f41b238f000ee6ee225c01f827638202be5bc13c5d7a587692"} Jun 03 23:03:45.960839 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:45.960809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dw424" event={"ID":"aec88443-ac3f-434e-aebf-43529b5e34dd","Type":"ContainerStarted","Data":"156f1b70da582e6b964480bcf74c57f703ab651d8208f9eaa7ccd40989452621"} Jun 03 23:03:46.913596 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:46.913537 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:48.347125 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:48.347007 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:48.412368 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:48.412289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:48.515484 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:48.515423 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:48.680061 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:48.679969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:48.894974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:48.894892 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:48.968943 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:48.968840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:50.767242 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:50.767203 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:50.826043 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:50.826010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:51.476373 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:51.476253 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:51.573498 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:51.573382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:51.636869 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:51.636805 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:51.786697 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:51.786601 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:51.903471 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:51.903439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:52.105001 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:52.104964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:52.200833 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:52.200802 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:52.261023 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:52.260983 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:55.006464 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.006423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc8rp" event={"ID":"c28a052e-9899-4ca0-97ed-55589e7f4841","Type":"ContainerStarted","Data":"4c3adc95d8b0e4075b4c276b762c67b9d7f4e261a2c481f15b1b606f6472451c"} Jun 03 23:03:55.007031 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.006503 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fc8rp" event={"ID":"c28a052e-9899-4ca0-97ed-55589e7f4841","Type":"ContainerStarted","Data":"d429d9a27e4c0b73e8d9c104a96aae8bdb8a6641afd1ae5c85eb2ae14a5cbea2"} Jun 03 23:03:55.008458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.008429 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwvbb" event={"ID":"ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284","Type":"ContainerStarted","Data":"92bbcb6d993a873969ec54f6d7995d228062ebcdfe400b3a2c945afbccf96dbf"} Jun 03 23:03:55.011255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.011226 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl7df" event={"ID":"25db501a-9cc1-41a3-8a67-73fc9224bb31","Type":"ContainerStarted","Data":"4a2a705ca0e0fde69dfb59abefd5e563bdd241ed271ebb1a67a6f42ce3779837"} Jun 03 23:03:55.012732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.012685 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" event={"ID":"abcd00ab-8e6b-4605-a49f-f09813ef6c37","Type":"ContainerStarted","Data":"1b6d1947737167b9a304141dd179acea5c7f1c13186e347d51478abbcb7f2fcb"} Jun 03 23:03:55.014729 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.014689 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" event={"ID":"820b4d2f-d00e-4850-89d5-ff0ed31a23a1","Type":"ContainerStarted","Data":"dbee2559da2731324767aa45ee470b8be9e11b3814c80e1c7c6bf5d7c50ada30"} Jun 03 23:03:55.014920 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.014879 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:55.016797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.016773 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dw424" event={"ID":"aec88443-ac3f-434e-aebf-43529b5e34dd","Type":"ContainerStarted","Data":"32df344caa1b38b9c88a8180c5a15d4bc9b2122edcb498210b85e0181a7a683c"} Jun 03 23:03:55.016899 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.016855 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" Jun 03 23:03:55.023804 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.023756 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fc8rp" podStartSLOduration=67.592037904 podStartE2EDuration="1m16.023742754s" totalImagesPullingTime="8.43170485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:55.02259046 +0000 UTC m=+75.895266301" watchObservedRunningTime="2026-06-03 23:03:55.023742754 +0000 UTC m=+75.896418606" Jun 03 23:03:55.039542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.039490 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cwvbb" podStartSLOduration=66.548802305 podStartE2EDuration="1m15.039471288s" totalImagesPullingTime="8.490668983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:55.038874684 +0000 UTC m=+75.911550524" watchObservedRunningTime="2026-06-03 23:03:55.039471288 +0000 UTC m=+75.912147132" Jun 03 23:03:55.056662 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.056605 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b58cd985b-lr6jp" podStartSLOduration=1.337126966 podStartE2EDuration="12.05658329s" totalImagesPullingTime="10.719456324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:55.05616681 +0000 UTC m=+75.928842651" watchObservedRunningTime="2026-06-03 23:03:55.05658329 +0000 UTC m=+75.929259132" Jun 03 23:03:55.072395 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.072339 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d8f686c64-t28qs" podStartSLOduration=1.427718814 podStartE2EDuration="12.072320758s" totalImagesPullingTime="10.644601944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:55.071726845 +0000 UTC m=+75.944402683" watchObservedRunningTime="2026-06-03 23:03:55.072320758 +0000 UTC m=+75.944996601" Jun 03 23:03:55.097074 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.097028 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hl7df" podStartSLOduration=2.954300187 podStartE2EDuration="12.097012448s" totalImagesPullingTime="9.142712261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:55.095417777 +0000 UTC m=+75.968093617" watchObservedRunningTime="2026-06-03 23:03:55.097012448 +0000 UTC m=+75.969688287" Jun 03 23:03:55.115055 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.113864 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dw424" podStartSLOduration=67.638332434 podStartE2EDuration="1m16.113840413s" totalImagesPullingTime="8.475507979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:03:55.113160932 +0000 UTC m=+75.985836797" watchObservedRunningTime="2026-06-03 23:03:55.113840413 +0000 UTC m=+75.986516260" Jun 03 23:03:55.143414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.143378 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:55.249281 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.249246 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:55.363119 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.363080 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:55.537976 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:55.537939 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:56.021435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:56.021401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:03:57.715755 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:57.715695 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:57.814637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:57.814583 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:57.920208 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:57.920153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.043226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.043142 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dvxpj"] Jun 03 23:03:58.049044 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.049011 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.057310 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.057059 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 23:03:58.057310 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.057268 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 23:03:58.059213 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.059177 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 23:03:58.059213 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.059204 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 23:03:58.059385 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.059337 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhwlr\"" Jun 03 23:03:58.061340 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.061243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.065128 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.065104 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 23:03:58.068955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.068936 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 23:03:58.208461 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.208425 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.214606 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4jx\" (UniqueName: \"kubernetes.io/projected/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-kube-api-access-9c4jx\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.214787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-sys\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.214787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-accelerators-collector-config\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.214787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214681 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.214787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214736 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-root\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.214787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-tls\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.214787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214786 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-textfile\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.215050 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-metrics-client-ca\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.215050 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.214872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-wtmp\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.308615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.308524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.315616 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315588 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-wtmp\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4jx\" (UniqueName: \"kubernetes.io/projected/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-kube-api-access-9c4jx\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315672 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-sys\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-accelerators-collector-config\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315743 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315769 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-root\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315768 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-sys\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.315817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315814 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-wtmp\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316189 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315833 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-root\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316189 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-tls\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316189 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315897 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-textfile\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316189 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.315921 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-metrics-client-ca\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316397 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.316202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-textfile\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316397 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.316377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-accelerators-collector-config\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.316503 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.316483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-metrics-client-ca\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.318728 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.318681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.318840 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.318694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-node-exporter-tls\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.327130 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.327096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4jx\" (UniqueName: \"kubernetes.io/projected/e8be78cb-078f-4adf-a7ad-3a6397bc9a71-kube-api-access-9c4jx\") pod \"node-exporter-dvxpj\" (UID: \"e8be78cb-078f-4adf-a7ad-3a6397bc9a71\") " pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.364195 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.364156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dvxpj" Jun 03 23:03:58.407362 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.407301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.504895 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.504859 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.788885 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.788778 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:58.979639 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:58.979505 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:59.080596 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:59.080511 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:03:59.246398 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:03:59.246364 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:00.624330 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:00.624284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:00.716328 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:00.716295 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:00.948466 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:00.948374 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:01.018101 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:01.018067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:01.141320 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:01.141280 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:01.422495 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:01.422463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:02.736354 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:02.736308 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:02.841215 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:02.841176 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:02.937345 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:02.937309 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:03.954117 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:04:03.954090 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8be78cb_078f_4adf_a7ad_3a6397bc9a71.slice/crio-e3befe1238e48a8747f4f026af655f123e54669f6b061af2cb7003571a4a597b WatchSource:0}: Error finding container e3befe1238e48a8747f4f026af655f123e54669f6b061af2cb7003571a4a597b: Status 404 returned error can't find the container with id e3befe1238e48a8747f4f026af655f123e54669f6b061af2cb7003571a4a597b Jun 03 23:04:04.052918 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:04.052877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvxpj" event={"ID":"e8be78cb-078f-4adf-a7ad-3a6397bc9a71","Type":"ContainerStarted","Data":"e3befe1238e48a8747f4f026af655f123e54669f6b061af2cb7003571a4a597b"} Jun 03 23:04:04.278602 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:04.278521 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:04.900213 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:04.900174 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:04.946951 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:04.946923 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64699c8c76-7wfc7" Jun 03 23:04:04.974681 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:04.974643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:05.059006 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.058944 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-fppqh" event={"ID":"e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73","Type":"ContainerStarted","Data":"3db706f4be6fa67f7e68de093d891d69e4c7a22380fa837aa5829a07552c6d05"} Jun 03 23:04:05.059364 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.059331 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:04:05.077293 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.077260 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-fppqh" Jun 03 23:04:05.088615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.088550 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-fppqh" podStartSLOduration=1.640215914 podStartE2EDuration="22.088525994s" totalImagesPullingTime="20.44831008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:05.087118259 +0000 UTC m=+85.959794100" watchObservedRunningTime="2026-06-03 23:04:05.088525994 +0000 UTC m=+85.961201838" Jun 03 23:04:05.117012 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.116976 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:05.176095 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.176004 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:05.312644 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.312575 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:05.414152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:05.414111 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:06.000374 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:06.000330 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:06.066120 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:06.066067 2567 generic.go:356] "Generic (PLEG): container finished" podID="e8be78cb-078f-4adf-a7ad-3a6397bc9a71" containerID="d06961114de44b6e7b761fcd175411f0b43f75fde885e11f4d4fce228e573655" exitCode=0 Jun 03 23:04:06.066322 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:06.066166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvxpj" event={"ID":"e8be78cb-078f-4adf-a7ad-3a6397bc9a71","Type":"ContainerDied","Data":"d06961114de44b6e7b761fcd175411f0b43f75fde885e11f4d4fce228e573655"} Jun 03 23:04:06.090011 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:06.089977 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:07.073961 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:07.073913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvxpj" event={"ID":"e8be78cb-078f-4adf-a7ad-3a6397bc9a71","Type":"ContainerStarted","Data":"8e15e84ad0086161964e00c72b3e3723c12dcbbceb92876d099f9f2ae43284ea"} Jun 03 23:04:07.074344 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:07.073984 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dvxpj" event={"ID":"e8be78cb-078f-4adf-a7ad-3a6397bc9a71","Type":"ContainerStarted","Data":"087ca9fe35357ac8f9d3635ce87680d16b42af43c92866b5c423d97c30643a39"} Jun 03 23:04:07.100992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:07.100935 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dvxpj" podStartSLOduration=7.736492274 podStartE2EDuration="9.100913825s" totalImagesPullingTime="1.254743592s" totalInitContainerRuntime="109.677959ms" isStatefulPod=true podCreationTimestamp="2026-06-03 23:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:04:07.098645026 +0000 UTC m=+87.971320866" watchObservedRunningTime="2026-06-03 23:04:07.100913825 +0000 UTC m=+87.973589668" Jun 03 23:04:12.843974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:12.843938 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:12.938917 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:12.938877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:13.121019 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:13.120980 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:13.218907 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:13.218870 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:14.123742 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:14.123686 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:14.224667 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:14.224629 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:14.324543 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:14.324507 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:14.425740 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:14.425623 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:14.985943 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:14.985907 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:15.040310 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:15.040273 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:27.027012 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:27.026981 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dw424" Jun 03 23:04:27.777012 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:27.776979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:27.878023 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:27.877993 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:42.773030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:42.772987 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:04:42.843353 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:04:42.843318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:17.253131 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:17.253092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:17.501832 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:17.501800 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:26.227575 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:26.227482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:26.327600 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:26.327566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:37.629393 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:37.629362 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:37.730999 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:37.730964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:05:37.792133 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:05:37.792101 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:15.302521 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:15.302484 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:32.522666 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:32.522630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:32.580065 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:32.580031 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:35.280379 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:35.280339 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:35.381177 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:35.381139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:38.065042 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:38.065001 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:44.447173 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:44.447135 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:44.550254 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:44.550212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:45.907789 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:45.907757 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:46.008800 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:46.008768 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:46.108603 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:46.108573 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:57.790311 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:57.790232 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:06:57.904282 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:06:57.904242 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:03.837241 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:03.837204 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:14.052458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.052423 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:14.153632 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.153572 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:14.721093 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.721053 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc"] Jun 03 23:07:14.724431 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.724413 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.727131 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.727113 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:07:14.728295 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.728277 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:07:14.728356 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.728283 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrb4z\"" Jun 03 23:07:14.741885 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.741858 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc"] Jun 03 23:07:14.823035 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.822987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.823226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.823060 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzlc\" (UniqueName: \"kubernetes.io/projected/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-kube-api-access-zxzlc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.823226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.823122 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.923489 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.923442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.923645 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.923504 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzlc\" (UniqueName: \"kubernetes.io/projected/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-kube-api-access-zxzlc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.923645 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.923531 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.923886 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.923861 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.923886 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.923877 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:14.932698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:14.932676 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzlc\" (UniqueName: \"kubernetes.io/projected/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-kube-api-access-zxzlc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:15.033361 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:15.033257 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:15.166913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:15.166874 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc"] Jun 03 23:07:15.170608 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:07:15.170581 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438a4aad_b5b0_458f_ad62_bc78bc8bdcde.slice/crio-8aca2bbd147af7243dcc1c2a5d2ee74c42d3193a7c7a1d8fa52ecda4ca69ba03 WatchSource:0}: Error finding container 8aca2bbd147af7243dcc1c2a5d2ee74c42d3193a7c7a1d8fa52ecda4ca69ba03: Status 404 returned error can't find the container with id 8aca2bbd147af7243dcc1c2a5d2ee74c42d3193a7c7a1d8fa52ecda4ca69ba03 Jun 03 23:07:15.710403 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:15.710361 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" event={"ID":"438a4aad-b5b0-458f-ad62-bc78bc8bdcde","Type":"ContainerStarted","Data":"8aca2bbd147af7243dcc1c2a5d2ee74c42d3193a7c7a1d8fa52ecda4ca69ba03"} Jun 03 23:07:22.738385 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:22.738352 2567 generic.go:356] "Generic (PLEG): container finished" podID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerID="cb1877c003e8874ea729ab46ec5e8ff721715dae2f76a4424771c5f386b4269e" exitCode=0 Jun 03 23:07:22.738795 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:22.738394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" event={"ID":"438a4aad-b5b0-458f-ad62-bc78bc8bdcde","Type":"ContainerDied","Data":"cb1877c003e8874ea729ab46ec5e8ff721715dae2f76a4424771c5f386b4269e"} Jun 03 23:07:23.744565 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:23.744471 2567 generic.go:356] "Generic (PLEG): container finished" podID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerID="de2575cba5fcc0327c061f654e4f5ebb9a4dc8e9186340a3677a162be581ffd4" exitCode=0 Jun 03 23:07:23.744927 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:23.744559 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" event={"ID":"438a4aad-b5b0-458f-ad62-bc78bc8bdcde","Type":"ContainerDied","Data":"de2575cba5fcc0327c061f654e4f5ebb9a4dc8e9186340a3677a162be581ffd4"} Jun 03 23:07:31.777918 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:31.777873 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" event={"ID":"438a4aad-b5b0-458f-ad62-bc78bc8bdcde","Type":"ContainerStarted","Data":"14554e84f35be1865b414e20abe3e621065ac624771b429f9c3bcddcd7ab5f61"} Jun 03 23:07:31.805210 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:31.805143 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" podStartSLOduration=2.374988953 podStartE2EDuration="17.805120541s" totalImagesPullingTime="15.430131588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:07:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:07:31.802942988 +0000 UTC m=+292.675618831" watchObservedRunningTime="2026-06-03 23:07:31.805120541 +0000 UTC m=+292.677796385" Jun 03 23:07:32.783527 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:32.783486 2567 generic.go:356] "Generic (PLEG): container finished" podID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerID="14554e84f35be1865b414e20abe3e621065ac624771b429f9c3bcddcd7ab5f61" exitCode=0 Jun 03 23:07:32.783990 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:32.783560 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" event={"ID":"438a4aad-b5b0-458f-ad62-bc78bc8bdcde","Type":"ContainerDied","Data":"14554e84f35be1865b414e20abe3e621065ac624771b429f9c3bcddcd7ab5f61"} Jun 03 23:07:33.918385 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:33.918357 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:34.081469 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.081377 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzlc\" (UniqueName: \"kubernetes.io/projected/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-kube-api-access-zxzlc\") pod \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " Jun 03 23:07:34.081469 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.081425 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-util\") pod \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " Jun 03 23:07:34.081648 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.081481 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-bundle\") pod \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\" (UID: \"438a4aad-b5b0-458f-ad62-bc78bc8bdcde\") " Jun 03 23:07:34.082251 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.082221 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-bundle" (OuterVolumeSpecName: "bundle") pod "438a4aad-b5b0-458f-ad62-bc78bc8bdcde" (UID: "438a4aad-b5b0-458f-ad62-bc78bc8bdcde"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:07:34.083845 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.083828 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-kube-api-access-zxzlc" (OuterVolumeSpecName: "kube-api-access-zxzlc") pod "438a4aad-b5b0-458f-ad62-bc78bc8bdcde" (UID: "438a4aad-b5b0-458f-ad62-bc78bc8bdcde"). InnerVolumeSpecName "kube-api-access-zxzlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:07:34.086261 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.086237 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-util" (OuterVolumeSpecName: "util") pod "438a4aad-b5b0-458f-ad62-bc78bc8bdcde" (UID: "438a4aad-b5b0-458f-ad62-bc78bc8bdcde"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:07:34.182524 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.182476 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:07:34.182524 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.182516 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzlc\" (UniqueName: \"kubernetes.io/projected/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-kube-api-access-zxzlc\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:07:34.182524 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.182528 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/438a4aad-b5b0-458f-ad62-bc78bc8bdcde-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:07:34.791354 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.791311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" event={"ID":"438a4aad-b5b0-458f-ad62-bc78bc8bdcde","Type":"ContainerDied","Data":"8aca2bbd147af7243dcc1c2a5d2ee74c42d3193a7c7a1d8fa52ecda4ca69ba03"} Jun 03 23:07:34.791354 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.791345 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8t4jc" Jun 03 23:07:34.791354 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:34.791359 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aca2bbd147af7243dcc1c2a5d2ee74c42d3193a7c7a1d8fa52ecda4ca69ba03" Jun 03 23:07:35.840813 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:35.840776 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:36.920924 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:36.920879 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:37.895412 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895371 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9"] Jun 03 23:07:37.895630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895616 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="extract" Jun 03 23:07:37.895690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895631 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="extract" Jun 03 23:07:37.895690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895644 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="util" Jun 03 23:07:37.895690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895649 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="util" Jun 03 23:07:37.895690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895659 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="pull" Jun 03 23:07:37.895690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895688 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="pull" Jun 03 23:07:37.895961 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.895744 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="438a4aad-b5b0-458f-ad62-bc78bc8bdcde" containerName="extract" Jun 03 23:07:37.924046 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.924006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9"] Jun 03 23:07:37.924480 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.924106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:37.927161 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.927138 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bwjqv\"" Jun 03 23:07:37.927538 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.927509 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 23:07:37.927645 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:37.927542 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:07:38.013565 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.013529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d17e89b1-efee-4998-ad35-f1561bfd8464-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x5vv9\" (UID: \"d17e89b1-efee-4998-ad35-f1561bfd8464\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.013565 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.013569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vtm\" (UniqueName: \"kubernetes.io/projected/d17e89b1-efee-4998-ad35-f1561bfd8464-kube-api-access-l2vtm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x5vv9\" (UID: \"d17e89b1-efee-4998-ad35-f1561bfd8464\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.114804 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.114764 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d17e89b1-efee-4998-ad35-f1561bfd8464-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x5vv9\" (UID: \"d17e89b1-efee-4998-ad35-f1561bfd8464\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.114933 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.114812 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vtm\" (UniqueName: \"kubernetes.io/projected/d17e89b1-efee-4998-ad35-f1561bfd8464-kube-api-access-l2vtm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x5vv9\" (UID: \"d17e89b1-efee-4998-ad35-f1561bfd8464\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.115225 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.115202 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d17e89b1-efee-4998-ad35-f1561bfd8464-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x5vv9\" (UID: \"d17e89b1-efee-4998-ad35-f1561bfd8464\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.129200 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.129168 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vtm\" (UniqueName: \"kubernetes.io/projected/d17e89b1-efee-4998-ad35-f1561bfd8464-kube-api-access-l2vtm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-x5vv9\" (UID: \"d17e89b1-efee-4998-ad35-f1561bfd8464\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.233980 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.233880 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" Jun 03 23:07:38.388242 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.388004 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9"] Jun 03 23:07:38.391218 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:07:38.391182 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17e89b1_efee_4998_ad35_f1561bfd8464.slice/crio-176e3de226e77c3de49cce36817ef60ca1c07846a74c667d0840b8f9ba616587 WatchSource:0}: Error finding container 176e3de226e77c3de49cce36817ef60ca1c07846a74c667d0840b8f9ba616587: Status 404 returned error can't find the container with id 176e3de226e77c3de49cce36817ef60ca1c07846a74c667d0840b8f9ba616587 Jun 03 23:07:38.807327 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:38.807293 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" event={"ID":"d17e89b1-efee-4998-ad35-f1561bfd8464","Type":"ContainerStarted","Data":"176e3de226e77c3de49cce36817ef60ca1c07846a74c667d0840b8f9ba616587"} Jun 03 23:07:39.579835 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:39.579801 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:07:39.580591 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:39.580571 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:07:39.582869 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:39.582848 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 23:07:39.683465 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:39.683292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:40.789064 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:40.789038 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:40.817803 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:40.817765 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" event={"ID":"d17e89b1-efee-4998-ad35-f1561bfd8464","Type":"ContainerStarted","Data":"d6c93f5f3b0ddfed07b0ce913038fdcabd5b224a4d3786e5db25f9f68c5da9c8"} Jun 03 23:07:41.435692 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:41.435657 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:41.526201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:41.526154 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:41.844175 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:41.844047 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-x5vv9" podStartSLOduration=2.541593822 podStartE2EDuration="4.844029723s" totalImagesPullingTime="2.302435901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:07:41.843606743 +0000 UTC m=+302.716282583" watchObservedRunningTime="2026-06-03 23:07:41.844029723 +0000 UTC m=+302.716705563" Jun 03 23:07:42.270243 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.270204 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:42.430431 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.430396 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:42.524046 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.523961 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b"] Jun 03 23:07:42.526826 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.526804 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.529896 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.529869 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:07:42.529896 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.529895 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrb4z\"" Jun 03 23:07:42.531148 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.531131 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:07:42.551296 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.551260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b"] Jun 03 23:07:42.654323 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.654287 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.654323 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.654324 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.654562 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.654348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmcz\" (UniqueName: \"kubernetes.io/projected/f3cde1f3-78b8-4ce9-b20f-e529c8875188-kube-api-access-vsmcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.755454 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.755406 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.755454 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.755452 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.755767 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.755603 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmcz\" (UniqueName: \"kubernetes.io/projected/f3cde1f3-78b8-4ce9-b20f-e529c8875188-kube-api-access-vsmcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.755838 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.755803 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.755891 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.755848 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.770774 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.770738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmcz\" (UniqueName: \"kubernetes.io/projected/f3cde1f3-78b8-4ce9-b20f-e529c8875188-kube-api-access-vsmcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.836214 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.836125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:42.976044 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:42.976003 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b"] Jun 03 23:07:42.978835 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:07:42.978802 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cde1f3_78b8_4ce9_b20f_e529c8875188.slice/crio-037a12fdbe594361fc71caf4879f5754de67d394b65d8f6f84bdc831ceed0233 WatchSource:0}: Error finding container 037a12fdbe594361fc71caf4879f5754de67d394b65d8f6f84bdc831ceed0233: Status 404 returned error can't find the container with id 037a12fdbe594361fc71caf4879f5754de67d394b65d8f6f84bdc831ceed0233 Jun 03 23:07:43.830415 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:43.830375 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerID="64f61dec34d832b06562ee3734982053290740d007cc6d80fc5cc7c7ea101c87" exitCode=0 Jun 03 23:07:43.830616 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:43.830427 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" event={"ID":"f3cde1f3-78b8-4ce9-b20f-e529c8875188","Type":"ContainerDied","Data":"64f61dec34d832b06562ee3734982053290740d007cc6d80fc5cc7c7ea101c87"} Jun 03 23:07:43.830616 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:43.830463 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" event={"ID":"f3cde1f3-78b8-4ce9-b20f-e529c8875188","Type":"ContainerStarted","Data":"037a12fdbe594361fc71caf4879f5754de67d394b65d8f6f84bdc831ceed0233"} Jun 03 23:07:43.831472 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:43.831455 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:07:44.926503 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:44.926456 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:45.315813 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:45.315728 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:46.639902 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:46.639869 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:46.707397 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:46.707367 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:46.845457 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:46.845423 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerID="13ff180b47784b8768c654cec5037c5b9f50049a61117c35534ee35fb1dd1340" exitCode=0 Jun 03 23:07:46.845633 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:46.845476 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" event={"ID":"f3cde1f3-78b8-4ce9-b20f-e529c8875188","Type":"ContainerDied","Data":"13ff180b47784b8768c654cec5037c5b9f50049a61117c35534ee35fb1dd1340"} Jun 03 23:07:47.851143 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:47.851107 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerID="752696d275ebf4202050b06506921b85a67f9656d564f6c28fbff409a470e571" exitCode=0 Jun 03 23:07:47.851521 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:47.851165 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" event={"ID":"f3cde1f3-78b8-4ce9-b20f-e529c8875188","Type":"ContainerDied","Data":"752696d275ebf4202050b06506921b85a67f9656d564f6c28fbff409a470e571"} Jun 03 23:07:48.994793 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:48.994764 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:48.997911 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:48.997894 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-bundle\") pod \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " Jun 03 23:07:48.997968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:48.997943 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsmcz\" (UniqueName: \"kubernetes.io/projected/f3cde1f3-78b8-4ce9-b20f-e529c8875188-kube-api-access-vsmcz\") pod \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " Jun 03 23:07:48.998003 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:48.997973 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-util\") pod \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\" (UID: \"f3cde1f3-78b8-4ce9-b20f-e529c8875188\") " Jun 03 23:07:48.998299 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:48.998281 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-bundle" (OuterVolumeSpecName: "bundle") pod "f3cde1f3-78b8-4ce9-b20f-e529c8875188" (UID: "f3cde1f3-78b8-4ce9-b20f-e529c8875188"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:07:49.000210 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.000186 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cde1f3-78b8-4ce9-b20f-e529c8875188-kube-api-access-vsmcz" (OuterVolumeSpecName: "kube-api-access-vsmcz") pod "f3cde1f3-78b8-4ce9-b20f-e529c8875188" (UID: "f3cde1f3-78b8-4ce9-b20f-e529c8875188"). InnerVolumeSpecName "kube-api-access-vsmcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:07:49.003009 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.002984 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-util" (OuterVolumeSpecName: "util") pod "f3cde1f3-78b8-4ce9-b20f-e529c8875188" (UID: "f3cde1f3-78b8-4ce9-b20f-e529c8875188"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:07:49.098570 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.098527 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:07:49.098570 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.098557 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsmcz\" (UniqueName: \"kubernetes.io/projected/f3cde1f3-78b8-4ce9-b20f-e529c8875188-kube-api-access-vsmcz\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:07:49.098570 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.098566 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3cde1f3-78b8-4ce9-b20f-e529c8875188-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:07:49.861131 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.861094 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" event={"ID":"f3cde1f3-78b8-4ce9-b20f-e529c8875188","Type":"ContainerDied","Data":"037a12fdbe594361fc71caf4879f5754de67d394b65d8f6f84bdc831ceed0233"} Jun 03 23:07:49.861325 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.861178 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="037a12fdbe594361fc71caf4879f5754de67d394b65d8f6f84bdc831ceed0233" Jun 03 23:07:49.861325 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:49.861109 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frq97b" Jun 03 23:07:50.932262 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:50.932224 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:51.031767 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:51.031728 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:07:52.602285 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:07:52.602255 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:01.255253 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:01.255215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:01.354741 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:01.354676 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:02.276257 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276221 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gwz7n"] Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276491 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="util" Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276502 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="util" Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276515 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="pull" Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276520 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="pull" Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276527 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="extract" Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276532 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="extract" Jun 03 23:08:02.276630 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.276572 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3cde1f3-78b8-4ce9-b20f-e529c8875188" containerName="extract" Jun 03 23:08:02.279438 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.279420 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.283091 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.283067 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 23:08:02.283253 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.283073 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pnhdp\"" Jun 03 23:08:02.284178 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.284160 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 23:08:02.285857 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.285550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kclh8\" (UniqueName: \"kubernetes.io/projected/47659a03-f0a8-4bee-b7a5-c69a985289dd-kube-api-access-kclh8\") pod \"cert-manager-59c77684cc-gwz7n\" (UID: \"47659a03-f0a8-4bee-b7a5-c69a985289dd\") " pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.285857 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.285615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47659a03-f0a8-4bee-b7a5-c69a985289dd-bound-sa-token\") pod \"cert-manager-59c77684cc-gwz7n\" (UID: \"47659a03-f0a8-4bee-b7a5-c69a985289dd\") " pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.295094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.295072 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gwz7n"] Jun 03 23:08:02.386299 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.386259 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47659a03-f0a8-4bee-b7a5-c69a985289dd-bound-sa-token\") pod \"cert-manager-59c77684cc-gwz7n\" (UID: \"47659a03-f0a8-4bee-b7a5-c69a985289dd\") " pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.386511 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.386333 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kclh8\" (UniqueName: \"kubernetes.io/projected/47659a03-f0a8-4bee-b7a5-c69a985289dd-kube-api-access-kclh8\") pod \"cert-manager-59c77684cc-gwz7n\" (UID: \"47659a03-f0a8-4bee-b7a5-c69a985289dd\") " pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.397926 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.397895 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47659a03-f0a8-4bee-b7a5-c69a985289dd-bound-sa-token\") pod \"cert-manager-59c77684cc-gwz7n\" (UID: \"47659a03-f0a8-4bee-b7a5-c69a985289dd\") " pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.398854 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.398830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kclh8\" (UniqueName: \"kubernetes.io/projected/47659a03-f0a8-4bee-b7a5-c69a985289dd-kube-api-access-kclh8\") pod \"cert-manager-59c77684cc-gwz7n\" (UID: \"47659a03-f0a8-4bee-b7a5-c69a985289dd\") " pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.588292 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.588198 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gwz7n" Jun 03 23:08:02.738584 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.738547 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gwz7n"] Jun 03 23:08:02.741547 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:02.741514 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47659a03_f0a8_4bee_b7a5_c69a985289dd.slice/crio-147f6b32aa159a8d2a428878990e10ceb39be892debac0a64c775dac0cf04080 WatchSource:0}: Error finding container 147f6b32aa159a8d2a428878990e10ceb39be892debac0a64c775dac0cf04080: Status 404 returned error can't find the container with id 147f6b32aa159a8d2a428878990e10ceb39be892debac0a64c775dac0cf04080 Jun 03 23:08:02.911640 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:02.911598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gwz7n" event={"ID":"47659a03-f0a8-4bee-b7a5-c69a985289dd","Type":"ContainerStarted","Data":"147f6b32aa159a8d2a428878990e10ceb39be892debac0a64c775dac0cf04080"} Jun 03 23:08:03.353302 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.353271 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl"] Jun 03 23:08:03.357867 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.357849 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.364921 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.364896 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 23:08:03.365973 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.365947 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:08:03.366091 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.365954 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lpnhc\"" Jun 03 23:08:03.378004 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.377973 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl"] Jun 03 23:08:03.393908 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.393878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5m52\" (UniqueName: \"kubernetes.io/projected/d887e2d9-67f7-40e1-84ab-f090f5b692ef-kube-api-access-l5m52\") pod \"openshift-lws-operator-fd8ccff4c-sxmxl\" (UID: \"d887e2d9-67f7-40e1-84ab-f090f5b692ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.394060 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.393931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d887e2d9-67f7-40e1-84ab-f090f5b692ef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxmxl\" (UID: \"d887e2d9-67f7-40e1-84ab-f090f5b692ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.495340 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.495305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5m52\" (UniqueName: \"kubernetes.io/projected/d887e2d9-67f7-40e1-84ab-f090f5b692ef-kube-api-access-l5m52\") pod \"openshift-lws-operator-fd8ccff4c-sxmxl\" (UID: \"d887e2d9-67f7-40e1-84ab-f090f5b692ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.495509 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.495366 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d887e2d9-67f7-40e1-84ab-f090f5b692ef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxmxl\" (UID: \"d887e2d9-67f7-40e1-84ab-f090f5b692ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.495821 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.495798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d887e2d9-67f7-40e1-84ab-f090f5b692ef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-sxmxl\" (UID: \"d887e2d9-67f7-40e1-84ab-f090f5b692ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.503796 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.503769 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5m52\" (UniqueName: \"kubernetes.io/projected/d887e2d9-67f7-40e1-84ab-f090f5b692ef-kube-api-access-l5m52\") pod \"openshift-lws-operator-fd8ccff4c-sxmxl\" (UID: \"d887e2d9-67f7-40e1-84ab-f090f5b692ef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.667252 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.667161 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" Jun 03 23:08:03.804113 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.804087 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl"] Jun 03 23:08:03.806306 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:03.806277 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd887e2d9_67f7_40e1_84ab_f090f5b692ef.slice/crio-d8301db5e52091125ad133108d807c6a1f8c439d96af3e0d64ee9b4f6fdc48de WatchSource:0}: Error finding container d8301db5e52091125ad133108d807c6a1f8c439d96af3e0d64ee9b4f6fdc48de: Status 404 returned error can't find the container with id d8301db5e52091125ad133108d807c6a1f8c439d96af3e0d64ee9b4f6fdc48de Jun 03 23:08:03.918298 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:03.918214 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" event={"ID":"d887e2d9-67f7-40e1-84ab-f090f5b692ef","Type":"ContainerStarted","Data":"d8301db5e52091125ad133108d807c6a1f8c439d96af3e0d64ee9b4f6fdc48de"} Jun 03 23:08:06.932615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:06.932578 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gwz7n" event={"ID":"47659a03-f0a8-4bee-b7a5-c69a985289dd","Type":"ContainerStarted","Data":"fa28ec019d2624cc087e8f7cf9b7ac54691cb1c764915636d7a5b08fa54a3fc2"} Jun 03 23:08:06.954163 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:06.954098 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gwz7n" podStartSLOduration=1.801315631 podStartE2EDuration="4.954080123s" totalImagesPullingTime="3.152764492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:06.953249592 +0000 UTC m=+327.825925435" watchObservedRunningTime="2026-06-03 23:08:06.954080123 +0000 UTC m=+327.826755962" Jun 03 23:08:07.938812 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:07.938762 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" event={"ID":"d887e2d9-67f7-40e1-84ab-f090f5b692ef","Type":"ContainerStarted","Data":"82b9471ed1c54b97c2a0c4877f603d938051759b1715466a74129b715bfa6f44"} Jun 03 23:08:07.957085 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:07.956994 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-sxmxl" podStartSLOduration=1.3542388380000001 podStartE2EDuration="4.956978031s" totalImagesPullingTime="3.602739193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:07.95675537 +0000 UTC m=+328.829431214" watchObservedRunningTime="2026-06-03 23:08:07.956978031 +0000 UTC m=+328.829653871" Jun 03 23:08:08.695255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:08.695215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:08.793288 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:08.793254 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:10.459615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:10.459573 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:12.315478 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.315439 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w"] Jun 03 23:08:12.318829 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.318812 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.321555 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.321532 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrb4z\"" Jun 03 23:08:12.321869 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.321853 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:08:12.322781 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.322766 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:08:12.327197 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.327172 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w"] Jun 03 23:08:12.366559 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.366521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.366559 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.366561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.366810 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.366646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thcz8\" (UniqueName: \"kubernetes.io/projected/f3549948-7b6b-4bba-b661-5caf45b8026e-kube-api-access-thcz8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.467395 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.467354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thcz8\" (UniqueName: \"kubernetes.io/projected/f3549948-7b6b-4bba-b661-5caf45b8026e-kube-api-access-thcz8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.467395 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.467398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.467639 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.467426 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.467876 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.467854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.467937 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.467862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.477041 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.477014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thcz8\" (UniqueName: \"kubernetes.io/projected/f3549948-7b6b-4bba-b661-5caf45b8026e-kube-api-access-thcz8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.628772 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.628736 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:12.768320 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.768284 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w"] Jun 03 23:08:12.771251 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:12.771222 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3549948_7b6b_4bba_b661_5caf45b8026e.slice/crio-224d1cfdfb422b1fd72295c91ebf374ed597f05537a58abb8f207190b6933cb1 WatchSource:0}: Error finding container 224d1cfdfb422b1fd72295c91ebf374ed597f05537a58abb8f207190b6933cb1: Status 404 returned error can't find the container with id 224d1cfdfb422b1fd72295c91ebf374ed597f05537a58abb8f207190b6933cb1 Jun 03 23:08:12.959038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.958942 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerID="0d0cfb0779a05b961c86c41f6c7d53bb0e8bfde2ae42ee95359242b7afad1e4d" exitCode=0 Jun 03 23:08:12.959038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.958980 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" event={"ID":"f3549948-7b6b-4bba-b661-5caf45b8026e","Type":"ContainerDied","Data":"0d0cfb0779a05b961c86c41f6c7d53bb0e8bfde2ae42ee95359242b7afad1e4d"} Jun 03 23:08:12.959038 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:12.959033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" event={"ID":"f3549948-7b6b-4bba-b661-5caf45b8026e","Type":"ContainerStarted","Data":"224d1cfdfb422b1fd72295c91ebf374ed597f05537a58abb8f207190b6933cb1"} Jun 03 23:08:13.965633 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:13.965597 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerID="0f7bce70e08feaa0932149d35cde9273efe15328285c2f5f0294abac4f10badf" exitCode=0 Jun 03 23:08:13.966042 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:13.965642 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" event={"ID":"f3549948-7b6b-4bba-b661-5caf45b8026e","Type":"ContainerDied","Data":"0f7bce70e08feaa0932149d35cde9273efe15328285c2f5f0294abac4f10badf"} Jun 03 23:08:14.759316 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.759282 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:14.885905 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.885870 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:14.918225 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.918185 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm"] Jun 03 23:08:14.921437 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.921411 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:14.924585 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.924563 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qrqzx\"" Jun 03 23:08:14.925883 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.925862 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 23:08:14.926020 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.925916 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 23:08:14.926020 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.925938 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 23:08:14.931793 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.931753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm"] Jun 03 23:08:14.972084 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.972047 2567 generic.go:356] "Generic (PLEG): container finished" podID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerID="99c75caf16305307ebd517e0302ba7a5370acb14666f1b8fe1a21fc7196de430" exitCode=0 Jun 03 23:08:14.972508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.972091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" event={"ID":"f3549948-7b6b-4bba-b661-5caf45b8026e","Type":"ContainerDied","Data":"99c75caf16305307ebd517e0302ba7a5370acb14666f1b8fe1a21fc7196de430"} Jun 03 23:08:14.990255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.990227 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f1587fe-a1db-4d47-b45d-6c950426ebde-cert\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:14.990338 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.990266 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lbb5\" (UniqueName: \"kubernetes.io/projected/1f1587fe-a1db-4d47-b45d-6c950426ebde-kube-api-access-5lbb5\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:14.990338 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.990288 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f1587fe-a1db-4d47-b45d-6c950426ebde-manager-config\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:14.990338 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:14.990336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f1587fe-a1db-4d47-b45d-6c950426ebde-metrics-cert\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.090740 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.090615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f1587fe-a1db-4d47-b45d-6c950426ebde-metrics-cert\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.090740 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.090671 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f1587fe-a1db-4d47-b45d-6c950426ebde-cert\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.090950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.090824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lbb5\" (UniqueName: \"kubernetes.io/projected/1f1587fe-a1db-4d47-b45d-6c950426ebde-kube-api-access-5lbb5\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.090950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.090868 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f1587fe-a1db-4d47-b45d-6c950426ebde-manager-config\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.091593 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.091489 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1f1587fe-a1db-4d47-b45d-6c950426ebde-manager-config\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.093635 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.093606 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f1587fe-a1db-4d47-b45d-6c950426ebde-cert\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.093751 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.093616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1f1587fe-a1db-4d47-b45d-6c950426ebde-metrics-cert\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.100980 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.100953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lbb5\" (UniqueName: \"kubernetes.io/projected/1f1587fe-a1db-4d47-b45d-6c950426ebde-kube-api-access-5lbb5\") pod \"lws-controller-manager-6bbc48ffd-7wccm\" (UID: \"1f1587fe-a1db-4d47-b45d-6c950426ebde\") " pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.231724 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.231663 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:15.376484 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.376448 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm"] Jun 03 23:08:15.379869 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:15.379841 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1587fe_a1db_4d47_b45d_6c950426ebde.slice/crio-b2c0d7d2bf1367d31f03a609a0539152d54f5925a007a2535dea0cace370f2ac WatchSource:0}: Error finding container b2c0d7d2bf1367d31f03a609a0539152d54f5925a007a2535dea0cace370f2ac: Status 404 returned error can't find the container with id b2c0d7d2bf1367d31f03a609a0539152d54f5925a007a2535dea0cace370f2ac Jun 03 23:08:15.977377 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:15.977344 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" event={"ID":"1f1587fe-a1db-4d47-b45d-6c950426ebde","Type":"ContainerStarted","Data":"b2c0d7d2bf1367d31f03a609a0539152d54f5925a007a2535dea0cace370f2ac"} Jun 03 23:08:16.112817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.112793 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:16.200158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.200124 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-util\") pod \"f3549948-7b6b-4bba-b661-5caf45b8026e\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " Jun 03 23:08:16.200158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.200168 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thcz8\" (UniqueName: \"kubernetes.io/projected/f3549948-7b6b-4bba-b661-5caf45b8026e-kube-api-access-thcz8\") pod \"f3549948-7b6b-4bba-b661-5caf45b8026e\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " Jun 03 23:08:16.200369 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.200269 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-bundle\") pod \"f3549948-7b6b-4bba-b661-5caf45b8026e\" (UID: \"f3549948-7b6b-4bba-b661-5caf45b8026e\") " Jun 03 23:08:16.200960 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.200940 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-bundle" (OuterVolumeSpecName: "bundle") pod "f3549948-7b6b-4bba-b661-5caf45b8026e" (UID: "f3549948-7b6b-4bba-b661-5caf45b8026e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:08:16.202432 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.202415 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3549948-7b6b-4bba-b661-5caf45b8026e-kube-api-access-thcz8" (OuterVolumeSpecName: "kube-api-access-thcz8") pod "f3549948-7b6b-4bba-b661-5caf45b8026e" (UID: "f3549948-7b6b-4bba-b661-5caf45b8026e"). InnerVolumeSpecName "kube-api-access-thcz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:08:16.207824 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.207798 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-util" (OuterVolumeSpecName: "util") pod "f3549948-7b6b-4bba-b661-5caf45b8026e" (UID: "f3549948-7b6b-4bba-b661-5caf45b8026e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:08:16.300961 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.300878 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:08:16.300961 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.300908 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thcz8\" (UniqueName: \"kubernetes.io/projected/f3549948-7b6b-4bba-b661-5caf45b8026e-kube-api-access-thcz8\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:08:16.300961 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.300917 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3549948-7b6b-4bba-b661-5caf45b8026e-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:08:16.985856 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.985817 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" event={"ID":"f3549948-7b6b-4bba-b661-5caf45b8026e","Type":"ContainerDied","Data":"224d1cfdfb422b1fd72295c91ebf374ed597f05537a58abb8f207190b6933cb1"} Jun 03 23:08:16.985856 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.985857 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnvg7w" Jun 03 23:08:16.985856 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:16.985877 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="224d1cfdfb422b1fd72295c91ebf374ed597f05537a58abb8f207190b6933cb1" Jun 03 23:08:17.991955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:17.991913 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" event={"ID":"1f1587fe-a1db-4d47-b45d-6c950426ebde","Type":"ContainerStarted","Data":"4465c5e1cb4adb2401743b79d8b4a2f33221b53a153f6872b4f3a6c41dbfc8d0"} Jun 03 23:08:17.992414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:17.992005 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:18.012826 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:18.012773 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" podStartSLOduration=1.959543278 podStartE2EDuration="4.012757425s" totalImagesPullingTime="2.053214147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:18.011895639 +0000 UTC m=+338.884571481" watchObservedRunningTime="2026-06-03 23:08:18.012757425 +0000 UTC m=+338.885433265" Jun 03 23:08:22.441300 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:22.441262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:22.572382 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:22.572340 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.058035 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.057952 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.324325 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.324230 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.441343 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.441310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.545542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545504 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97"] Jun 03 23:08:23.545801 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545788 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="pull" Jun 03 23:08:23.545862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545803 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="pull" Jun 03 23:08:23.545862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545816 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="util" Jun 03 23:08:23.545862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545822 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="util" Jun 03 23:08:23.545862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545828 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="extract" Jun 03 23:08:23.545862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545834 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="extract" Jun 03 23:08:23.546058 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.545879 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3549948-7b6b-4bba-b661-5caf45b8026e" containerName="extract" Jun 03 23:08:23.548907 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.548888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.552671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.552646 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 23:08:23.552825 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.552695 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 23:08:23.553118 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.553103 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 23:08:23.553317 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.553303 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jt2zl\"" Jun 03 23:08:23.564609 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.564578 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 23:08:23.594748 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.594648 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97"] Jun 03 23:08:23.660029 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.659988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mswt\" (UniqueName: \"kubernetes.io/projected/5425e493-6474-43cc-b504-6ec41733babd-kube-api-access-6mswt\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.660227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.660043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5425e493-6474-43cc-b504-6ec41733babd-tmp\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.660227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.660109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5425e493-6474-43cc-b504-6ec41733babd-manifests\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.660227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.660166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5425e493-6474-43cc-b504-6ec41733babd-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.660227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.660186 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5425e493-6474-43cc-b504-6ec41733babd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.696696 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.696634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.761048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.761009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mswt\" (UniqueName: \"kubernetes.io/projected/5425e493-6474-43cc-b504-6ec41733babd-kube-api-access-6mswt\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.761230 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.761062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5425e493-6474-43cc-b504-6ec41733babd-tmp\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.761230 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.761087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5425e493-6474-43cc-b504-6ec41733babd-manifests\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.761230 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.761117 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5425e493-6474-43cc-b504-6ec41733babd-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.761230 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.761142 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5425e493-6474-43cc-b504-6ec41733babd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.761554 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.761524 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5425e493-6474-43cc-b504-6ec41733babd-manifests\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.763756 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.763720 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5425e493-6474-43cc-b504-6ec41733babd-tmp\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.763890 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.763775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5425e493-6474-43cc-b504-6ec41733babd-webhook-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.763890 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.763857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5425e493-6474-43cc-b504-6ec41733babd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.774080 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.774051 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mswt\" (UniqueName: \"kubernetes.io/projected/5425e493-6474-43cc-b504-6ec41733babd-kube-api-access-6mswt\") pod \"opendatahub-operator-controller-manager-588c8dd987-6tj97\" (UID: \"5425e493-6474-43cc-b504-6ec41733babd\") " pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.795133 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.795097 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.859619 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.859582 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:23.895100 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.895055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:23.974720 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:23.974665 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:24.004094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:24.004070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97"] Jun 03 23:08:24.006340 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:24.006309 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5425e493_6474_43cc_b504_6ec41733babd.slice/crio-fb9b08f2cc34e43093f47a773081eb5f9319bea68472699265f31347e4785c2e WatchSource:0}: Error finding container fb9b08f2cc34e43093f47a773081eb5f9319bea68472699265f31347e4785c2e: Status 404 returned error can't find the container with id fb9b08f2cc34e43093f47a773081eb5f9319bea68472699265f31347e4785c2e Jun 03 23:08:24.017433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:24.017405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" event={"ID":"5425e493-6474-43cc-b504-6ec41733babd","Type":"ContainerStarted","Data":"fb9b08f2cc34e43093f47a773081eb5f9319bea68472699265f31347e4785c2e"} Jun 03 23:08:24.039926 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:24.039893 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:24.140254 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:24.140145 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:24.240377 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:24.240344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:27.034369 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:27.034332 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" event={"ID":"5425e493-6474-43cc-b504-6ec41733babd","Type":"ContainerStarted","Data":"42c0e22c2375be3e45a27d35ec712a72aab8d5daacd56e7e0ca92205f39bf65a"} Jun 03 23:08:28.040327 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:28.040290 2567 generic.go:356] "Generic (PLEG): container finished" podID="5425e493-6474-43cc-b504-6ec41733babd" containerID="42c0e22c2375be3e45a27d35ec712a72aab8d5daacd56e7e0ca92205f39bf65a" exitCode=0 Jun 03 23:08:28.040755 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:28.040356 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" event={"ID":"5425e493-6474-43cc-b504-6ec41733babd","Type":"ContainerDied","Data":"42c0e22c2375be3e45a27d35ec712a72aab8d5daacd56e7e0ca92205f39bf65a"} Jun 03 23:08:28.998453 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:28.998409 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bbc48ffd-7wccm" Jun 03 23:08:29.049260 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:29.049229 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" event={"ID":"5425e493-6474-43cc-b504-6ec41733babd","Type":"ContainerStarted","Data":"caa0cadcbac46434d4bcca1a78481a14ec435159e081a9a70f8c32c7a4f20677"} Jun 03 23:08:29.049758 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:29.049519 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:29.087799 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:29.087741 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" podStartSLOduration=1.961995048 podStartE2EDuration="6.087722453s" totalImagesPullingTime="3.221944373s" totalInitContainerRuntime="903.783032ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:08:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:08:29.085070096 +0000 UTC m=+349.957745939" watchObservedRunningTime="2026-06-03 23:08:29.087722453 +0000 UTC m=+349.960398283" Jun 03 23:08:40.056066 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:40.056033 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-588c8dd987-6tj97" Jun 03 23:08:42.242526 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:42.242487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:42.418468 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:42.418403 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.272361 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.272318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.375914 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.375876 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.451229 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.451187 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s"] Jun 03 23:08:43.454722 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.454677 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.541690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.541599 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.573065 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.573030 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s"] Jun 03 23:08:43.573240 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.573143 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.576331 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.576303 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:08:43.577729 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.577691 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:08:43.577855 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.577760 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrb4z\"" Jun 03 23:08:43.649985 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.649948 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.729694 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.729656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.729892 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.729730 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.729892 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.729806 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxsxh\" (UniqueName: \"kubernetes.io/projected/589c2186-6de0-4c7a-9819-486fb95461cc-kube-api-access-gxsxh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.755676 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.755635 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.830950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.830853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.830950 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.830915 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxsxh\" (UniqueName: \"kubernetes.io/projected/589c2186-6de0-4c7a-9819-486fb95461cc-kube-api-access-gxsxh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.831140 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.830966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.831226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.831207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.831332 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.831310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.840839 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.840802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxsxh\" (UniqueName: \"kubernetes.io/projected/589c2186-6de0-4c7a-9819-486fb95461cc-kube-api-access-gxsxh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.859603 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.859554 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:43.884541 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.884506 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:43.952177 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:43.952144 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:44.060210 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:44.060019 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s"] Jun 03 23:08:44.063618 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:44.063583 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589c2186_6de0_4c7a_9819_486fb95461cc.slice/crio-0cd3e8bb391eeca746d018503e0205667aeda9ec21a153aa23962c917e7218b1 WatchSource:0}: Error finding container 0cd3e8bb391eeca746d018503e0205667aeda9ec21a153aa23962c917e7218b1: Status 404 returned error can't find the container with id 0cd3e8bb391eeca746d018503e0205667aeda9ec21a153aa23962c917e7218b1 Jun 03 23:08:44.114549 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:44.114512 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" event={"ID":"589c2186-6de0-4c7a-9819-486fb95461cc","Type":"ContainerStarted","Data":"0cd3e8bb391eeca746d018503e0205667aeda9ec21a153aa23962c917e7218b1"} Jun 03 23:08:44.218906 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:44.218869 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:44.511110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:44.511067 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:44.673643 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:44.673613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:45.023824 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:45.023792 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:45.088002 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:45.087965 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:45.120850 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:45.120815 2567 generic.go:356] "Generic (PLEG): container finished" podID="589c2186-6de0-4c7a-9819-486fb95461cc" containerID="f4a9d4a9b0283f0418788ce8437bb1df419db0f2012e6b36f7d65f4099cb1f82" exitCode=0 Jun 03 23:08:45.121022 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:45.120876 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" event={"ID":"589c2186-6de0-4c7a-9819-486fb95461cc","Type":"ContainerDied","Data":"f4a9d4a9b0283f0418788ce8437bb1df419db0f2012e6b36f7d65f4099cb1f82"} Jun 03 23:08:46.127024 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:46.126989 2567 generic.go:356] "Generic (PLEG): container finished" podID="589c2186-6de0-4c7a-9819-486fb95461cc" containerID="9b0d39c6197ee5fb2b54d2ffc085ae8ec8d93c4e4df4070b43a5e47f65d12c3e" exitCode=0 Jun 03 23:08:46.127467 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:46.127058 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" event={"ID":"589c2186-6de0-4c7a-9819-486fb95461cc","Type":"ContainerDied","Data":"9b0d39c6197ee5fb2b54d2ffc085ae8ec8d93c4e4df4070b43a5e47f65d12c3e"} Jun 03 23:08:47.133468 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:47.133427 2567 generic.go:356] "Generic (PLEG): container finished" podID="589c2186-6de0-4c7a-9819-486fb95461cc" containerID="529908ada1e0cdbe95cdde795e96d275434f98d52f82af04a9632aecb75f44f5" exitCode=0 Jun 03 23:08:47.133864 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:47.133493 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" event={"ID":"589c2186-6de0-4c7a-9819-486fb95461cc","Type":"ContainerDied","Data":"529908ada1e0cdbe95cdde795e96d275434f98d52f82af04a9632aecb75f44f5"} Jun 03 23:08:48.284508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.284470 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:48.364918 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.364877 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-util\") pod \"589c2186-6de0-4c7a-9819-486fb95461cc\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " Jun 03 23:08:48.365108 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.364939 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-bundle\") pod \"589c2186-6de0-4c7a-9819-486fb95461cc\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " Jun 03 23:08:48.365108 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.364996 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxsxh\" (UniqueName: \"kubernetes.io/projected/589c2186-6de0-4c7a-9819-486fb95461cc-kube-api-access-gxsxh\") pod \"589c2186-6de0-4c7a-9819-486fb95461cc\" (UID: \"589c2186-6de0-4c7a-9819-486fb95461cc\") " Jun 03 23:08:48.366047 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.366016 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-bundle" (OuterVolumeSpecName: "bundle") pod "589c2186-6de0-4c7a-9819-486fb95461cc" (UID: "589c2186-6de0-4c7a-9819-486fb95461cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:08:48.367308 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.367279 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589c2186-6de0-4c7a-9819-486fb95461cc-kube-api-access-gxsxh" (OuterVolumeSpecName: "kube-api-access-gxsxh") pod "589c2186-6de0-4c7a-9819-486fb95461cc" (UID: "589c2186-6de0-4c7a-9819-486fb95461cc"). InnerVolumeSpecName "kube-api-access-gxsxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:08:48.370364 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.370318 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-util" (OuterVolumeSpecName: "util") pod "589c2186-6de0-4c7a-9819-486fb95461cc" (UID: "589c2186-6de0-4c7a-9819-486fb95461cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:08:48.465924 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.465831 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:08:48.465924 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.465864 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589c2186-6de0-4c7a-9819-486fb95461cc-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:08:48.465924 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:48.465876 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxsxh\" (UniqueName: \"kubernetes.io/projected/589c2186-6de0-4c7a-9819-486fb95461cc-kube-api-access-gxsxh\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:08:49.144698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:49.144664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" event={"ID":"589c2186-6de0-4c7a-9819-486fb95461cc","Type":"ContainerDied","Data":"0cd3e8bb391eeca746d018503e0205667aeda9ec21a153aa23962c917e7218b1"} Jun 03 23:08:49.144893 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:49.144724 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06wrh8s" Jun 03 23:08:49.144893 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:49.144744 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cd3e8bb391eeca746d018503e0205667aeda9ec21a153aa23962c917e7218b1" Jun 03 23:08:54.422729 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:54.420263 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:54.530054 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:54.530010 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:54.655900 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:54.655865 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:54.844507 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:54.844421 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:55.785365 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:55.785325 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:55.888983 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:55.888950 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:56.763857 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:56.763813 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:56.942090 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:56.942053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:57.982594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982552 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd"] Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982856 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="extract" Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982869 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="extract" Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982878 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="util" Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982883 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="util" Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982902 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="pull" Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982907 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="pull" Jun 03 23:08:57.982992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.982955 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="589c2186-6de0-4c7a-9819-486fb95461cc" containerName="extract" Jun 03 23:08:57.986138 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.986115 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:57.993485 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.993463 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:08:57.994552 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.994527 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:08:57.996464 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:57.996447 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrb4z\"" Jun 03 23:08:58.042000 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.041957 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd"] Jun 03 23:08:58.144714 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.144676 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.144889 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.144755 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4f9m\" (UniqueName: \"kubernetes.io/projected/6aecc07d-8aef-4a38-a06f-542973f93298-kube-api-access-p4f9m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.144889 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.144790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.245727 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.245594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.245727 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.245643 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4f9m\" (UniqueName: \"kubernetes.io/projected/6aecc07d-8aef-4a38-a06f-542973f93298-kube-api-access-p4f9m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.245727 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.245678 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.246117 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.246092 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.246179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.246118 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.289552 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.289504 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4f9m\" (UniqueName: \"kubernetes.io/projected/6aecc07d-8aef-4a38-a06f-542973f93298-kube-api-access-p4f9m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.296075 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.296044 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:08:58.487521 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.487485 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd"] Jun 03 23:08:58.492046 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:08:58.492014 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aecc07d_8aef_4a38_a06f_542973f93298.slice/crio-0259df6ddb748c76cbaf0c4f7a6e09c5688938c03a6f94268828ff6a876e315a WatchSource:0}: Error finding container 0259df6ddb748c76cbaf0c4f7a6e09c5688938c03a6f94268828ff6a876e315a: Status 404 returned error can't find the container with id 0259df6ddb748c76cbaf0c4f7a6e09c5688938c03a6f94268828ff6a876e315a Jun 03 23:08:58.717341 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.717304 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:58.882631 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:58.882597 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:59.013187 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:59.013156 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:59.159333 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:59.159243 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:08:59.187188 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:59.187148 2567 generic.go:356] "Generic (PLEG): container finished" podID="6aecc07d-8aef-4a38-a06f-542973f93298" containerID="4bd022067a224d18d7c9578b2a7c85d20354b41056ed474cf536b7eeb7284996" exitCode=0 Jun 03 23:08:59.187336 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:59.187232 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" event={"ID":"6aecc07d-8aef-4a38-a06f-542973f93298","Type":"ContainerDied","Data":"4bd022067a224d18d7c9578b2a7c85d20354b41056ed474cf536b7eeb7284996"} Jun 03 23:08:59.187336 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:59.187287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" event={"ID":"6aecc07d-8aef-4a38-a06f-542973f93298","Type":"ContainerStarted","Data":"0259df6ddb748c76cbaf0c4f7a6e09c5688938c03a6f94268828ff6a876e315a"} Jun 03 23:08:59.687103 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:08:59.687058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:01.197910 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:01.197877 2567 generic.go:356] "Generic (PLEG): container finished" podID="6aecc07d-8aef-4a38-a06f-542973f93298" containerID="2f79ef715ce2f9cdcd8834fada042b08a0baed4c77c99765dc022db5f91e7221" exitCode=0 Jun 03 23:09:01.198442 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:01.197970 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" event={"ID":"6aecc07d-8aef-4a38-a06f-542973f93298","Type":"ContainerDied","Data":"2f79ef715ce2f9cdcd8834fada042b08a0baed4c77c99765dc022db5f91e7221"} Jun 03 23:09:02.204767 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:02.204728 2567 generic.go:356] "Generic (PLEG): container finished" podID="6aecc07d-8aef-4a38-a06f-542973f93298" containerID="ecd46f9321178488bf33127fb74234f5518f0ab77c576238ca520d2a0c76a3fb" exitCode=0 Jun 03 23:09:02.205149 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:02.204800 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" event={"ID":"6aecc07d-8aef-4a38-a06f-542973f93298","Type":"ContainerDied","Data":"ecd46f9321178488bf33127fb74234f5518f0ab77c576238ca520d2a0c76a3fb"} Jun 03 23:09:03.334773 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.334746 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:09:03.388583 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.388540 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4f9m\" (UniqueName: \"kubernetes.io/projected/6aecc07d-8aef-4a38-a06f-542973f93298-kube-api-access-p4f9m\") pod \"6aecc07d-8aef-4a38-a06f-542973f93298\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " Jun 03 23:09:03.390862 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.390829 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aecc07d-8aef-4a38-a06f-542973f93298-kube-api-access-p4f9m" (OuterVolumeSpecName: "kube-api-access-p4f9m") pod "6aecc07d-8aef-4a38-a06f-542973f93298" (UID: "6aecc07d-8aef-4a38-a06f-542973f93298"). InnerVolumeSpecName "kube-api-access-p4f9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:09:03.489234 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.489129 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-util\") pod \"6aecc07d-8aef-4a38-a06f-542973f93298\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " Jun 03 23:09:03.489234 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.489229 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-bundle\") pod \"6aecc07d-8aef-4a38-a06f-542973f93298\" (UID: \"6aecc07d-8aef-4a38-a06f-542973f93298\") " Jun 03 23:09:03.489456 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.489409 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4f9m\" (UniqueName: \"kubernetes.io/projected/6aecc07d-8aef-4a38-a06f-542973f93298-kube-api-access-p4f9m\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:09:03.490158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.490127 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-bundle" (OuterVolumeSpecName: "bundle") pod "6aecc07d-8aef-4a38-a06f-542973f93298" (UID: "6aecc07d-8aef-4a38-a06f-542973f93298"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:09:03.494612 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.494571 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-util" (OuterVolumeSpecName: "util") pod "6aecc07d-8aef-4a38-a06f-542973f93298" (UID: "6aecc07d-8aef-4a38-a06f-542973f93298"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:09:03.590095 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.590056 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:09:03.590095 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:03.590088 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6aecc07d-8aef-4a38-a06f-542973f93298-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:09:04.214638 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:04.214599 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" event={"ID":"6aecc07d-8aef-4a38-a06f-542973f93298","Type":"ContainerDied","Data":"0259df6ddb748c76cbaf0c4f7a6e09c5688938c03a6f94268828ff6a876e315a"} Jun 03 23:09:04.214638 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:04.214635 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a5mzpd" Jun 03 23:09:04.214878 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:04.214657 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0259df6ddb748c76cbaf0c4f7a6e09c5688938c03a6f94268828ff6a876e315a" Jun 03 23:09:09.923762 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:09.923723 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:10.028762 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:10.028696 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:13.947218 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947181 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-574764c5bd-2zr7x"] Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947477 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="util" Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947489 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="util" Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947502 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="extract" Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947507 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="extract" Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947523 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="pull" Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947528 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="pull" Jun 03 23:09:13.947598 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.947576 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aecc07d-8aef-4a38-a06f-542973f93298" containerName="extract" Jun 03 23:09:13.950663 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.950645 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:13.954121 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.954095 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 23:09:13.954375 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.954360 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bztwh\"" Jun 03 23:09:13.967661 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.967627 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-574764c5bd-2zr7x"] Jun 03 23:09:13.974241 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.974213 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57ca6262-0461-4409-ab3d-502b46b59ba8-redirect-config\") pod \"dashboard-redirect-574764c5bd-2zr7x\" (UID: \"57ca6262-0461-4409-ab3d-502b46b59ba8\") " pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:13.974372 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.974250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xk6l\" (UniqueName: \"kubernetes.io/projected/57ca6262-0461-4409-ab3d-502b46b59ba8-kube-api-access-8xk6l\") pod \"dashboard-redirect-574764c5bd-2zr7x\" (UID: \"57ca6262-0461-4409-ab3d-502b46b59ba8\") " pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:13.981635 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:13.981609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:14.069826 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.069788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:14.074923 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.074895 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57ca6262-0461-4409-ab3d-502b46b59ba8-redirect-config\") pod \"dashboard-redirect-574764c5bd-2zr7x\" (UID: \"57ca6262-0461-4409-ab3d-502b46b59ba8\") " pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:14.075046 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.074940 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xk6l\" (UniqueName: \"kubernetes.io/projected/57ca6262-0461-4409-ab3d-502b46b59ba8-kube-api-access-8xk6l\") pod \"dashboard-redirect-574764c5bd-2zr7x\" (UID: \"57ca6262-0461-4409-ab3d-502b46b59ba8\") " pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:14.075801 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.075780 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57ca6262-0461-4409-ab3d-502b46b59ba8-redirect-config\") pod \"dashboard-redirect-574764c5bd-2zr7x\" (UID: \"57ca6262-0461-4409-ab3d-502b46b59ba8\") " pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:14.086348 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.086322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xk6l\" (UniqueName: \"kubernetes.io/projected/57ca6262-0461-4409-ab3d-502b46b59ba8-kube-api-access-8xk6l\") pod \"dashboard-redirect-574764c5bd-2zr7x\" (UID: \"57ca6262-0461-4409-ab3d-502b46b59ba8\") " pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:14.261410 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.261324 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" Jun 03 23:09:14.398659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.398592 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-574764c5bd-2zr7x"] Jun 03 23:09:14.401324 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:09:14.401297 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ca6262_0461_4409_ab3d_502b46b59ba8.slice/crio-870e8d74153df99935d445b456c87cc6e427adca1a6a989d1e2fe25e02bda962 WatchSource:0}: Error finding container 870e8d74153df99935d445b456c87cc6e427adca1a6a989d1e2fe25e02bda962: Status 404 returned error can't find the container with id 870e8d74153df99935d445b456c87cc6e427adca1a6a989d1e2fe25e02bda962 Jun 03 23:09:14.544057 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:14.543965 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:15.267772 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:15.267678 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" event={"ID":"57ca6262-0461-4409-ab3d-502b46b59ba8","Type":"ContainerStarted","Data":"870e8d74153df99935d445b456c87cc6e427adca1a6a989d1e2fe25e02bda962"} Jun 03 23:09:19.295540 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:19.295449 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" event={"ID":"57ca6262-0461-4409-ab3d-502b46b59ba8","Type":"ContainerStarted","Data":"c1483523c3c4676b43033aaa8e1c90aeb5404dae6e025f1fe7b58261bd080b82"} Jun 03 23:09:19.316620 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:19.316561 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-574764c5bd-2zr7x" podStartSLOduration=1.825003604 podStartE2EDuration="6.316544331s" totalImagesPullingTime="4.491540727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:19.314278173 +0000 UTC m=+400.186954012" watchObservedRunningTime="2026-06-03 23:09:19.316544331 +0000 UTC m=+400.189220351" Jun 03 23:09:20.310474 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.310431 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:20.411843 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.411799 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:20.591182 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.591087 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll"] Jun 03 23:09:20.596455 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.596429 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.599305 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.599277 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 23:09:20.599698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.599519 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 23:09:20.599698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.599563 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-r22f2\"" Jun 03 23:09:20.600013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.599800 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 23:09:20.607491 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.607463 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll"] Jun 03 23:09:20.625490 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625495 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969dd539-a811-4f8e-ab14-dcb5645ff884-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcbhb\" (UniqueName: \"kubernetes.io/projected/969dd539-a811-4f8e-ab14-dcb5645ff884-kube-api-access-xcbhb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625633 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625658 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625874 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625675 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.625874 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.625690 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.633865 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.633834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:20.726955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.726918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.726955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.726959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcbhb\" (UniqueName: \"kubernetes.io/projected/969dd539-a811-4f8e-ab14-dcb5645ff884-kube-api-access-xcbhb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727010 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727052 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727102 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969dd539-a811-4f8e-ab14-dcb5645ff884-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727227 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727195 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727573 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727573 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727678 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727611 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.727818 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.728021 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.727997 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/969dd539-a811-4f8e-ab14-dcb5645ff884-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.728998 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.728969 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:20.730204 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.730175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.730304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.730284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.744273 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.744246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcbhb\" (UniqueName: \"kubernetes.io/projected/969dd539-a811-4f8e-ab14-dcb5645ff884-kube-api-access-xcbhb\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.745626 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.745601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969dd539-a811-4f8e-ab14-dcb5645ff884-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xkrll\" (UID: \"969dd539-a811-4f8e-ab14-dcb5645ff884\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:20.826634 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.826597 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:20.908186 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:20.908142 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:21.059747 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:21.059720 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll"] Jun 03 23:09:21.061680 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:09:21.061653 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969dd539_a811_4f8e_ab14_dcb5645ff884.slice/crio-19b272c84259309ec269651fe958671373e6ff29e15cfac2c155f743dfb9c30a WatchSource:0}: Error finding container 19b272c84259309ec269651fe958671373e6ff29e15cfac2c155f743dfb9c30a: Status 404 returned error can't find the container with id 19b272c84259309ec269651fe958671373e6ff29e15cfac2c155f743dfb9c30a Jun 03 23:09:21.308305 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:21.308208 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" event={"ID":"969dd539-a811-4f8e-ab14-dcb5645ff884","Type":"ContainerStarted","Data":"19b272c84259309ec269651fe958671373e6ff29e15cfac2c155f743dfb9c30a"} Jun 03 23:09:22.618250 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:22.618169 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:24.232394 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:24.232350 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:09:24.232909 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:24.232424 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:09:24.232909 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:24.232455 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:09:24.330651 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:24.330608 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" event={"ID":"969dd539-a811-4f8e-ab14-dcb5645ff884","Type":"ContainerStarted","Data":"8582b7637f5eb4a6840583ea78e48248108d1c0edcbb27544d6ce5bcabe8d8a6"} Jun 03 23:09:24.355945 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:24.355888 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" podStartSLOduration=1.1873895 podStartE2EDuration="4.355870729s" totalImagesPullingTime="3.168481229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:24.354756193 +0000 UTC m=+405.227432034" watchObservedRunningTime="2026-06-03 23:09:24.355870729 +0000 UTC m=+405.228546569" Jun 03 23:09:24.909261 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:24.909219 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:25.913884 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:25.913842 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:26.339802 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:26.339723 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:26.340765 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:26.340746 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xkrll" Jun 03 23:09:43.802331 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.802284 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:43.903558 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.903513 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:43.923015 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.922983 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-294b4"] Jun 03 23:09:43.928414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.928382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:43.932852 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.932828 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mx9lm\"" Jun 03 23:09:43.933981 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.933958 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:09:43.933981 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.933970 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:09:43.943054 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:43.943025 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-294b4"] Jun 03 23:09:44.001149 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.001091 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:44.026352 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.026311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzjcv\" (UniqueName: \"kubernetes.io/projected/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c-kube-api-access-wzjcv\") pod \"kuadrant-operator-catalog-294b4\" (UID: \"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c\") " pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:44.127682 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.127645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzjcv\" (UniqueName: \"kubernetes.io/projected/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c-kube-api-access-wzjcv\") pod \"kuadrant-operator-catalog-294b4\" (UID: \"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c\") " pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:44.139177 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.139140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzjcv\" (UniqueName: \"kubernetes.io/projected/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c-kube-api-access-wzjcv\") pod \"kuadrant-operator-catalog-294b4\" (UID: \"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c\") " pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:44.239336 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.239281 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:44.265593 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.265561 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-294b4"] Jun 03 23:09:44.382023 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.381996 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-294b4"] Jun 03 23:09:44.384151 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:09:44.384121 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcc8065_3a98_4fdb_8bd7_79e585bdaa0c.slice/crio-1a24746be558c617d9cb47dfea7f33544098754528d718f456ef465ffef8b821 WatchSource:0}: Error finding container 1a24746be558c617d9cb47dfea7f33544098754528d718f456ef465ffef8b821: Status 404 returned error can't find the container with id 1a24746be558c617d9cb47dfea7f33544098754528d718f456ef465ffef8b821 Jun 03 23:09:44.417775 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.417740 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-294b4" event={"ID":"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c","Type":"ContainerStarted","Data":"1a24746be558c617d9cb47dfea7f33544098754528d718f456ef465ffef8b821"} Jun 03 23:09:44.519589 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.519552 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bsdp"] Jun 03 23:09:44.526524 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.526495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:44.543126 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.543085 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bsdp"] Jun 03 23:09:44.632186 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.632086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4w7b\" (UniqueName: \"kubernetes.io/projected/9bbd9762-9cfa-4eee-b438-b744c1790a41-kube-api-access-w4w7b\") pod \"kuadrant-operator-catalog-2bsdp\" (UID: \"9bbd9762-9cfa-4eee-b438-b744c1790a41\") " pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:44.732883 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.732837 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4w7b\" (UniqueName: \"kubernetes.io/projected/9bbd9762-9cfa-4eee-b438-b744c1790a41-kube-api-access-w4w7b\") pod \"kuadrant-operator-catalog-2bsdp\" (UID: \"9bbd9762-9cfa-4eee-b438-b744c1790a41\") " pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:44.741748 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.741690 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4w7b\" (UniqueName: \"kubernetes.io/projected/9bbd9762-9cfa-4eee-b438-b744c1790a41-kube-api-access-w4w7b\") pod \"kuadrant-operator-catalog-2bsdp\" (UID: \"9bbd9762-9cfa-4eee-b438-b744c1790a41\") " pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:44.836048 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.836014 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:44.987030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:44.987003 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bsdp"] Jun 03 23:09:44.988802 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:09:44.988777 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbd9762_9cfa_4eee_b438_b744c1790a41.slice/crio-55454e5501109ace95b6b353a4a42c531fce9bb2f6f6c481dbd346fcfce8c351 WatchSource:0}: Error finding container 55454e5501109ace95b6b353a4a42c531fce9bb2f6f6c481dbd346fcfce8c351: Status 404 returned error can't find the container with id 55454e5501109ace95b6b353a4a42c531fce9bb2f6f6c481dbd346fcfce8c351 Jun 03 23:09:45.423610 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:45.423569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" event={"ID":"9bbd9762-9cfa-4eee-b438-b744c1790a41","Type":"ContainerStarted","Data":"55454e5501109ace95b6b353a4a42c531fce9bb2f6f6c481dbd346fcfce8c351"} Jun 03 23:09:47.434406 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.434369 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-294b4" event={"ID":"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c","Type":"ContainerStarted","Data":"5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831"} Jun 03 23:09:47.434856 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.434458 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-294b4" podUID="8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" containerName="registry-server" containerID="cri-o://5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831" gracePeriod=2 Jun 03 23:09:47.435917 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.435877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" event={"ID":"9bbd9762-9cfa-4eee-b438-b744c1790a41","Type":"ContainerStarted","Data":"edfe1b0a486b3b89f5caf8299889a162dcd9e9c660f21f48ae140d09dd933aaf"} Jun 03 23:09:47.503880 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.503809 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-294b4" podStartSLOduration=2.232457892 podStartE2EDuration="4.503761301s" totalImagesPullingTime="2.271303409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:47.469778981 +0000 UTC m=+428.342454820" watchObservedRunningTime="2026-06-03 23:09:47.503761301 +0000 UTC m=+428.376437141" Jun 03 23:09:47.685587 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.685516 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:47.720767 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.720687 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" podStartSLOduration=2.050728516 podStartE2EDuration="3.720670031s" totalImagesPullingTime="1.669941515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:09:47.503946835 +0000 UTC m=+428.376622675" watchObservedRunningTime="2026-06-03 23:09:47.720670031 +0000 UTC m=+428.593345870" Jun 03 23:09:47.862021 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.861982 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzjcv\" (UniqueName: \"kubernetes.io/projected/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c-kube-api-access-wzjcv\") pod \"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c\" (UID: \"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c\") " Jun 03 23:09:47.864384 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.864358 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c-kube-api-access-wzjcv" (OuterVolumeSpecName: "kube-api-access-wzjcv") pod "8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" (UID: "8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c"). InnerVolumeSpecName "kube-api-access-wzjcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:09:47.963365 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:47.963274 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzjcv\" (UniqueName: \"kubernetes.io/projected/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c-kube-api-access-wzjcv\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:09:48.441682 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.441650 2567 generic.go:356] "Generic (PLEG): container finished" podID="8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" containerID="5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831" exitCode=0 Jun 03 23:09:48.442126 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.441698 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-294b4" Jun 03 23:09:48.442126 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.441745 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-294b4" event={"ID":"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c","Type":"ContainerDied","Data":"5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831"} Jun 03 23:09:48.442126 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.441799 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-294b4" event={"ID":"8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c","Type":"ContainerDied","Data":"1a24746be558c617d9cb47dfea7f33544098754528d718f456ef465ffef8b821"} Jun 03 23:09:48.442126 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.441823 2567 scope.go:117] "RemoveContainer" containerID="5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831" Jun 03 23:09:48.451866 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.451848 2567 scope.go:117] "RemoveContainer" containerID="5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831" Jun 03 23:09:48.452141 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:09:48.452123 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831\": container with ID starting with 5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831 not found: ID does not exist" containerID="5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831" Jun 03 23:09:48.452210 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.452153 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831"} err="failed to get container status \"5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831\": rpc error: code = NotFound desc = could not find container \"5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831\": container with ID starting with 5d04dd0c5774a4e796e5d00a2d5eba4478c655b5bd03e893966fd6589f86c831 not found: ID does not exist" Jun 03 23:09:48.464256 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.464221 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-294b4"] Jun 03 23:09:48.468621 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:48.468593 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-294b4"] Jun 03 23:09:49.635997 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:49.635964 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" path="/var/lib/kubelet/pods/8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c/volumes" Jun 03 23:09:54.837134 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:54.837035 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:54.837134 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:54.837099 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:54.860547 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:54.860518 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:55.500335 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:55.500302 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2bsdp" Jun 03 23:09:57.528280 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:57.528246 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:57.624778 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:57.624738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:09:59.675793 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.675752 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2"] Jun 03 23:09:59.676279 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.676213 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" containerName="registry-server" Jun 03 23:09:59.676279 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.676232 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" containerName="registry-server" Jun 03 23:09:59.676396 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.676319 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dcc8065-3a98-4fdb-8bd7-79e585bdaa0c" containerName="registry-server" Jun 03 23:09:59.691667 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.691635 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2"] Jun 03 23:09:59.691848 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.691780 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.695031 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.695004 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m4mqh\"" Jun 03 23:09:59.763897 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.763857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.764081 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.763901 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.764081 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.763981 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56blq\" (UniqueName: \"kubernetes.io/projected/1bc1ab34-0145-464e-8d8a-7e62f8959b05-kube-api-access-56blq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.865091 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.865051 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.865091 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.865095 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.865259 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.865146 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56blq\" (UniqueName: \"kubernetes.io/projected/1bc1ab34-0145-464e-8d8a-7e62f8959b05-kube-api-access-56blq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.865441 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.865420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.865485 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.865458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:09:59.875441 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:09:59.875403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56blq\" (UniqueName: \"kubernetes.io/projected/1bc1ab34-0145-464e-8d8a-7e62f8959b05-kube-api-access-56blq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:10:00.002095 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.001996 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:10:00.083056 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.083023 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn"] Jun 03 23:10:00.086962 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.086945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.104191 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.104156 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn"] Jun 03 23:10:00.153159 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.153133 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2"] Jun 03 23:10:00.154772 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:00.154738 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc1ab34_0145_464e_8d8a_7e62f8959b05.slice/crio-96c1bd720c1551c90f08dfa7dcf5b13f04c49e7f0959250cbc2cf29165a01543 WatchSource:0}: Error finding container 96c1bd720c1551c90f08dfa7dcf5b13f04c49e7f0959250cbc2cf29165a01543: Status 404 returned error can't find the container with id 96c1bd720c1551c90f08dfa7dcf5b13f04c49e7f0959250cbc2cf29165a01543 Jun 03 23:10:00.267578 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.267543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.267750 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.267604 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8q4c\" (UniqueName: \"kubernetes.io/projected/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-kube-api-access-j8q4c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.267750 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.267627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.368574 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.368532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.368777 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.368614 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8q4c\" (UniqueName: \"kubernetes.io/projected/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-kube-api-access-j8q4c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.368777 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.368645 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.368972 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.368940 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.369012 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.368967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.380903 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.380872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8q4c\" (UniqueName: \"kubernetes.io/projected/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-kube-api-access-j8q4c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.399694 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.399662 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:00.502342 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.502308 2567 generic.go:356] "Generic (PLEG): container finished" podID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerID="6f9882f34efc7b6846b27e2eaf696adb8cf48321bc5ec532e94de6d83811e8f5" exitCode=0 Jun 03 23:10:00.502534 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.502405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" event={"ID":"1bc1ab34-0145-464e-8d8a-7e62f8959b05","Type":"ContainerDied","Data":"6f9882f34efc7b6846b27e2eaf696adb8cf48321bc5ec532e94de6d83811e8f5"} Jun 03 23:10:00.502534 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.502481 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" event={"ID":"1bc1ab34-0145-464e-8d8a-7e62f8959b05","Type":"ContainerStarted","Data":"96c1bd720c1551c90f08dfa7dcf5b13f04c49e7f0959250cbc2cf29165a01543"} Jun 03 23:10:00.541112 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.541018 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg"] Jun 03 23:10:00.545961 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.545939 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.555337 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.555286 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn"] Jun 03 23:10:00.557321 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:00.557291 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1a9a6a_8fe2_4580_a2b2_14cf8f6039e6.slice/crio-a53f0cc615919aaf81acd41e8b33d98a313d7a06171836a34bfc0c3a849b27db WatchSource:0}: Error finding container a53f0cc615919aaf81acd41e8b33d98a313d7a06171836a34bfc0c3a849b27db: Status 404 returned error can't find the container with id a53f0cc615919aaf81acd41e8b33d98a313d7a06171836a34bfc0c3a849b27db Jun 03 23:10:00.561876 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.561851 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg"] Jun 03 23:10:00.570574 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.570546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmxhc\" (UniqueName: \"kubernetes.io/projected/71ecca99-3846-446d-a7cc-e97c5e93f371-kube-api-access-bmxhc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.570737 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.570606 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.570805 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.570744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.671106 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.671057 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.671289 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.671134 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmxhc\" (UniqueName: \"kubernetes.io/projected/71ecca99-3846-446d-a7cc-e97c5e93f371-kube-api-access-bmxhc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.671289 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.671183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.671580 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.671562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.671642 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.671622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.681414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.681381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmxhc\" (UniqueName: \"kubernetes.io/projected/71ecca99-3846-446d-a7cc-e97c5e93f371-kube-api-access-bmxhc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.856428 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.856391 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:00.998491 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:00.998447 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg"] Jun 03 23:10:01.000091 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:01.000053 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ecca99_3846_446d_a7cc_e97c5e93f371.slice/crio-a00313f2856a8d13f49fdd8475296df144251be9afa2042305337eb39cb677fb WatchSource:0}: Error finding container a00313f2856a8d13f49fdd8475296df144251be9afa2042305337eb39cb677fb: Status 404 returned error can't find the container with id a00313f2856a8d13f49fdd8475296df144251be9afa2042305337eb39cb677fb Jun 03 23:10:01.085983 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.085949 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m"] Jun 03 23:10:01.090054 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.090025 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.100103 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.100075 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m"] Jun 03 23:10:01.175827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.175792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxfrn\" (UniqueName: \"kubernetes.io/projected/e27df7ee-8d67-43c1-b6f6-2686c22d4926-kube-api-access-mxfrn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.176004 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.175866 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.176004 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.175898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.276314 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.276283 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxfrn\" (UniqueName: \"kubernetes.io/projected/e27df7ee-8d67-43c1-b6f6-2686c22d4926-kube-api-access-mxfrn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.276438 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.276354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.276438 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.276392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.276797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.276778 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.276840 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.276802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.289001 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.288975 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxfrn\" (UniqueName: \"kubernetes.io/projected/e27df7ee-8d67-43c1-b6f6-2686c22d4926-kube-api-access-mxfrn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.404996 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.404900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:01.516148 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.516111 2567 generic.go:356] "Generic (PLEG): container finished" podID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerID="40bbc5de1f193f0906e11cf6c80a130fdcc8685e09a5a823d723f96b0e35b9a3" exitCode=0 Jun 03 23:10:01.516320 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.516187 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" event={"ID":"1bc1ab34-0145-464e-8d8a-7e62f8959b05","Type":"ContainerDied","Data":"40bbc5de1f193f0906e11cf6c80a130fdcc8685e09a5a823d723f96b0e35b9a3"} Jun 03 23:10:01.518457 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.518419 2567 generic.go:356] "Generic (PLEG): container finished" podID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerID="0c3dd3f966fa6e10172dbaf737caff3d27234c38de6aa1f542aa2dc8dbba7585" exitCode=0 Jun 03 23:10:01.518571 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.518549 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" event={"ID":"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6","Type":"ContainerDied","Data":"0c3dd3f966fa6e10172dbaf737caff3d27234c38de6aa1f542aa2dc8dbba7585"} Jun 03 23:10:01.518645 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.518590 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" event={"ID":"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6","Type":"ContainerStarted","Data":"a53f0cc615919aaf81acd41e8b33d98a313d7a06171836a34bfc0c3a849b27db"} Jun 03 23:10:01.520536 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.520501 2567 generic.go:356] "Generic (PLEG): container finished" podID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerID="2d73d90529baeccdd4c1cf1870c3bdd7e604ca88a18597be6451aeafef914a70" exitCode=0 Jun 03 23:10:01.520649 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.520598 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" event={"ID":"71ecca99-3846-446d-a7cc-e97c5e93f371","Type":"ContainerDied","Data":"2d73d90529baeccdd4c1cf1870c3bdd7e604ca88a18597be6451aeafef914a70"} Jun 03 23:10:01.520649 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.520636 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" event={"ID":"71ecca99-3846-446d-a7cc-e97c5e93f371","Type":"ContainerStarted","Data":"a00313f2856a8d13f49fdd8475296df144251be9afa2042305337eb39cb677fb"} Jun 03 23:10:01.555524 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:01.555471 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m"] Jun 03 23:10:01.557608 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:01.557578 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27df7ee_8d67_43c1_b6f6_2686c22d4926.slice/crio-d2f55d6d0bd16fd35bde7c2d07c8c64e7adef75985eafbc35f252cf3b3e9ae15 WatchSource:0}: Error finding container d2f55d6d0bd16fd35bde7c2d07c8c64e7adef75985eafbc35f252cf3b3e9ae15: Status 404 returned error can't find the container with id d2f55d6d0bd16fd35bde7c2d07c8c64e7adef75985eafbc35f252cf3b3e9ae15 Jun 03 23:10:02.526655 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.526617 2567 generic.go:356] "Generic (PLEG): container finished" podID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerID="50679bf90799012133b8d29750cf8d521bc63e1030f303a2f4200fb2f354db1b" exitCode=0 Jun 03 23:10:02.527127 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.526727 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" event={"ID":"e27df7ee-8d67-43c1-b6f6-2686c22d4926","Type":"ContainerDied","Data":"50679bf90799012133b8d29750cf8d521bc63e1030f303a2f4200fb2f354db1b"} Jun 03 23:10:02.527127 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.526828 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" event={"ID":"e27df7ee-8d67-43c1-b6f6-2686c22d4926","Type":"ContainerStarted","Data":"d2f55d6d0bd16fd35bde7c2d07c8c64e7adef75985eafbc35f252cf3b3e9ae15"} Jun 03 23:10:02.529175 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.529154 2567 generic.go:356] "Generic (PLEG): container finished" podID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerID="439b5f4f84108d3ce6f698573bb3893ee0e206d49ae7319535c52200294667fb" exitCode=0 Jun 03 23:10:02.529240 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.529221 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" event={"ID":"1bc1ab34-0145-464e-8d8a-7e62f8959b05","Type":"ContainerDied","Data":"439b5f4f84108d3ce6f698573bb3893ee0e206d49ae7319535c52200294667fb"} Jun 03 23:10:02.531193 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.531166 2567 generic.go:356] "Generic (PLEG): container finished" podID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerID="75292e4a0fe079050dfa6763a3020ba43bdbb6f099ed2eceb534ca0138af9afe" exitCode=0 Jun 03 23:10:02.531299 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.531251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" event={"ID":"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6","Type":"ContainerDied","Data":"75292e4a0fe079050dfa6763a3020ba43bdbb6f099ed2eceb534ca0138af9afe"} Jun 03 23:10:02.533201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.533175 2567 generic.go:356] "Generic (PLEG): container finished" podID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerID="d285413a969bf4d230a72b527e9a6a50c771e3a83487fbb29e3ffb509579c49f" exitCode=0 Jun 03 23:10:02.533290 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:02.533227 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" event={"ID":"71ecca99-3846-446d-a7cc-e97c5e93f371","Type":"ContainerDied","Data":"d285413a969bf4d230a72b527e9a6a50c771e3a83487fbb29e3ffb509579c49f"} Jun 03 23:10:03.540378 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.540338 2567 generic.go:356] "Generic (PLEG): container finished" podID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerID="8df712084cc8f8850acedd3ea01589015c57ecb27a89225097f1ad05a50ce2bb" exitCode=0 Jun 03 23:10:03.540859 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.540418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" event={"ID":"e27df7ee-8d67-43c1-b6f6-2686c22d4926","Type":"ContainerDied","Data":"8df712084cc8f8850acedd3ea01589015c57ecb27a89225097f1ad05a50ce2bb"} Jun 03 23:10:03.542730 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.542685 2567 generic.go:356] "Generic (PLEG): container finished" podID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerID="9eb069bb8efe1c864e2f08fb04dea19d72650b9944813cad69ec1de6b8f9ab40" exitCode=0 Jun 03 23:10:03.542827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.542770 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" event={"ID":"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6","Type":"ContainerDied","Data":"9eb069bb8efe1c864e2f08fb04dea19d72650b9944813cad69ec1de6b8f9ab40"} Jun 03 23:10:03.545014 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.544994 2567 generic.go:356] "Generic (PLEG): container finished" podID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerID="e69bc3d2ea9fa327f67d9a931c7886cf17c7c626ed98291123aed627df598795" exitCode=0 Jun 03 23:10:03.545112 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.545023 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" event={"ID":"71ecca99-3846-446d-a7cc-e97c5e93f371","Type":"ContainerDied","Data":"e69bc3d2ea9fa327f67d9a931c7886cf17c7c626ed98291123aed627df598795"} Jun 03 23:10:03.687547 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.687520 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:10:03.793031 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.792988 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-util\") pod \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " Jun 03 23:10:03.793225 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.793053 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56blq\" (UniqueName: \"kubernetes.io/projected/1bc1ab34-0145-464e-8d8a-7e62f8959b05-kube-api-access-56blq\") pod \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " Jun 03 23:10:03.793225 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.793100 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-bundle\") pod \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\" (UID: \"1bc1ab34-0145-464e-8d8a-7e62f8959b05\") " Jun 03 23:10:03.793571 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.793549 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-bundle" (OuterVolumeSpecName: "bundle") pod "1bc1ab34-0145-464e-8d8a-7e62f8959b05" (UID: "1bc1ab34-0145-464e-8d8a-7e62f8959b05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:03.795404 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.795383 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc1ab34-0145-464e-8d8a-7e62f8959b05-kube-api-access-56blq" (OuterVolumeSpecName: "kube-api-access-56blq") pod "1bc1ab34-0145-464e-8d8a-7e62f8959b05" (UID: "1bc1ab34-0145-464e-8d8a-7e62f8959b05"). InnerVolumeSpecName "kube-api-access-56blq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:10:03.798946 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.798920 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-util" (OuterVolumeSpecName: "util") pod "1bc1ab34-0145-464e-8d8a-7e62f8959b05" (UID: "1bc1ab34-0145-464e-8d8a-7e62f8959b05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:03.893979 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.893938 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:03.893979 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.893976 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56blq\" (UniqueName: \"kubernetes.io/projected/1bc1ab34-0145-464e-8d8a-7e62f8959b05-kube-api-access-56blq\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:03.893979 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:03.893989 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1bc1ab34-0145-464e-8d8a-7e62f8959b05-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:04.551575 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.551543 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" Jun 03 23:10:04.552083 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.551540 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2" event={"ID":"1bc1ab34-0145-464e-8d8a-7e62f8959b05","Type":"ContainerDied","Data":"96c1bd720c1551c90f08dfa7dcf5b13f04c49e7f0959250cbc2cf29165a01543"} Jun 03 23:10:04.552083 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.551678 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96c1bd720c1551c90f08dfa7dcf5b13f04c49e7f0959250cbc2cf29165a01543" Jun 03 23:10:04.553579 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.553553 2567 generic.go:356] "Generic (PLEG): container finished" podID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerID="fd4912d38c0e1251001e22c05e797fed3b84a5f81950b23bb43c897135c120dc" exitCode=0 Jun 03 23:10:04.553688 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.553622 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" event={"ID":"e27df7ee-8d67-43c1-b6f6-2686c22d4926","Type":"ContainerDied","Data":"fd4912d38c0e1251001e22c05e797fed3b84a5f81950b23bb43c897135c120dc"} Jun 03 23:10:04.710541 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.710517 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:04.713232 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.713212 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:04.800825 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.800789 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-bundle\") pod \"71ecca99-3846-446d-a7cc-e97c5e93f371\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " Jun 03 23:10:04.800825 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.800823 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-bundle\") pod \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " Jun 03 23:10:04.801066 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.800876 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-util\") pod \"71ecca99-3846-446d-a7cc-e97c5e93f371\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " Jun 03 23:10:04.801066 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.800910 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-util\") pod \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " Jun 03 23:10:04.801066 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.800933 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8q4c\" (UniqueName: \"kubernetes.io/projected/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-kube-api-access-j8q4c\") pod \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\" (UID: \"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6\") " Jun 03 23:10:04.801066 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.800954 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmxhc\" (UniqueName: \"kubernetes.io/projected/71ecca99-3846-446d-a7cc-e97c5e93f371-kube-api-access-bmxhc\") pod \"71ecca99-3846-446d-a7cc-e97c5e93f371\" (UID: \"71ecca99-3846-446d-a7cc-e97c5e93f371\") " Jun 03 23:10:04.801438 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.801407 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-bundle" (OuterVolumeSpecName: "bundle") pod "71ecca99-3846-446d-a7cc-e97c5e93f371" (UID: "71ecca99-3846-446d-a7cc-e97c5e93f371"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:04.801607 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.801553 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-bundle" (OuterVolumeSpecName: "bundle") pod "5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" (UID: "5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:04.803517 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.803489 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-kube-api-access-j8q4c" (OuterVolumeSpecName: "kube-api-access-j8q4c") pod "5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" (UID: "5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6"). InnerVolumeSpecName "kube-api-access-j8q4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:10:04.803669 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.803646 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ecca99-3846-446d-a7cc-e97c5e93f371-kube-api-access-bmxhc" (OuterVolumeSpecName: "kube-api-access-bmxhc") pod "71ecca99-3846-446d-a7cc-e97c5e93f371" (UID: "71ecca99-3846-446d-a7cc-e97c5e93f371"). InnerVolumeSpecName "kube-api-access-bmxhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:10:04.807079 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.807055 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-util" (OuterVolumeSpecName: "util") pod "5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" (UID: "5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:04.809241 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.809215 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-util" (OuterVolumeSpecName: "util") pod "71ecca99-3846-446d-a7cc-e97c5e93f371" (UID: "71ecca99-3846-446d-a7cc-e97c5e93f371"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:04.901741 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.901687 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:04.901741 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.901732 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:04.901741 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.901745 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8q4c\" (UniqueName: \"kubernetes.io/projected/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-kube-api-access-j8q4c\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:04.901984 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.901759 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmxhc\" (UniqueName: \"kubernetes.io/projected/71ecca99-3846-446d-a7cc-e97c5e93f371-kube-api-access-bmxhc\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:04.901984 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.901772 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71ecca99-3846-446d-a7cc-e97c5e93f371-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:04.901984 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:04.901783 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:05.560153 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.560125 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" Jun 03 23:10:05.560153 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.560152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg" event={"ID":"71ecca99-3846-446d-a7cc-e97c5e93f371","Type":"ContainerDied","Data":"a00313f2856a8d13f49fdd8475296df144251be9afa2042305337eb39cb677fb"} Jun 03 23:10:05.560683 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.560206 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a00313f2856a8d13f49fdd8475296df144251be9afa2042305337eb39cb677fb" Jun 03 23:10:05.562059 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.562031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" event={"ID":"5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6","Type":"ContainerDied","Data":"a53f0cc615919aaf81acd41e8b33d98a313d7a06171836a34bfc0c3a849b27db"} Jun 03 23:10:05.562059 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.562061 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn" Jun 03 23:10:05.562262 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.562075 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a53f0cc615919aaf81acd41e8b33d98a313d7a06171836a34bfc0c3a849b27db" Jun 03 23:10:05.701499 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.701472 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:05.707424 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.707399 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-bundle\") pod \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " Jun 03 23:10:05.707584 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.707436 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxfrn\" (UniqueName: \"kubernetes.io/projected/e27df7ee-8d67-43c1-b6f6-2686c22d4926-kube-api-access-mxfrn\") pod \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " Jun 03 23:10:05.707584 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.707465 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-util\") pod \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\" (UID: \"e27df7ee-8d67-43c1-b6f6-2686c22d4926\") " Jun 03 23:10:05.707952 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.707928 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-bundle" (OuterVolumeSpecName: "bundle") pod "e27df7ee-8d67-43c1-b6f6-2686c22d4926" (UID: "e27df7ee-8d67-43c1-b6f6-2686c22d4926"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:05.709640 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.709616 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27df7ee-8d67-43c1-b6f6-2686c22d4926-kube-api-access-mxfrn" (OuterVolumeSpecName: "kube-api-access-mxfrn") pod "e27df7ee-8d67-43c1-b6f6-2686c22d4926" (UID: "e27df7ee-8d67-43c1-b6f6-2686c22d4926"). InnerVolumeSpecName "kube-api-access-mxfrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:10:05.712995 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.712957 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-util" (OuterVolumeSpecName: "util") pod "e27df7ee-8d67-43c1-b6f6-2686c22d4926" (UID: "e27df7ee-8d67-43c1-b6f6-2686c22d4926"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:10:05.808313 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.808269 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:05.808313 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.808301 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxfrn\" (UniqueName: \"kubernetes.io/projected/e27df7ee-8d67-43c1-b6f6-2686c22d4926-kube-api-access-mxfrn\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:05.808313 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:05.808311 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e27df7ee-8d67-43c1-b6f6-2686c22d4926-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:06.568595 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:06.568561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" event={"ID":"e27df7ee-8d67-43c1-b6f6-2686c22d4926","Type":"ContainerDied","Data":"d2f55d6d0bd16fd35bde7c2d07c8c64e7adef75985eafbc35f252cf3b3e9ae15"} Jun 03 23:10:06.569011 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:06.568607 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m" Jun 03 23:10:06.569011 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:06.568614 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2f55d6d0bd16fd35bde7c2d07c8c64e7adef75985eafbc35f252cf3b3e9ae15" Jun 03 23:10:13.397691 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:13.397654 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:15.857388 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857349 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s"] Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857633 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857643 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857655 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857660 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857669 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857675 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857682 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857687 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857694 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857699 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857723 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857731 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857750 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857757 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857763 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857768 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="pull" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857774 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857779 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857784 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857790 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857796 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857801 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="util" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857809 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="extract" Jun 03 23:10:15.857798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857814 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="extract" Jun 03 23:10:15.858482 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857858 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6" containerName="extract" Jun 03 23:10:15.858482 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857867 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ecca99-3846-446d-a7cc-e97c5e93f371" containerName="extract" Jun 03 23:10:15.858482 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857872 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc1ab34-0145-464e-8d8a-7e62f8959b05" containerName="extract" Jun 03 23:10:15.858482 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.857878 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e27df7ee-8d67-43c1-b6f6-2686c22d4926" containerName="extract" Jun 03 23:10:15.860903 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.860883 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:15.863617 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.863577 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 23:10:15.863617 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.863612 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pftfd\"" Jun 03 23:10:15.871473 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.871449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mj46\" (UniqueName: \"kubernetes.io/projected/e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76-kube-api-access-9mj46\") pod \"dns-operator-controller-manager-864dd78c4c-8br2s\" (UID: \"e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:15.878234 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.878207 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s"] Jun 03 23:10:15.972440 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.972407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mj46\" (UniqueName: \"kubernetes.io/projected/e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76-kube-api-access-9mj46\") pod \"dns-operator-controller-manager-864dd78c4c-8br2s\" (UID: \"e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:15.981797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:15.981758 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mj46\" (UniqueName: \"kubernetes.io/projected/e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76-kube-api-access-9mj46\") pod \"dns-operator-controller-manager-864dd78c4c-8br2s\" (UID: \"e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:16.171311 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:16.171196 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:16.319665 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:16.319637 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s"] Jun 03 23:10:16.321621 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:16.321591 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64d6c3b_5ef3_46c7_9ba4_a35fda6f6b76.slice/crio-a2109f1bac55576704d328dccf34e538b51fa1eeeaa6d6aaae93f3ccb4152f05 WatchSource:0}: Error finding container a2109f1bac55576704d328dccf34e538b51fa1eeeaa6d6aaae93f3ccb4152f05: Status 404 returned error can't find the container with id a2109f1bac55576704d328dccf34e538b51fa1eeeaa6d6aaae93f3ccb4152f05 Jun 03 23:10:16.623094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:16.623060 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" event={"ID":"e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76","Type":"ContainerStarted","Data":"a2109f1bac55576704d328dccf34e538b51fa1eeeaa6d6aaae93f3ccb4152f05"} Jun 03 23:10:17.485384 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:17.485341 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:19.295322 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.295281 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc"] Jun 03 23:10:19.304850 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.304818 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:19.309217 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.309185 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc"] Jun 03 23:10:19.309776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.309755 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9hxgc\"" Jun 03 23:10:19.396400 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.396364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz2cz\" (UniqueName: \"kubernetes.io/projected/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b-kube-api-access-zz2cz\") pod \"limitador-operator-controller-manager-859d7b78bd-7v6hc\" (UID: \"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:19.496901 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.496854 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz2cz\" (UniqueName: \"kubernetes.io/projected/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b-kube-api-access-zz2cz\") pod \"limitador-operator-controller-manager-859d7b78bd-7v6hc\" (UID: \"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:19.522736 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.522689 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz2cz\" (UniqueName: \"kubernetes.io/projected/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b-kube-api-access-zz2cz\") pod \"limitador-operator-controller-manager-859d7b78bd-7v6hc\" (UID: \"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:19.616756 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.616699 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:19.640933 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.640897 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" event={"ID":"e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76","Type":"ContainerStarted","Data":"4c18cc99000f35e0f1dc9272b84c39f487114ab1f9174fdd1136b30ac2d5f1cd"} Jun 03 23:10:19.641091 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.641044 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:19.665645 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.665593 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" podStartSLOduration=2.32029323 podStartE2EDuration="4.665575939s" totalImagesPullingTime="2.345282709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:10:19.665386032 +0000 UTC m=+460.538061873" watchObservedRunningTime="2026-06-03 23:10:19.665575939 +0000 UTC m=+460.538251778" Jun 03 23:10:19.766246 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.766220 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc"] Jun 03 23:10:19.767936 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:19.767909 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422f6fa0_a9bb_4b64_8ea1_60d74c55ea0b.slice/crio-579dc17ed8fb5f47165d0685cf72648af59f48e8d436afd26f9b21e6f45b1b83 WatchSource:0}: Error finding container 579dc17ed8fb5f47165d0685cf72648af59f48e8d436afd26f9b21e6f45b1b83: Status 404 returned error can't find the container with id 579dc17ed8fb5f47165d0685cf72648af59f48e8d436afd26f9b21e6f45b1b83 Jun 03 23:10:19.998658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:19.998561 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:20.649546 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:20.649499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" event={"ID":"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b","Type":"ContainerStarted","Data":"579dc17ed8fb5f47165d0685cf72648af59f48e8d436afd26f9b21e6f45b1b83"} Jun 03 23:10:21.655593 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:21.655554 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" event={"ID":"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b","Type":"ContainerStarted","Data":"25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98"} Jun 03 23:10:21.656073 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:21.655656 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:21.678727 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:21.678590 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" podStartSLOduration=1.029194237 podStartE2EDuration="2.678568875s" totalImagesPullingTime="1.649374638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:10:21.675846502 +0000 UTC m=+462.548522341" watchObservedRunningTime="2026-06-03 23:10:21.678568875 +0000 UTC m=+462.551244715" Jun 03 23:10:23.475528 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:23.475487 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:24.609984 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:24.609937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:25.016753 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:25.016634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:25.114506 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:25.114470 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:25.253428 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:25.253366 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:26.756530 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:26.756498 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:28.013113 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.013076 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq"] Jun 03 23:10:28.016565 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.016542 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:28.019453 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.019430 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bzdl4\"" Jun 03 23:10:28.028435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.028404 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq"] Jun 03 23:10:28.058491 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.058437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kjv\" (UniqueName: \"kubernetes.io/projected/ae48c011-2cd4-428b-abe6-fb7a40279517-kube-api-access-s4kjv\") pod \"authorino-operator-75cc8d5cb7-mr4fq\" (UID: \"ae48c011-2cd4-428b-abe6-fb7a40279517\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:28.159834 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.159788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kjv\" (UniqueName: \"kubernetes.io/projected/ae48c011-2cd4-428b-abe6-fb7a40279517-kube-api-access-s4kjv\") pod \"authorino-operator-75cc8d5cb7-mr4fq\" (UID: \"ae48c011-2cd4-428b-abe6-fb7a40279517\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:28.170173 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.170141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kjv\" (UniqueName: \"kubernetes.io/projected/ae48c011-2cd4-428b-abe6-fb7a40279517-kube-api-access-s4kjv\") pod \"authorino-operator-75cc8d5cb7-mr4fq\" (UID: \"ae48c011-2cd4-428b-abe6-fb7a40279517\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:28.327744 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.327625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:28.478792 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.478760 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq"] Jun 03 23:10:28.479942 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:28.479912 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae48c011_2cd4_428b_abe6_fb7a40279517.slice/crio-2d40b9cf396c6cfe086088a6897b16b94e90634b89d92678dbf506e0b636fcd3 WatchSource:0}: Error finding container 2d40b9cf396c6cfe086088a6897b16b94e90634b89d92678dbf506e0b636fcd3: Status 404 returned error can't find the container with id 2d40b9cf396c6cfe086088a6897b16b94e90634b89d92678dbf506e0b636fcd3 Jun 03 23:10:28.692615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:28.692579 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" event={"ID":"ae48c011-2cd4-428b-abe6-fb7a40279517","Type":"ContainerStarted","Data":"2d40b9cf396c6cfe086088a6897b16b94e90634b89d92678dbf506e0b636fcd3"} Jun 03 23:10:29.293284 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:29.293239 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:30.112604 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:30.112555 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:30.213726 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:30.213662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:30.312480 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:30.312442 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:30.652597 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:30.652567 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8br2s" Jun 03 23:10:30.702221 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:30.702185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:30.794326 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:30.794291 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:31.710475 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:31.710422 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" event={"ID":"ae48c011-2cd4-428b-abe6-fb7a40279517","Type":"ContainerStarted","Data":"cf83beacd854b2e15c49c769fa6cd40bc581c1331cc88e5ee58c197b7feba9fb"} Jun 03 23:10:31.710925 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:31.710605 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:31.734097 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:31.734036 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" podStartSLOduration=2.544593416 podStartE2EDuration="4.734018743s" totalImagesPullingTime="2.189425327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:10:31.73200691 +0000 UTC m=+472.604682750" watchObservedRunningTime="2026-06-03 23:10:31.734018743 +0000 UTC m=+472.606694584" Jun 03 23:10:32.546145 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:32.546107 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:32.663110 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:32.663079 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:32.754801 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:32.754760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:34.002122 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:34.002089 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:34.113131 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:34.113096 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:35.196082 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:35.196048 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:35.265039 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:35.265002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:37.613771 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:37.613736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:37.706655 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:37.706621 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:41.020760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:41.020725 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:41.122299 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:41.122259 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:41.227136 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:41.227103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:41.333986 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:41.333905 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:42.659914 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.659881 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc"] Jun 03 23:10:42.660396 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.660138 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" containerName="manager" containerID="cri-o://25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98" gracePeriod=2 Jun 03 23:10:42.686885 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.686841 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc"] Jun 03 23:10:42.687677 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:10:42.687643 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-7v6hc\": pods \"limitador-operator-controller-manager-859d7b78bd-7v6hc\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:42.717318 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.717281 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mr4fq" Jun 03 23:10:42.746654 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:10:42.746607 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7v6hc\" is forbidden: User \"system:node:ip-10-0-134-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-57.ec2.internal' and this object" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:42.908739 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.908690 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:42.911389 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:10:42.911323 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7v6hc\" is forbidden: User \"system:node:ip-10-0-134-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-57.ec2.internal' and this object" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:42.972949 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.972911 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz2cz\" (UniqueName: \"kubernetes.io/projected/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b-kube-api-access-zz2cz\") pod \"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b\" (UID: \"422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b\") " Jun 03 23:10:42.975179 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:42.975150 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b-kube-api-access-zz2cz" (OuterVolumeSpecName: "kube-api-access-zz2cz") pod "422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" (UID: "422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b"). InnerVolumeSpecName "kube-api-access-zz2cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:10:43.073942 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.073901 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz2cz\" (UniqueName: \"kubernetes.io/projected/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b-kube-api-access-zz2cz\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:10:43.636152 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.636106 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" path="/var/lib/kubelet/pods/422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b/volumes" Jun 03 23:10:43.777523 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.777490 2567 generic.go:356] "Generic (PLEG): container finished" podID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" containerID="25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98" exitCode=0 Jun 03 23:10:43.777981 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.777539 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v6hc" Jun 03 23:10:43.777981 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.777551 2567 scope.go:117] "RemoveContainer" containerID="25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98" Jun 03 23:10:43.786931 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.786904 2567 scope.go:117] "RemoveContainer" containerID="25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98" Jun 03 23:10:43.787185 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:10:43.787162 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98\": container with ID starting with 25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98 not found: ID does not exist" containerID="25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98" Jun 03 23:10:43.787255 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.787198 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98"} err="failed to get container status \"25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98\": rpc error: code = NotFound desc = could not find container \"25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98\": container with ID starting with 25926e8f2ae152c224c7a652825608114d979e0349f946c25d2e89fb2032bb98 not found: ID does not exist" Jun 03 23:10:43.913930 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.913845 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6"] Jun 03 23:10:43.914151 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.914139 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" containerName="manager" Jun 03 23:10:43.914205 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.914152 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" containerName="manager" Jun 03 23:10:43.914245 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.914226 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="422f6fa0-a9bb-4b64-8ea1-60d74c55ea0b" containerName="manager" Jun 03 23:10:43.918579 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.918559 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:43.923201 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.923175 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8fp6\"" Jun 03 23:10:43.945784 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.945472 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6"] Jun 03 23:10:43.981809 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.981772 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l77vb\" (UniqueName: \"kubernetes.io/projected/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-kube-api-access-l77vb\") pod \"kuadrant-operator-controller-manager-86878c769f-tscr6\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:43.981989 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:43.981851 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tscr6\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:44.082423 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.082378 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l77vb\" (UniqueName: \"kubernetes.io/projected/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-kube-api-access-l77vb\") pod \"kuadrant-operator-controller-manager-86878c769f-tscr6\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:44.082621 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.082448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tscr6\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:44.082842 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.082820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tscr6\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:44.098576 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.098548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l77vb\" (UniqueName: \"kubernetes.io/projected/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-kube-api-access-l77vb\") pod \"kuadrant-operator-controller-manager-86878c769f-tscr6\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:44.228435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.228330 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:44.387885 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.387858 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6"] Jun 03 23:10:44.389358 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:10:44.389324 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eaabb9a_d71c_48d2_b057_d73fd79e3a59.slice/crio-482a4540f5af4bf0e1e756cf3b57452a0863a2b7c29e691d2649b5556383870c WatchSource:0}: Error finding container 482a4540f5af4bf0e1e756cf3b57452a0863a2b7c29e691d2649b5556383870c: Status 404 returned error can't find the container with id 482a4540f5af4bf0e1e756cf3b57452a0863a2b7c29e691d2649b5556383870c Jun 03 23:10:44.785022 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:44.784985 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" event={"ID":"6eaabb9a-d71c-48d2-b057-d73fd79e3a59","Type":"ContainerStarted","Data":"482a4540f5af4bf0e1e756cf3b57452a0863a2b7c29e691d2649b5556383870c"} Jun 03 23:10:45.543046 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:45.543013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:45.677489 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:45.677445 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:45.795307 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:45.795216 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:48.133597 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:48.133557 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:48.343875 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:48.343840 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:48.809474 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:48.809441 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" event={"ID":"6eaabb9a-d71c-48d2-b057-d73fd79e3a59","Type":"ContainerStarted","Data":"92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7"} Jun 03 23:10:48.809688 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:48.809563 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:10:48.845418 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:48.845341 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" podStartSLOduration=1.999030971 podStartE2EDuration="5.845317434s" totalImagesPullingTime="3.846286463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:10:48.840845028 +0000 UTC m=+489.713520867" watchObservedRunningTime="2026-06-03 23:10:48.845317434 +0000 UTC m=+489.717993281" Jun 03 23:10:50.942043 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:50.941997 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:51.043082 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:51.043045 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:54.605916 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:54.605877 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:54.737420 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:54.737392 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:10:59.818084 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:10:59.818050 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:11:03.408868 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:03.408834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:03.508530 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:03.508492 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:06.027615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:06.027578 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:06.126396 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:06.126345 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:09.214924 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:09.214892 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:09.316837 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:09.316806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:13.101323 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:13.101290 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:13.272052 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:13.271999 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:16.458578 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.458536 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768"] Jun 03 23:11:16.466597 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.466571 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.471585 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.471552 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wnfr2\"" Jun 03 23:11:16.481520 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775pl\" (UniqueName: \"kubernetes.io/projected/c7beffc9-3576-4742-9fdd-29a93b49d538-kube-api-access-775pl\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7beffc9-3576-4742-9fdd-29a93b49d538-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481824 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481824 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481689 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481824 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.481824 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.481800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.529019 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.528988 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768"] Jun 03 23:11:16.582595 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.582827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582601 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.582827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582754 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.582827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582810 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775pl\" (UniqueName: \"kubernetes.io/projected/c7beffc9-3576-4742-9fdd-29a93b49d538-kube-api-access-775pl\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582901 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7beffc9-3576-4742-9fdd-29a93b49d538-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582945 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.582992 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583013 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.583000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583309 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.583066 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583309 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.583226 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583309 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.583271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.583604 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.583577 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7beffc9-3576-4742-9fdd-29a93b49d538-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.585443 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.585425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.585567 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.585548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.595652 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.595630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7beffc9-3576-4742-9fdd-29a93b49d538-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.606715 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.606679 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-775pl\" (UniqueName: \"kubernetes.io/projected/c7beffc9-3576-4742-9fdd-29a93b49d538-kube-api-access-775pl\") pod \"maas-default-gateway-openshift-default-687ff6996-6f768\" (UID: \"c7beffc9-3576-4742-9fdd-29a93b49d538\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.612660 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.612635 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:16.741828 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.741738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:16.778258 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.778221 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:16.935168 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.935113 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768"] Jun 03 23:11:16.937511 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:11:16.937480 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7beffc9_3576_4742_9fdd_29a93b49d538.slice/crio-273e0703cfba0ca34c96f9b99b42ee48a22ddca5fcd9dce4ec3c2494a96633d3 WatchSource:0}: Error finding container 273e0703cfba0ca34c96f9b99b42ee48a22ddca5fcd9dce4ec3c2494a96633d3: Status 404 returned error can't find the container with id 273e0703cfba0ca34c96f9b99b42ee48a22ddca5fcd9dce4ec3c2494a96633d3 Jun 03 23:11:16.939612 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.939579 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:11:16.939692 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.939645 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:11:16.939692 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.939676 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:11:16.961144 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:16.961117 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" event={"ID":"c7beffc9-3576-4742-9fdd-29a93b49d538","Type":"ContainerStarted","Data":"273e0703cfba0ca34c96f9b99b42ee48a22ddca5fcd9dce4ec3c2494a96633d3"} Jun 03 23:11:17.967627 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:17.967592 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" event={"ID":"c7beffc9-3576-4742-9fdd-29a93b49d538","Type":"ContainerStarted","Data":"568ba1129135eabb52482519cfe54c636d5f553def84ef83bfc470232e2f5057"} Jun 03 23:11:17.993882 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:17.993826 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" podStartSLOduration=1.993809754 podStartE2EDuration="1.993809754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:11:17.991572176 +0000 UTC m=+518.864248027" watchObservedRunningTime="2026-06-03 23:11:17.993809754 +0000 UTC m=+518.866485593" Jun 03 23:11:18.779288 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:18.779242 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:18.784301 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:18.784272 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:18.972931 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:18.972899 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:18.973846 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:18.973827 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:11:19.908903 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:19.908835 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:20.308069 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:20.308020 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:20.470735 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:20.470641 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:20.572108 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:20.572015 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:21.223327 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.223287 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-262md"] Jun 03 23:11:21.228148 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.228125 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:21.231090 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.231066 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9xp9k\"" Jun 03 23:11:21.237903 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.237881 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-262md"] Jun 03 23:11:21.273202 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.273162 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:21.325760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.325723 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2x5\" (UniqueName: \"kubernetes.io/projected/c516aa7c-7c6e-41db-847f-d853a3f18d89-kube-api-access-mk2x5\") pod \"authorino-58cd955675-262md\" (UID: \"c516aa7c-7c6e-41db-847f-d853a3f18d89\") " pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:21.344330 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.344285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:21.426725 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.426667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2x5\" (UniqueName: \"kubernetes.io/projected/c516aa7c-7c6e-41db-847f-d853a3f18d89-kube-api-access-mk2x5\") pod \"authorino-58cd955675-262md\" (UID: \"c516aa7c-7c6e-41db-847f-d853a3f18d89\") " pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:21.436207 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.436184 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2x5\" (UniqueName: \"kubernetes.io/projected/c516aa7c-7c6e-41db-847f-d853a3f18d89-kube-api-access-mk2x5\") pod \"authorino-58cd955675-262md\" (UID: \"c516aa7c-7c6e-41db-847f-d853a3f18d89\") " pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:21.538646 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.538562 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:21.686402 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.686376 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-262md"] Jun 03 23:11:21.688242 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:11:21.688213 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc516aa7c_7c6e_41db_847f_d853a3f18d89.slice/crio-8a4fa44115f68e350c66af0de6eac00aa4e507686d22f01ad0513259a8b84950 WatchSource:0}: Error finding container 8a4fa44115f68e350c66af0de6eac00aa4e507686d22f01ad0513259a8b84950: Status 404 returned error can't find the container with id 8a4fa44115f68e350c66af0de6eac00aa4e507686d22f01ad0513259a8b84950 Jun 03 23:11:21.989427 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:21.989386 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-262md" event={"ID":"c516aa7c-7c6e-41db-847f-d853a3f18d89","Type":"ContainerStarted","Data":"8a4fa44115f68e350c66af0de6eac00aa4e507686d22f01ad0513259a8b84950"} Jun 03 23:11:22.817025 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:22.816941 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:22.896503 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:22.896419 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:23.224406 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:23.224356 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:23.323114 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:23.323075 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:26.014891 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:26.014858 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-262md" event={"ID":"c516aa7c-7c6e-41db-847f-d853a3f18d89","Type":"ContainerStarted","Data":"2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5"} Jun 03 23:11:26.033028 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:26.032972 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-262md" podStartSLOduration=1.646124352 podStartE2EDuration="5.032957099s" totalImagesPullingTime="3.386832747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:11:26.030790483 +0000 UTC m=+526.903466324" watchObservedRunningTime="2026-06-03 23:11:26.032957099 +0000 UTC m=+526.905632937" Jun 03 23:11:26.102050 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:26.102014 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-262md"] Jun 03 23:11:28.024769 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:28.024727 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-262md" podUID="c516aa7c-7c6e-41db-847f-d853a3f18d89" containerName="authorino" containerID="cri-o://2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5" gracePeriod=30 Jun 03 23:11:28.266801 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:28.266776 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:28.400365 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:28.400331 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk2x5\" (UniqueName: \"kubernetes.io/projected/c516aa7c-7c6e-41db-847f-d853a3f18d89-kube-api-access-mk2x5\") pod \"c516aa7c-7c6e-41db-847f-d853a3f18d89\" (UID: \"c516aa7c-7c6e-41db-847f-d853a3f18d89\") " Jun 03 23:11:28.402516 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:28.402485 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c516aa7c-7c6e-41db-847f-d853a3f18d89-kube-api-access-mk2x5" (OuterVolumeSpecName: "kube-api-access-mk2x5") pod "c516aa7c-7c6e-41db-847f-d853a3f18d89" (UID: "c516aa7c-7c6e-41db-847f-d853a3f18d89"). InnerVolumeSpecName "kube-api-access-mk2x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:11:28.501090 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:28.501040 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk2x5\" (UniqueName: \"kubernetes.io/projected/c516aa7c-7c6e-41db-847f-d853a3f18d89-kube-api-access-mk2x5\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:11:29.030696 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.030656 2567 generic.go:356] "Generic (PLEG): container finished" podID="c516aa7c-7c6e-41db-847f-d853a3f18d89" containerID="2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5" exitCode=0 Jun 03 23:11:29.031156 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.030730 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-262md" Jun 03 23:11:29.031156 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.030747 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-262md" event={"ID":"c516aa7c-7c6e-41db-847f-d853a3f18d89","Type":"ContainerDied","Data":"2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5"} Jun 03 23:11:29.031156 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.030799 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-262md" event={"ID":"c516aa7c-7c6e-41db-847f-d853a3f18d89","Type":"ContainerDied","Data":"8a4fa44115f68e350c66af0de6eac00aa4e507686d22f01ad0513259a8b84950"} Jun 03 23:11:29.031156 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.030817 2567 scope.go:117] "RemoveContainer" containerID="2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5" Jun 03 23:11:29.040313 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.040293 2567 scope.go:117] "RemoveContainer" containerID="2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5" Jun 03 23:11:29.040596 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:11:29.040576 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5\": container with ID starting with 2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5 not found: ID does not exist" containerID="2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5" Jun 03 23:11:29.040645 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.040606 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5"} err="failed to get container status \"2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5\": rpc error: code = NotFound desc = could not find container \"2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5\": container with ID starting with 2bb2bfe2600620d4d4f6ac254e45c38b1fad20c7e1746a045a804b8597198ce5 not found: ID does not exist" Jun 03 23:11:29.054042 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.054011 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-262md"] Jun 03 23:11:29.057856 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.057833 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-262md"] Jun 03 23:11:29.636442 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:29.636410 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c516aa7c-7c6e-41db-847f-d853a3f18d89" path="/var/lib/kubelet/pods/c516aa7c-7c6e-41db-847f-d853a3f18d89/volumes" Jun 03 23:11:36.403077 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:36.403029 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:39.587271 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:39.587237 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:49.547001 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:49.546966 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:49.642769 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:49.642731 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:49.810791 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:49.810673 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:11:51.168502 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.168465 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd"] Jun 03 23:11:51.168998 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.168974 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c516aa7c-7c6e-41db-847f-d853a3f18d89" containerName="authorino" Jun 03 23:11:51.168998 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.168992 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c516aa7c-7c6e-41db-847f-d853a3f18d89" containerName="authorino" Jun 03 23:11:51.169111 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.169088 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c516aa7c-7c6e-41db-847f-d853a3f18d89" containerName="authorino" Jun 03 23:11:51.173839 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.173817 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.176542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.176522 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:11:51.176813 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.176794 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:11:51.177782 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.177768 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xrb4z\"" Jun 03 23:11:51.183426 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.183394 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd"] Jun 03 23:11:51.298190 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.298149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq4fl\" (UniqueName: \"kubernetes.io/projected/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-kube-api-access-jq4fl\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.298378 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.298272 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.298378 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.298302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.399530 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.399494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.399698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.399543 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq4fl\" (UniqueName: \"kubernetes.io/projected/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-kube-api-access-jq4fl\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.399698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.399611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.399918 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.399899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.399955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.399933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.410491 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.410458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq4fl\" (UniqueName: \"kubernetes.io/projected/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-kube-api-access-jq4fl\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.487113 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.487011 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:51.629983 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:51.629956 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd"] Jun 03 23:11:51.632271 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:11:51.632245 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908a2bb2_c5ab_4bf8_bd37_ec8f3050bc29.slice/crio-3fa4e3c269f4183d32df3656ed5664ad2c2be7255b877deb4285ec512fd772e0 WatchSource:0}: Error finding container 3fa4e3c269f4183d32df3656ed5664ad2c2be7255b877deb4285ec512fd772e0: Status 404 returned error can't find the container with id 3fa4e3c269f4183d32df3656ed5664ad2c2be7255b877deb4285ec512fd772e0 Jun 03 23:11:52.148698 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:52.148665 2567 generic.go:356] "Generic (PLEG): container finished" podID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerID="eb2f5e6304c7a73eaa530387ca8525c8f4fdba2e3642a04d143c65e948709263" exitCode=0 Jun 03 23:11:52.148896 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:52.148752 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" event={"ID":"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29","Type":"ContainerDied","Data":"eb2f5e6304c7a73eaa530387ca8525c8f4fdba2e3642a04d143c65e948709263"} Jun 03 23:11:52.148896 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:52.148803 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" event={"ID":"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29","Type":"ContainerStarted","Data":"3fa4e3c269f4183d32df3656ed5664ad2c2be7255b877deb4285ec512fd772e0"} Jun 03 23:11:53.155675 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:53.155644 2567 generic.go:356] "Generic (PLEG): container finished" podID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerID="da00892d8a87faee769c162e1ddbdb8ab23670ece8d237f250e9e73724afba3b" exitCode=0 Jun 03 23:11:53.156085 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:53.155742 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" event={"ID":"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29","Type":"ContainerDied","Data":"da00892d8a87faee769c162e1ddbdb8ab23670ece8d237f250e9e73724afba3b"} Jun 03 23:11:54.168798 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:54.168763 2567 generic.go:356] "Generic (PLEG): container finished" podID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerID="c7a3385dadee0218005e80aafbdebf20be579884f4edef4024fb668f9738903d" exitCode=0 Jun 03 23:11:54.169170 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:54.168847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" event={"ID":"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29","Type":"ContainerDied","Data":"c7a3385dadee0218005e80aafbdebf20be579884f4edef4024fb668f9738903d"} Jun 03 23:11:55.361810 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.361779 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:55.538404 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.538312 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-util\") pod \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " Jun 03 23:11:55.538404 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.538372 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq4fl\" (UniqueName: \"kubernetes.io/projected/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-kube-api-access-jq4fl\") pod \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " Jun 03 23:11:55.538404 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.538388 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-bundle\") pod \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\" (UID: \"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29\") " Jun 03 23:11:55.538942 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.538915 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-bundle" (OuterVolumeSpecName: "bundle") pod "908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" (UID: "908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:11:55.540642 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.540612 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-kube-api-access-jq4fl" (OuterVolumeSpecName: "kube-api-access-jq4fl") pod "908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" (UID: "908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29"). InnerVolumeSpecName "kube-api-access-jq4fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:11:55.545000 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.544973 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-util" (OuterVolumeSpecName: "util") pod "908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" (UID: "908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:11:55.638895 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.638865 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq4fl\" (UniqueName: \"kubernetes.io/projected/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-kube-api-access-jq4fl\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:11:55.638895 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.638889 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-bundle\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:11:55.638895 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:55.638899 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29-util\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:11:56.181649 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:56.181621 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" Jun 03 23:11:56.181649 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:56.181628 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a707lsrd" event={"ID":"908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29","Type":"ContainerDied","Data":"3fa4e3c269f4183d32df3656ed5664ad2c2be7255b877deb4285ec512fd772e0"} Jun 03 23:11:56.181880 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:11:56.181668 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fa4e3c269f4183d32df3656ed5664ad2c2be7255b877deb4285ec512fd772e0" Jun 03 23:12:08.246956 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:08.246913 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:14.414588 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.414546 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:14.512838 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.512806 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:14.886368 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886336 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:12:14.886696 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886681 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="pull" Jun 03 23:12:14.886760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886716 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="pull" Jun 03 23:12:14.886760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886727 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="extract" Jun 03 23:12:14.886760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886732 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="extract" Jun 03 23:12:14.886760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886749 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="util" Jun 03 23:12:14.886760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886754 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="util" Jun 03 23:12:14.886910 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.886816 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="908a2bb2-c5ab-4bf8-bd37-ec8f3050bc29" containerName="extract" Jun 03 23:12:14.889634 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.889618 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:14.892508 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.892476 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:12:14.892646 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.892536 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:12:14.892646 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.892562 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:12:14.892754 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.892646 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2wd9d\"" Jun 03 23:12:14.900932 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.900908 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:12:14.997660 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:14.997619 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drlmf\" (UniqueName: \"kubernetes.io/projected/2ec3fc12-c415-4cc7-b872-1aee42f24739-kube-api-access-drlmf\") pod \"maas-keycloak-0\" (UID: \"2ec3fc12-c415-4cc7-b872-1aee42f24739\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:15.098843 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:15.098802 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drlmf\" (UniqueName: \"kubernetes.io/projected/2ec3fc12-c415-4cc7-b872-1aee42f24739-kube-api-access-drlmf\") pod \"maas-keycloak-0\" (UID: \"2ec3fc12-c415-4cc7-b872-1aee42f24739\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:15.109534 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:15.109499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drlmf\" (UniqueName: \"kubernetes.io/projected/2ec3fc12-c415-4cc7-b872-1aee42f24739-kube-api-access-drlmf\") pod \"maas-keycloak-0\" (UID: \"2ec3fc12-c415-4cc7-b872-1aee42f24739\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:15.199237 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:15.199141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:15.347065 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:15.347034 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:12:15.348221 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:12:15.348198 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec3fc12_c415_4cc7_b872_1aee42f24739.slice/crio-1ed4c3aea604a6ac5389dc4322afd0fe495bcbad66963a0f5b247ee6d5b1e9aa WatchSource:0}: Error finding container 1ed4c3aea604a6ac5389dc4322afd0fe495bcbad66963a0f5b247ee6d5b1e9aa: Status 404 returned error can't find the container with id 1ed4c3aea604a6ac5389dc4322afd0fe495bcbad66963a0f5b247ee6d5b1e9aa Jun 03 23:12:16.289016 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:16.288976 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ec3fc12-c415-4cc7-b872-1aee42f24739","Type":"ContainerStarted","Data":"1ed4c3aea604a6ac5389dc4322afd0fe495bcbad66963a0f5b247ee6d5b1e9aa"} Jun 03 23:12:20.324840 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:20.324450 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ec3fc12-c415-4cc7-b872-1aee42f24739","Type":"ContainerStarted","Data":"3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047"} Jun 03 23:12:20.346692 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:20.346621 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.657818871 podStartE2EDuration="6.346599716s" totalImagesPullingTime="4.688780845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:12:20.345567609 +0000 UTC m=+581.218243453" watchObservedRunningTime="2026-06-03 23:12:20.346599716 +0000 UTC m=+581.219275560" Jun 03 23:12:21.199913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:21.199867 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:21.201773 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:21.201726 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:22.200642 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:22.200582 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:23.199917 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:23.199869 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:24.200765 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:24.200682 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:25.213832 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:25.213776 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:25.214448 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:25.213802 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:26.199825 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:26.199770 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:27.199981 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:27.199919 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:28.200467 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:28.200411 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:29.199813 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:29.199767 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:30.200202 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:30.200148 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:31.200526 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:31.200470 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:32.200689 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:32.200632 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:33.199996 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:33.199946 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 03 23:12:33.300716 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:33.300668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:34.056945 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:34.056896 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:34.157821 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:34.157760 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:34.332363 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:34.332266 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:34.349416 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:34.349369 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:12:39.620252 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:39.620221 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:12:39.621124 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:39.621099 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:12:44.339026 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:44.338977 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:12:45.064008 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.063971 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:45.290170 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.290132 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hs2tg"] Jun 03 23:12:45.293498 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.293478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:45.296964 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.296944 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9xp9k\"" Jun 03 23:12:45.302394 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.302372 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hs2tg"] Jun 03 23:12:45.302551 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.302527 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8rhn\" (UniqueName: \"kubernetes.io/projected/e79af057-c70a-4ef6-9776-a674df1096b1-kube-api-access-r8rhn\") pod \"authorino-5d4b67c446-hs2tg\" (UID: \"e79af057-c70a-4ef6-9776-a674df1096b1\") " pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:45.403971 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.403934 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8rhn\" (UniqueName: \"kubernetes.io/projected/e79af057-c70a-4ef6-9776-a674df1096b1-kube-api-access-r8rhn\") pod \"authorino-5d4b67c446-hs2tg\" (UID: \"e79af057-c70a-4ef6-9776-a674df1096b1\") " pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:45.413889 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.413858 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8rhn\" (UniqueName: \"kubernetes.io/projected/e79af057-c70a-4ef6-9776-a674df1096b1-kube-api-access-r8rhn\") pod \"authorino-5d4b67c446-hs2tg\" (UID: \"e79af057-c70a-4ef6-9776-a674df1096b1\") " pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:45.512687 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.512639 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hs2tg"] Jun 03 23:12:45.512963 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.512949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:45.675268 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.675234 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hs2tg"] Jun 03 23:12:45.676903 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:12:45.676878 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode79af057_c70a_4ef6_9776_a674df1096b1.slice/crio-c07f1758e5b4ce7200413a0fc2e5da3f2740c4d291534590699bdfd658b817e7 WatchSource:0}: Error finding container c07f1758e5b4ce7200413a0fc2e5da3f2740c4d291534590699bdfd658b817e7: Status 404 returned error can't find the container with id c07f1758e5b4ce7200413a0fc2e5da3f2740c4d291534590699bdfd658b817e7 Jun 03 23:12:45.678369 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:45.678347 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:12:46.064815 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.064784 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:46.510768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.510725 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" event={"ID":"e79af057-c70a-4ef6-9776-a674df1096b1","Type":"ContainerStarted","Data":"9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad"} Jun 03 23:12:46.510768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.510741 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" podUID="e79af057-c70a-4ef6-9776-a674df1096b1" containerName="authorino" containerID="cri-o://9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad" gracePeriod=30 Jun 03 23:12:46.510768 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.510776 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" event={"ID":"e79af057-c70a-4ef6-9776-a674df1096b1","Type":"ContainerStarted","Data":"c07f1758e5b4ce7200413a0fc2e5da3f2740c4d291534590699bdfd658b817e7"} Jun 03 23:12:46.529091 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.529041 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" podStartSLOduration=1.215425111 podStartE2EDuration="1.529023397s" totalImagesPullingTime="313.598286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:12:46.526420681 +0000 UTC m=+607.399096520" watchObservedRunningTime="2026-06-03 23:12:46.529023397 +0000 UTC m=+607.401699282" Jun 03 23:12:46.778497 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.778469 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:46.814657 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.814631 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8rhn\" (UniqueName: \"kubernetes.io/projected/e79af057-c70a-4ef6-9776-a674df1096b1-kube-api-access-r8rhn\") pod \"e79af057-c70a-4ef6-9776-a674df1096b1\" (UID: \"e79af057-c70a-4ef6-9776-a674df1096b1\") " Jun 03 23:12:46.816640 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.816616 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e79af057-c70a-4ef6-9776-a674df1096b1-kube-api-access-r8rhn" (OuterVolumeSpecName: "kube-api-access-r8rhn") pod "e79af057-c70a-4ef6-9776-a674df1096b1" (UID: "e79af057-c70a-4ef6-9776-a674df1096b1"). InnerVolumeSpecName "kube-api-access-r8rhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:12:46.916068 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:46.916027 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8rhn\" (UniqueName: \"kubernetes.io/projected/e79af057-c70a-4ef6-9776-a674df1096b1-kube-api-access-r8rhn\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:12:47.518273 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.518222 2567 generic.go:356] "Generic (PLEG): container finished" podID="e79af057-c70a-4ef6-9776-a674df1096b1" containerID="9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad" exitCode=0 Jun 03 23:12:47.518827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.518303 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" Jun 03 23:12:47.518827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.518319 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" event={"ID":"e79af057-c70a-4ef6-9776-a674df1096b1","Type":"ContainerDied","Data":"9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad"} Jun 03 23:12:47.518827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.518424 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hs2tg" event={"ID":"e79af057-c70a-4ef6-9776-a674df1096b1","Type":"ContainerDied","Data":"c07f1758e5b4ce7200413a0fc2e5da3f2740c4d291534590699bdfd658b817e7"} Jun 03 23:12:47.518827 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.518451 2567 scope.go:117] "RemoveContainer" containerID="9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad" Jun 03 23:12:47.528756 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.528734 2567 scope.go:117] "RemoveContainer" containerID="9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad" Jun 03 23:12:47.529102 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:12:47.529078 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad\": container with ID starting with 9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad not found: ID does not exist" containerID="9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad" Jun 03 23:12:47.529212 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.529113 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad"} err="failed to get container status \"9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad\": rpc error: code = NotFound desc = could not find container \"9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad\": container with ID starting with 9dc47b543793d2fef0c2cf724d43596faab7ce8e0bbdc5be560662d3956b2fad not found: ID does not exist" Jun 03 23:12:47.548402 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.548364 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hs2tg"] Jun 03 23:12:47.552931 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.552903 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hs2tg"] Jun 03 23:12:47.636504 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:47.636471 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e79af057-c70a-4ef6-9776-a674df1096b1" path="/var/lib/kubelet/pods/e79af057-c70a-4ef6-9776-a674df1096b1/volumes" Jun 03 23:12:50.762078 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.762041 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dd6594b9d-k8b6d"] Jun 03 23:12:50.762466 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.762368 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e79af057-c70a-4ef6-9776-a674df1096b1" containerName="authorino" Jun 03 23:12:50.762466 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.762379 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e79af057-c70a-4ef6-9776-a674df1096b1" containerName="authorino" Jun 03 23:12:50.762466 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.762427 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e79af057-c70a-4ef6-9776-a674df1096b1" containerName="authorino" Jun 03 23:12:50.773098 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.773064 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:12:50.776666 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.776497 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wlfbg\"" Jun 03 23:12:50.777451 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.777430 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 23:12:50.779565 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.779541 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd6594b9d-k8b6d"] Jun 03 23:12:50.845662 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.845623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2bw6\" (UniqueName: \"kubernetes.io/projected/a0a98e22-6690-46a5-a7d6-98a85511a4a9-kube-api-access-l2bw6\") pod \"maas-controller-7dd6594b9d-k8b6d\" (UID: \"a0a98e22-6690-46a5-a7d6-98a85511a4a9\") " pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:12:50.941333 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.941297 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-7zncg"] Jun 03 23:12:50.944843 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.944817 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:12:50.946225 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.946201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2bw6\" (UniqueName: \"kubernetes.io/projected/a0a98e22-6690-46a5-a7d6-98a85511a4a9-kube-api-access-l2bw6\") pod \"maas-controller-7dd6594b9d-k8b6d\" (UID: \"a0a98e22-6690-46a5-a7d6-98a85511a4a9\") " pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:12:50.954987 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.954961 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-7zncg"] Jun 03 23:12:50.959082 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:50.959057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2bw6\" (UniqueName: \"kubernetes.io/projected/a0a98e22-6690-46a5-a7d6-98a85511a4a9-kube-api-access-l2bw6\") pod \"maas-controller-7dd6594b9d-k8b6d\" (UID: \"a0a98e22-6690-46a5-a7d6-98a85511a4a9\") " pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:12:51.046881 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.046787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vpl\" (UniqueName: \"kubernetes.io/projected/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f-kube-api-access-q2vpl\") pod \"maas-controller-65fdcf5f97-7zncg\" (UID: \"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f\") " pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:12:51.085936 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.085898 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:12:51.148433 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.148355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vpl\" (UniqueName: \"kubernetes.io/projected/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f-kube-api-access-q2vpl\") pod \"maas-controller-65fdcf5f97-7zncg\" (UID: \"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f\") " pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:12:51.158733 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.158683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vpl\" (UniqueName: \"kubernetes.io/projected/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f-kube-api-access-q2vpl\") pod \"maas-controller-65fdcf5f97-7zncg\" (UID: \"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f\") " pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:12:51.226668 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.226641 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd6594b9d-k8b6d"] Jun 03 23:12:51.228233 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:12:51.228205 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a98e22_6690_46a5_a7d6_98a85511a4a9.slice/crio-1bd3c999d2f9cac571eb17ddf1e8f331f0f4c87381bae302788cfcf7293db2da WatchSource:0}: Error finding container 1bd3c999d2f9cac571eb17ddf1e8f331f0f4c87381bae302788cfcf7293db2da: Status 404 returned error can't find the container with id 1bd3c999d2f9cac571eb17ddf1e8f331f0f4c87381bae302788cfcf7293db2da Jun 03 23:12:51.255659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.255626 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:12:51.396913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.396881 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-7zncg"] Jun 03 23:12:51.397966 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:12:51.397932 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25504dbd_07a0_4e9a_a916_cf4f7ab74e5f.slice/crio-a6280e4c18dac9889bafa50cc832480d3406895c8af5593b19e02dc198912d63 WatchSource:0}: Error finding container a6280e4c18dac9889bafa50cc832480d3406895c8af5593b19e02dc198912d63: Status 404 returned error can't find the container with id a6280e4c18dac9889bafa50cc832480d3406895c8af5593b19e02dc198912d63 Jun 03 23:12:51.540260 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.540226 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" event={"ID":"a0a98e22-6690-46a5-a7d6-98a85511a4a9","Type":"ContainerStarted","Data":"1bd3c999d2f9cac571eb17ddf1e8f331f0f4c87381bae302788cfcf7293db2da"} Jun 03 23:12:51.541401 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:51.541374 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" event={"ID":"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f","Type":"ContainerStarted","Data":"a6280e4c18dac9889bafa50cc832480d3406895c8af5593b19e02dc198912d63"} Jun 03 23:12:54.065178 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.065136 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:54.161695 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.161664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:12:54.563936 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.563826 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" event={"ID":"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f","Type":"ContainerStarted","Data":"07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf"} Jun 03 23:12:54.564130 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.564060 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:12:54.565795 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.565766 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" event={"ID":"a0a98e22-6690-46a5-a7d6-98a85511a4a9","Type":"ContainerStarted","Data":"4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504"} Jun 03 23:12:54.565935 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.565903 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:12:54.617773 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.617695 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" podStartSLOduration=2.172393991 podStartE2EDuration="4.617677306s" totalImagesPullingTime="2.445283315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:12:54.616482788 +0000 UTC m=+615.489158652" watchObservedRunningTime="2026-06-03 23:12:54.617677306 +0000 UTC m=+615.490353153" Jun 03 23:12:54.682619 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:12:54.682536 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" podStartSLOduration=2.080743988 podStartE2EDuration="4.682512791s" totalImagesPullingTime="2.601768803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:12:54.677651748 +0000 UTC m=+615.550327589" watchObservedRunningTime="2026-06-03 23:12:54.682512791 +0000 UTC m=+615.555188624" Jun 03 23:13:05.577414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.577381 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:13:05.577838 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.577455 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:13:05.645732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.645686 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dd6594b9d-k8b6d"] Jun 03 23:13:05.645958 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.645914 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" podUID="a0a98e22-6690-46a5-a7d6-98a85511a4a9" containerName="manager" containerID="cri-o://4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504" gracePeriod=30 Jun 03 23:13:05.892477 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.892449 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:13:05.985981 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.985943 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2bw6\" (UniqueName: \"kubernetes.io/projected/a0a98e22-6690-46a5-a7d6-98a85511a4a9-kube-api-access-l2bw6\") pod \"a0a98e22-6690-46a5-a7d6-98a85511a4a9\" (UID: \"a0a98e22-6690-46a5-a7d6-98a85511a4a9\") " Jun 03 23:13:05.988230 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:05.988203 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a98e22-6690-46a5-a7d6-98a85511a4a9-kube-api-access-l2bw6" (OuterVolumeSpecName: "kube-api-access-l2bw6") pod "a0a98e22-6690-46a5-a7d6-98a85511a4a9" (UID: "a0a98e22-6690-46a5-a7d6-98a85511a4a9"). InnerVolumeSpecName "kube-api-access-l2bw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:13:06.087153 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.087109 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2bw6\" (UniqueName: \"kubernetes.io/projected/a0a98e22-6690-46a5-a7d6-98a85511a4a9-kube-api-access-l2bw6\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:13:06.633281 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.633247 2567 generic.go:356] "Generic (PLEG): container finished" podID="a0a98e22-6690-46a5-a7d6-98a85511a4a9" containerID="4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504" exitCode=0 Jun 03 23:13:06.633796 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.633301 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" Jun 03 23:13:06.633796 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.633330 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" event={"ID":"a0a98e22-6690-46a5-a7d6-98a85511a4a9","Type":"ContainerDied","Data":"4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504"} Jun 03 23:13:06.633796 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.633371 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd6594b9d-k8b6d" event={"ID":"a0a98e22-6690-46a5-a7d6-98a85511a4a9","Type":"ContainerDied","Data":"1bd3c999d2f9cac571eb17ddf1e8f331f0f4c87381bae302788cfcf7293db2da"} Jun 03 23:13:06.633796 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.633394 2567 scope.go:117] "RemoveContainer" containerID="4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504" Jun 03 23:13:06.642642 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.642621 2567 scope.go:117] "RemoveContainer" containerID="4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504" Jun 03 23:13:06.642986 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:13:06.642964 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504\": container with ID starting with 4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504 not found: ID does not exist" containerID="4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504" Jun 03 23:13:06.643040 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.642996 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504"} err="failed to get container status \"4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504\": rpc error: code = NotFound desc = could not find container \"4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504\": container with ID starting with 4df728e94b166f71d2171bcfea92a304a7c8d38c3093fa26cd72a48b7d9fe504 not found: ID does not exist" Jun 03 23:13:06.655873 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.655849 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dd6594b9d-k8b6d"] Jun 03 23:13:06.660292 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:06.660273 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dd6594b9d-k8b6d"] Jun 03 23:13:07.636662 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:07.636626 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0a98e22-6690-46a5-a7d6-98a85511a4a9" path="/var/lib/kubelet/pods/a0a98e22-6690-46a5-a7d6-98a85511a4a9/volumes" Jun 03 23:13:25.133221 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.133185 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:13:25.206019 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.205989 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-9d5b5566f-rjhgk"] Jun 03 23:13:25.206366 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.206351 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a98e22-6690-46a5-a7d6-98a85511a4a9" containerName="manager" Jun 03 23:13:25.206416 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.206369 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a98e22-6690-46a5-a7d6-98a85511a4a9" containerName="manager" Jun 03 23:13:25.206457 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.206427 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a98e22-6690-46a5-a7d6-98a85511a4a9" containerName="manager" Jun 03 23:13:25.210211 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.210180 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.214437 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.214406 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-npbrw\"" Jun 03 23:13:25.214597 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.214451 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 23:13:25.220894 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.220867 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-9d5b5566f-rjhgk"] Jun 03 23:13:25.354391 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.354343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57vpl\" (UniqueName: \"kubernetes.io/projected/c52499f0-8652-4048-aaa7-cde7ba0026d9-kube-api-access-57vpl\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.354589 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.354399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c52499f0-8652-4048-aaa7-cde7ba0026d9-maas-api-tls\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.455494 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.455408 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57vpl\" (UniqueName: \"kubernetes.io/projected/c52499f0-8652-4048-aaa7-cde7ba0026d9-kube-api-access-57vpl\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.455494 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.455454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c52499f0-8652-4048-aaa7-cde7ba0026d9-maas-api-tls\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.455693 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:13:25.455566 2567 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 03 23:13:25.455693 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:13:25.455648 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c52499f0-8652-4048-aaa7-cde7ba0026d9-maas-api-tls podName:c52499f0-8652-4048-aaa7-cde7ba0026d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:13:25.955624373 +0000 UTC m=+646.828300196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c52499f0-8652-4048-aaa7-cde7ba0026d9-maas-api-tls") pod "maas-api-9d5b5566f-rjhgk" (UID: "c52499f0-8652-4048-aaa7-cde7ba0026d9") : secret "maas-api-serving-cert" not found Jun 03 23:13:25.466776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.466747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57vpl\" (UniqueName: \"kubernetes.io/projected/c52499f0-8652-4048-aaa7-cde7ba0026d9-kube-api-access-57vpl\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.560111 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.560079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:13:25.669109 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.669077 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:13:25.734696 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.734581 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qzmdr"] Jun 03 23:13:25.738206 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.738182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:25.742888 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.742869 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 23:13:25.743104 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.743091 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dx7jj\"" Jun 03 23:13:25.768256 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.768226 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qzmdr"] Jun 03 23:13:25.859424 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.859384 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8cp\" (UniqueName: \"kubernetes.io/projected/35233120-809a-4ce0-abe3-7e59b66af347-kube-api-access-jw8cp\") pod \"payload-processing-7c6c859784-qzmdr\" (UID: \"35233120-809a-4ce0-abe3-7e59b66af347\") " pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:25.960835 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.960785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8cp\" (UniqueName: \"kubernetes.io/projected/35233120-809a-4ce0-abe3-7e59b66af347-kube-api-access-jw8cp\") pod \"payload-processing-7c6c859784-qzmdr\" (UID: \"35233120-809a-4ce0-abe3-7e59b66af347\") " pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:25.961026 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.960881 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c52499f0-8652-4048-aaa7-cde7ba0026d9-maas-api-tls\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.963594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.963571 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c52499f0-8652-4048-aaa7-cde7ba0026d9-maas-api-tls\") pod \"maas-api-9d5b5566f-rjhgk\" (UID: \"c52499f0-8652-4048-aaa7-cde7ba0026d9\") " pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:25.979280 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:25.979246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8cp\" (UniqueName: \"kubernetes.io/projected/35233120-809a-4ce0-abe3-7e59b66af347-kube-api-access-jw8cp\") pod \"payload-processing-7c6c859784-qzmdr\" (UID: \"35233120-809a-4ce0-abe3-7e59b66af347\") " pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:26.048579 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:26.048495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:26.126922 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:26.126888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:26.201927 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:26.201898 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qzmdr"] Jun 03 23:13:26.203119 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:13:26.203088 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35233120_809a_4ce0_abe3_7e59b66af347.slice/crio-a7862a8931d1c241e50720daabd4e806dc6ce1e1e6527351bea706d4caafdb4a WatchSource:0}: Error finding container a7862a8931d1c241e50720daabd4e806dc6ce1e1e6527351bea706d4caafdb4a: Status 404 returned error can't find the container with id a7862a8931d1c241e50720daabd4e806dc6ce1e1e6527351bea706d4caafdb4a Jun 03 23:13:26.278507 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:26.278484 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-9d5b5566f-rjhgk"] Jun 03 23:13:26.279826 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:13:26.279797 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52499f0_8652_4048_aaa7_cde7ba0026d9.slice/crio-1c2178bd5636ea2621c94d6c0f17dc7a41951537170351638d75a2aa61159952 WatchSource:0}: Error finding container 1c2178bd5636ea2621c94d6c0f17dc7a41951537170351638d75a2aa61159952: Status 404 returned error can't find the container with id 1c2178bd5636ea2621c94d6c0f17dc7a41951537170351638d75a2aa61159952 Jun 03 23:13:26.766725 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:26.766613 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-9d5b5566f-rjhgk" event={"ID":"c52499f0-8652-4048-aaa7-cde7ba0026d9","Type":"ContainerStarted","Data":"1c2178bd5636ea2621c94d6c0f17dc7a41951537170351638d75a2aa61159952"} Jun 03 23:13:26.775773 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:26.775728 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" event={"ID":"35233120-809a-4ce0-abe3-7e59b66af347","Type":"ContainerStarted","Data":"a7862a8931d1c241e50720daabd4e806dc6ce1e1e6527351bea706d4caafdb4a"} Jun 03 23:13:29.798779 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:29.798748 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" event={"ID":"35233120-809a-4ce0-abe3-7e59b66af347","Type":"ContainerStarted","Data":"fcfaca6bf5bf25f3e6fa800181888ebeea4d52a2fd8f9b2854f31786362c689a"} Jun 03 23:13:29.799232 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:29.798816 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:29.800271 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:29.800251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-9d5b5566f-rjhgk" event={"ID":"c52499f0-8652-4048-aaa7-cde7ba0026d9","Type":"ContainerStarted","Data":"ebbfb306f0ba770a74c2ed2e25c7080e2652ff3f81572a3e884b252559e0e9f8"} Jun 03 23:13:29.800389 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:29.800291 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:29.819591 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:29.819546 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" podStartSLOduration=1.61267921 podStartE2EDuration="4.819531518s" totalImagesPullingTime="3.206852308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:13:29.817876759 +0000 UTC m=+650.690552601" watchObservedRunningTime="2026-06-03 23:13:29.819531518 +0000 UTC m=+650.692207335" Jun 03 23:13:29.835004 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:29.834953 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-9d5b5566f-rjhgk" podStartSLOduration=1.775001874 podStartE2EDuration="4.8349395s" totalImagesPullingTime="3.059937626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:13:29.833988786 +0000 UTC m=+650.706664637" watchObservedRunningTime="2026-06-03 23:13:29.8349395 +0000 UTC m=+650.707615339" Jun 03 23:13:33.825481 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.825381 2567 generic.go:356] "Generic (PLEG): container finished" podID="c7beffc9-3576-4742-9fdd-29a93b49d538" containerID="568ba1129135eabb52482519cfe54c636d5f553def84ef83bfc470232e2f5057" exitCode=0 Jun 03 23:13:33.825481 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.825428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" event={"ID":"c7beffc9-3576-4742-9fdd-29a93b49d538","Type":"ContainerDied","Data":"568ba1129135eabb52482519cfe54c636d5f553def84ef83bfc470232e2f5057"} Jun 03 23:13:33.825933 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.825825 2567 scope.go:117] "RemoveContainer" containerID="568ba1129135eabb52482519cfe54c636d5f553def84ef83bfc470232e2f5057" Jun 03 23:13:33.826881 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.826850 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:13:33.826937 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.826921 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:13:33.826980 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.826954 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 23:13:33.973329 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:33.973294 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:13:34.832398 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:34.832362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" event={"ID":"c7beffc9-3576-4742-9fdd-29a93b49d538","Type":"ContainerStarted","Data":"1943cc1d3a433e90db43ce96e369664faae05a9916db38b5e494eae0702c44cc"} Jun 03 23:13:35.779154 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:35.779117 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:13:35.780483 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:35.780445 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6f768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 03 23:13:35.780612 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:35.780502 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" podUID="c7beffc9-3576-4742-9fdd-29a93b49d538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 03 23:13:35.812282 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:35.812253 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-9d5b5566f-rjhgk" Jun 03 23:13:36.779075 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:36.779037 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6f768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 03 23:13:36.779440 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:36.779098 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" podUID="c7beffc9-3576-4742-9fdd-29a93b49d538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 03 23:13:37.574979 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:37.574942 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:13:37.575171 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:37.575136 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" containerID="cri-o://3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047" gracePeriod=30 Jun 03 23:13:37.779080 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:37.779039 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6f768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 03 23:13:37.779447 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:37.779094 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" podUID="c7beffc9-3576-4742-9fdd-29a93b49d538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 03 23:13:38.778964 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:38.778926 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6f768 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jun 03 23:13:38.779160 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:38.778995 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" podUID="c7beffc9-3576-4742-9fdd-29a93b49d538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jun 03 23:13:39.237510 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.237478 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:39.280605 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.280506 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drlmf\" (UniqueName: \"kubernetes.io/projected/2ec3fc12-c415-4cc7-b872-1aee42f24739-kube-api-access-drlmf\") pod \"2ec3fc12-c415-4cc7-b872-1aee42f24739\" (UID: \"2ec3fc12-c415-4cc7-b872-1aee42f24739\") " Jun 03 23:13:39.282852 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.282818 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec3fc12-c415-4cc7-b872-1aee42f24739-kube-api-access-drlmf" (OuterVolumeSpecName: "kube-api-access-drlmf") pod "2ec3fc12-c415-4cc7-b872-1aee42f24739" (UID: "2ec3fc12-c415-4cc7-b872-1aee42f24739"). InnerVolumeSpecName "kube-api-access-drlmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:13:39.381361 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.381329 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drlmf\" (UniqueName: \"kubernetes.io/projected/2ec3fc12-c415-4cc7-b872-1aee42f24739-kube-api-access-drlmf\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:13:39.782911 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.782870 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:13:39.783374 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.783245 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:13:39.783997 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.783977 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6f768" Jun 03 23:13:39.872826 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.872794 2567 generic.go:356] "Generic (PLEG): container finished" podID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerID="3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047" exitCode=143 Jun 03 23:13:39.872974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.872837 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:39.872974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.872877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ec3fc12-c415-4cc7-b872-1aee42f24739","Type":"ContainerDied","Data":"3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047"} Jun 03 23:13:39.872974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.872929 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ec3fc12-c415-4cc7-b872-1aee42f24739","Type":"ContainerDied","Data":"1ed4c3aea604a6ac5389dc4322afd0fe495bcbad66963a0f5b247ee6d5b1e9aa"} Jun 03 23:13:39.872974 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.872959 2567 scope.go:117] "RemoveContainer" containerID="3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047" Jun 03 23:13:39.883167 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.883142 2567 scope.go:117] "RemoveContainer" containerID="3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047" Jun 03 23:13:39.883531 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:13:39.883502 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047\": container with ID starting with 3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047 not found: ID does not exist" containerID="3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047" Jun 03 23:13:39.883632 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.883543 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047"} err="failed to get container status \"3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047\": rpc error: code = NotFound desc = could not find container \"3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047\": container with ID starting with 3d5fbed10825b818cfa117981823ee1a50d76ac546dafe4d501b95f356b41047 not found: ID does not exist" Jun 03 23:13:39.896593 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.896560 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:13:39.901432 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.901401 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:13:39.922491 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.922457 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:13:39.922873 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.922856 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" Jun 03 23:13:39.922873 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.922873 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" Jun 03 23:13:39.923098 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.922931 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" containerName="keycloak" Jun 03 23:13:39.925599 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.925577 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:39.928600 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.928580 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:13:39.928757 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.928581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:13:39.928757 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.928686 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 23:13:39.928757 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.928741 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-2wd9d\"" Jun 03 23:13:39.928930 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.928750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:13:39.937584 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.937559 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:13:39.985684 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.985653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkw9\" (UniqueName: \"kubernetes.io/projected/732960d3-a993-4291-a5a4-24e95276cb61-kube-api-access-dfkw9\") pod \"maas-keycloak-0\" (UID: \"732960d3-a993-4291-a5a4-24e95276cb61\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:39.985868 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:39.985753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/732960d3-a993-4291-a5a4-24e95276cb61-test-realms\") pod \"maas-keycloak-0\" (UID: \"732960d3-a993-4291-a5a4-24e95276cb61\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:40.086345 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.086304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/732960d3-a993-4291-a5a4-24e95276cb61-test-realms\") pod \"maas-keycloak-0\" (UID: \"732960d3-a993-4291-a5a4-24e95276cb61\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:40.086532 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.086376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkw9\" (UniqueName: \"kubernetes.io/projected/732960d3-a993-4291-a5a4-24e95276cb61-kube-api-access-dfkw9\") pod \"maas-keycloak-0\" (UID: \"732960d3-a993-4291-a5a4-24e95276cb61\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:40.087137 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.087116 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/732960d3-a993-4291-a5a4-24e95276cb61-test-realms\") pod \"maas-keycloak-0\" (UID: \"732960d3-a993-4291-a5a4-24e95276cb61\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:40.095311 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.095289 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkw9\" (UniqueName: \"kubernetes.io/projected/732960d3-a993-4291-a5a4-24e95276cb61-kube-api-access-dfkw9\") pod \"maas-keycloak-0\" (UID: \"732960d3-a993-4291-a5a4-24e95276cb61\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:40.237470 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.237374 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:40.379405 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.379373 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:13:40.381109 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:13:40.381077 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732960d3_a993_4291_a5a4_24e95276cb61.slice/crio-be4068538c1d061da17f2c545352f8fa8d321c5f66b06ebf6a213531017508af WatchSource:0}: Error finding container be4068538c1d061da17f2c545352f8fa8d321c5f66b06ebf6a213531017508af: Status 404 returned error can't find the container with id be4068538c1d061da17f2c545352f8fa8d321c5f66b06ebf6a213531017508af Jun 03 23:13:40.809290 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.809258 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qzmdr" Jun 03 23:13:40.881781 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.881742 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"732960d3-a993-4291-a5a4-24e95276cb61","Type":"ContainerStarted","Data":"b12ee7a71561ac4819d20b264297782910b89fa01e434447a4ab22fcaa3213ef"} Jun 03 23:13:40.881992 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.881809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"732960d3-a993-4291-a5a4-24e95276cb61","Type":"ContainerStarted","Data":"be4068538c1d061da17f2c545352f8fa8d321c5f66b06ebf6a213531017508af"} Jun 03 23:13:40.900807 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:40.900750 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5630914059999998 podStartE2EDuration="1.900732901s" totalImagesPullingTime="337.641495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:13:40.899502049 +0000 UTC m=+661.772178089" watchObservedRunningTime="2026-06-03 23:13:40.900732901 +0000 UTC m=+661.773408737" Jun 03 23:13:41.238532 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:41.238475 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:41.240363 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:41.240324 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:41.639583 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:41.639541 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec3fc12-c415-4cc7-b872-1aee42f24739" path="/var/lib/kubelet/pods/2ec3fc12-c415-4cc7-b872-1aee42f24739/volumes" Jun 03 23:13:42.238311 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:42.238263 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:43.237886 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:43.237828 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:44.238177 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:44.238128 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:45.238414 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:45.238359 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:46.238807 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:46.238752 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:47.238682 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:47.238628 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:48.238292 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:48.238234 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:49.238306 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:49.238262 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:50.238318 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:50.238261 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:50.239010 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:50.238670 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:51.238775 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:51.238696 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:52.238324 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:52.238270 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:53.238561 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:53.238510 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.47:9000/health/started\": dial tcp 10.133.0.47:9000: connect: connection refused" Jun 03 23:13:54.369677 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:54.369626 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 23:13:54.390388 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:13:54.390343 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="732960d3-a993-4291-a5a4-24e95276cb61" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:14:04.375797 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:04.375760 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:14:17.398062 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:17.398020 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:14:17.488321 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:17.488292 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:14:23.260348 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:23.260258 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:14:38.313985 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.313946 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg"] Jun 03 23:14:38.316684 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.316660 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.319559 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.319534 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 23:14:38.319696 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.319570 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:14:38.319696 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.319532 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:14:38.320373 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.320354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tvs66\"" Jun 03 23:14:38.327623 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.327601 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg"] Jun 03 23:14:38.345673 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.345639 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:14:38.413931 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.413898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.413931 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.413935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.414212 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.413956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8gk9\" (UniqueName: \"kubernetes.io/projected/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-kube-api-access-r8gk9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.414212 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.414034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.414212 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.414121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.414212 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.414159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.515663 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.515624 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.515663 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.515666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.515968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.515748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.515968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.515846 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.515968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.515880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8gk9\" (UniqueName: \"kubernetes.io/projected/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-kube-api-access-r8gk9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.515968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.515916 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.516196 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.516141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.516270 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.516248 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.516310 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.516294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.518285 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.518264 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.518348 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.518320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.525384 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.525356 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8gk9\" (UniqueName: \"kubernetes.io/projected/c365d72f-78f2-4bd1-b809-0fc1b41d8cf5-kube-api-access-r8gk9\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vs4bg\" (UID: \"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.628462 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.628425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:38.803949 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:38.803911 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg"] Jun 03 23:14:38.805251 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:14:38.805219 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc365d72f_78f2_4bd1_b809_0fc1b41d8cf5.slice/crio-de0259c9d34858859d5c50fd5d9c0483eca4a47ff07bf82d73cfd1cc4efdfff3 WatchSource:0}: Error finding container de0259c9d34858859d5c50fd5d9c0483eca4a47ff07bf82d73cfd1cc4efdfff3: Status 404 returned error can't find the container with id de0259c9d34858859d5c50fd5d9c0483eca4a47ff07bf82d73cfd1cc4efdfff3 Jun 03 23:14:39.248141 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:39.248093 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" event={"ID":"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5","Type":"ContainerStarted","Data":"de0259c9d34858859d5c50fd5d9c0483eca4a47ff07bf82d73cfd1cc4efdfff3"} Jun 03 23:14:43.276622 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:43.276577 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" event={"ID":"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5","Type":"ContainerStarted","Data":"089dab94db0dea500ce051ee0e5555741172848f0563d5c5aaf4724201603f3c"} Jun 03 23:14:44.284458 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:44.284421 2567 generic.go:356] "Generic (PLEG): container finished" podID="c365d72f-78f2-4bd1-b809-0fc1b41d8cf5" containerID="089dab94db0dea500ce051ee0e5555741172848f0563d5c5aaf4724201603f3c" exitCode=0 Jun 03 23:14:44.284902 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:44.284514 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" event={"ID":"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5","Type":"ContainerDied","Data":"089dab94db0dea500ce051ee0e5555741172848f0563d5c5aaf4724201603f3c"} Jun 03 23:14:46.299205 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:46.299167 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" event={"ID":"c365d72f-78f2-4bd1-b809-0fc1b41d8cf5","Type":"ContainerStarted","Data":"7a731d84e08e5192ef2608be98af2c99cefff6794d15f06f86a1cd4572193137"} Jun 03 23:14:46.319247 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:46.319188 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" podStartSLOduration=2.408854518 podStartE2EDuration="8.319172048s" totalImagesPullingTime="4.577463012s" totalInitContainerRuntime="1.332854518s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:14:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:14:46.31883602 +0000 UTC m=+727.191511859" watchObservedRunningTime="2026-06-03 23:14:46.319172048 +0000 UTC m=+727.191847887" Jun 03 23:14:46.923728 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:46.923668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:14:48.629022 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:48.628971 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:48.629498 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:48.629132 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:48.641842 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:48.641808 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:49.327779 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:49.327749 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vs4bg" Jun 03 23:14:52.828732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:52.828667 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:14:52.929843 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:14:52.929811 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:15:03.419053 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:03.419013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:15:14.490346 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:14.490312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:15:16.859081 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:16.859038 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:15:19.120162 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.120119 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp"] Jun 03 23:15:19.123979 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.123953 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.127475 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.127437 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 23:15:19.140129 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.140093 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp"] Jun 03 23:15:19.185444 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.185390 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da639df4-88f6-46c0-b0a8-2a7eea54feec-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.185732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.185467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.185732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.185509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.185732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.185565 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.185732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.185603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.185732 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.185646 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv8rg\" (UniqueName: \"kubernetes.io/projected/da639df4-88f6-46c0-b0a8-2a7eea54feec-kube-api-access-vv8rg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.209891 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.209843 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:15:19.286094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da639df4-88f6-46c0-b0a8-2a7eea54feec-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286094 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286366 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286143 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286366 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286192 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286366 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286228 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286366 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv8rg\" (UniqueName: \"kubernetes.io/projected/da639df4-88f6-46c0-b0a8-2a7eea54feec-kube-api-access-vv8rg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286628 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286603 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286694 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.286782 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.286752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.288660 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.288639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da639df4-88f6-46c0-b0a8-2a7eea54feec-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.288814 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.288798 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da639df4-88f6-46c0-b0a8-2a7eea54feec-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.296145 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.296115 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv8rg\" (UniqueName: \"kubernetes.io/projected/da639df4-88f6-46c0-b0a8-2a7eea54feec-kube-api-access-vv8rg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-922rp\" (UID: \"da639df4-88f6-46c0-b0a8-2a7eea54feec\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.433686 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.433592 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:19.584859 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:19.584833 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp"] Jun 03 23:15:19.586147 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:15:19.586115 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda639df4_88f6_46c0_b0a8_2a7eea54feec.slice/crio-13645d72500157e753523f25ddbcebe53f75d7030d7faeac253297e473ee1f66 WatchSource:0}: Error finding container 13645d72500157e753523f25ddbcebe53f75d7030d7faeac253297e473ee1f66: Status 404 returned error can't find the container with id 13645d72500157e753523f25ddbcebe53f75d7030d7faeac253297e473ee1f66 Jun 03 23:15:20.501898 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:20.501841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" event={"ID":"da639df4-88f6-46c0-b0a8-2a7eea54feec","Type":"ContainerStarted","Data":"2011674d6915e4a203c5de1b4e54e66b6d833aebf99456abd7f10a507e26766d"} Jun 03 23:15:20.502470 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:20.501921 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" event={"ID":"da639df4-88f6-46c0-b0a8-2a7eea54feec","Type":"ContainerStarted","Data":"13645d72500157e753523f25ddbcebe53f75d7030d7faeac253297e473ee1f66"} Jun 03 23:15:21.509276 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:21.509242 2567 generic.go:356] "Generic (PLEG): container finished" podID="da639df4-88f6-46c0-b0a8-2a7eea54feec" containerID="2011674d6915e4a203c5de1b4e54e66b6d833aebf99456abd7f10a507e26766d" exitCode=0 Jun 03 23:15:21.509693 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:21.509337 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" event={"ID":"da639df4-88f6-46c0-b0a8-2a7eea54feec","Type":"ContainerDied","Data":"2011674d6915e4a203c5de1b4e54e66b6d833aebf99456abd7f10a507e26766d"} Jun 03 23:15:22.517158 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:22.517119 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" event={"ID":"da639df4-88f6-46c0-b0a8-2a7eea54feec","Type":"ContainerStarted","Data":"30024490a960d83d05873686b430d640ff4e94834134f5be26e833e42edad117"} Jun 03 23:15:22.552831 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:22.552776 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" podStartSLOduration=1.862231227 podStartE2EDuration="3.552756182s" totalImagesPullingTime="378.92982ms" totalInitContainerRuntime="1.311595135s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:15:22.551535768 +0000 UTC m=+763.424211607" watchObservedRunningTime="2026-06-03 23:15:22.552756182 +0000 UTC m=+763.425432024" Jun 03 23:15:29.433811 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:29.433764 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:29.434215 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:29.433833 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:29.447332 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:29.447299 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:15:29.571760 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:15:29.571723 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-922rp" Jun 03 23:16:22.208333 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:16:22.208290 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:16:22.304421 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:16:22.304390 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:16:23.329670 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:16:23.329631 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:16:23.432165 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:16:23.432128 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:17:38.478868 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:38.478774 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:17:39.659854 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:39.659824 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:17:39.660326 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:39.659901 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:17:49.268304 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:49.268264 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-7zncg"] Jun 03 23:17:49.268902 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:49.268467 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" podUID="25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" containerName="manager" containerID="cri-o://07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf" gracePeriod=30 Jun 03 23:17:49.531365 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:49.531295 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:17:49.627379 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:49.627342 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2vpl\" (UniqueName: \"kubernetes.io/projected/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f-kube-api-access-q2vpl\") pod \"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f\" (UID: \"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f\") " Jun 03 23:17:49.629628 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:49.629595 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f-kube-api-access-q2vpl" (OuterVolumeSpecName: "kube-api-access-q2vpl") pod "25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" (UID: "25504dbd-07a0-4e9a-a916-cf4f7ab74e5f"). InnerVolumeSpecName "kube-api-access-q2vpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:17:49.727912 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:49.727882 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2vpl\" (UniqueName: \"kubernetes.io/projected/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f-kube-api-access-q2vpl\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:17:50.365034 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.364997 2567 generic.go:356] "Generic (PLEG): container finished" podID="25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" containerID="07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf" exitCode=0 Jun 03 23:17:50.365529 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.365045 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" Jun 03 23:17:50.365529 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.365078 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" event={"ID":"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f","Type":"ContainerDied","Data":"07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf"} Jun 03 23:17:50.365529 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.365131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fdcf5f97-7zncg" event={"ID":"25504dbd-07a0-4e9a-a916-cf4f7ab74e5f","Type":"ContainerDied","Data":"a6280e4c18dac9889bafa50cc832480d3406895c8af5593b19e02dc198912d63"} Jun 03 23:17:50.365529 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.365164 2567 scope.go:117] "RemoveContainer" containerID="07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf" Jun 03 23:17:50.375653 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.375626 2567 scope.go:117] "RemoveContainer" containerID="07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf" Jun 03 23:17:50.378694 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:17:50.378662 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf\": container with ID starting with 07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf not found: ID does not exist" containerID="07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf" Jun 03 23:17:50.378847 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.378721 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf"} err="failed to get container status \"07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf\": rpc error: code = NotFound desc = could not find container \"07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf\": container with ID starting with 07e3956c72faabe5bbdb49e2d75fb0b3a380a6e5d9af34e72f749e5ccd6cc2cf not found: ID does not exist" Jun 03 23:17:50.387030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.387002 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-7zncg"] Jun 03 23:17:50.396652 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:50.396621 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-7zncg"] Jun 03 23:17:51.155602 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.155561 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-xtqdl"] Jun 03 23:17:51.155991 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.155976 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" containerName="manager" Jun 03 23:17:51.156044 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.155994 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" containerName="manager" Jun 03 23:17:51.156078 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.156059 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" containerName="manager" Jun 03 23:17:51.160423 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.160404 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:17:51.163413 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.163390 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wlfbg\"" Jun 03 23:17:51.163713 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.163680 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 23:17:51.171302 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.171277 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-xtqdl"] Jun 03 23:17:51.237879 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.237847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqpws\" (UniqueName: \"kubernetes.io/projected/082b314d-bf60-4206-a9c6-3bb147b2b4c2-kube-api-access-bqpws\") pod \"maas-controller-65fdcf5f97-xtqdl\" (UID: \"082b314d-bf60-4206-a9c6-3bb147b2b4c2\") " pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:17:51.338671 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.338628 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqpws\" (UniqueName: \"kubernetes.io/projected/082b314d-bf60-4206-a9c6-3bb147b2b4c2-kube-api-access-bqpws\") pod \"maas-controller-65fdcf5f97-xtqdl\" (UID: \"082b314d-bf60-4206-a9c6-3bb147b2b4c2\") " pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:17:51.348937 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.348908 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqpws\" (UniqueName: \"kubernetes.io/projected/082b314d-bf60-4206-a9c6-3bb147b2b4c2-kube-api-access-bqpws\") pod \"maas-controller-65fdcf5f97-xtqdl\" (UID: \"082b314d-bf60-4206-a9c6-3bb147b2b4c2\") " pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:17:51.471806 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.471680 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:17:51.620773 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.620749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65fdcf5f97-xtqdl"] Jun 03 23:17:51.622451 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:17:51.622423 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082b314d_bf60_4206_a9c6_3bb147b2b4c2.slice/crio-c02de4773a047f827f16051355a66675126bcd53c43f8dba4511090ef3b1e997 WatchSource:0}: Error finding container c02de4773a047f827f16051355a66675126bcd53c43f8dba4511090ef3b1e997: Status 404 returned error can't find the container with id c02de4773a047f827f16051355a66675126bcd53c43f8dba4511090ef3b1e997 Jun 03 23:17:51.623946 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.623923 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:17:51.637756 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:51.637728 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25504dbd-07a0-4e9a-a916-cf4f7ab74e5f" path="/var/lib/kubelet/pods/25504dbd-07a0-4e9a-a916-cf4f7ab74e5f/volumes" Jun 03 23:17:52.378695 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:52.378657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" event={"ID":"082b314d-bf60-4206-a9c6-3bb147b2b4c2","Type":"ContainerStarted","Data":"c41b8393f42d6b2af08a7fbf3175551178da0f464855af1517a77295f2dbf5f4"} Jun 03 23:17:52.378903 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:52.378737 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" event={"ID":"082b314d-bf60-4206-a9c6-3bb147b2b4c2","Type":"ContainerStarted","Data":"c02de4773a047f827f16051355a66675126bcd53c43f8dba4511090ef3b1e997"} Jun 03 23:17:52.378903 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:52.378767 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:17:52.401015 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:17:52.400965 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" podStartSLOduration=0.967829379 podStartE2EDuration="1.400951087s" totalImagesPullingTime="433.121708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:17:52.399336049 +0000 UTC m=+913.272011888" watchObservedRunningTime="2026-06-03 23:17:52.400951087 +0000 UTC m=+913.273626926" Jun 03 23:18:03.391847 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:18:03.391814 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65fdcf5f97-xtqdl" Jun 03 23:18:33.033925 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:18:33.033892 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:18:34.087960 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:18:34.087923 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:18:41.399688 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:18:41.399649 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:18:47.892882 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:18:47.892843 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:18:48.012936 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:18:48.012895 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:20.400533 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:20.400310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:20.499590 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:20.499552 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:44.238717 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:44.238660 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:50.142811 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:50.142740 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:50.248615 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:50.248578 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:50.344098 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:50.344063 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:50.543394 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:50.543301 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:19:50.637028 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:19:50.636996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:07.018286 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:07.018249 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:07.125214 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:07.125172 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:07.241810 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:07.241767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:13.312557 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:13.312519 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:13.413030 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:13.412990 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:21.454733 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:21.454669 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:21.575989 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:21.575959 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:21.683395 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:21.683350 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:21.776027 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:21.775926 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:38.232659 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:38.232535 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:38.336124 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:38.336085 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:38.436493 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:38.436454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:40.009324 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:40.009285 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:44.253723 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:44.253668 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:20:44.353597 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:20:44.353564 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:21:18.437594 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:21:18.437556 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:21:18.540865 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:21:18.540832 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:22:01.160250 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:22:01.160161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:22:01.258902 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:22:01.258864 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:22:39.702342 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:22:39.702313 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:22:39.702978 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:22:39.702856 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:25:47.263383 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:25:47.263352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:27:39.739722 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:27:39.739673 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:27:39.742817 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:27:39.742793 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:28:11.411860 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.411759 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6"] Jun 03 23:28:11.412435 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.412029 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" podUID="6eaabb9a-d71c-48d2-b057-d73fd79e3a59" containerName="manager" containerID="cri-o://92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7" gracePeriod=10 Jun 03 23:28:11.769416 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.769381 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:28:11.885086 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.885041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-extensions-socket-volume\") pod \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " Jun 03 23:28:11.885278 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.885183 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l77vb\" (UniqueName: \"kubernetes.io/projected/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-kube-api-access-l77vb\") pod \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\" (UID: \"6eaabb9a-d71c-48d2-b057-d73fd79e3a59\") " Jun 03 23:28:11.885451 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.885427 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6eaabb9a-d71c-48d2-b057-d73fd79e3a59" (UID: "6eaabb9a-d71c-48d2-b057-d73fd79e3a59"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:28:11.887502 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.887474 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-kube-api-access-l77vb" (OuterVolumeSpecName: "kube-api-access-l77vb") pod "6eaabb9a-d71c-48d2-b057-d73fd79e3a59" (UID: "6eaabb9a-d71c-48d2-b057-d73fd79e3a59"). InnerVolumeSpecName "kube-api-access-l77vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:28:11.902757 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.902725 2567 generic.go:356] "Generic (PLEG): container finished" podID="6eaabb9a-d71c-48d2-b057-d73fd79e3a59" containerID="92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7" exitCode=0 Jun 03 23:28:11.902913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.902778 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" Jun 03 23:28:11.902913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.902809 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" event={"ID":"6eaabb9a-d71c-48d2-b057-d73fd79e3a59","Type":"ContainerDied","Data":"92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7"} Jun 03 23:28:11.902913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.902869 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6" event={"ID":"6eaabb9a-d71c-48d2-b057-d73fd79e3a59","Type":"ContainerDied","Data":"482a4540f5af4bf0e1e756cf3b57452a0863a2b7c29e691d2649b5556383870c"} Jun 03 23:28:11.902913 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.902899 2567 scope.go:117] "RemoveContainer" containerID="92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7" Jun 03 23:28:11.913341 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.913322 2567 scope.go:117] "RemoveContainer" containerID="92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7" Jun 03 23:28:11.913640 ip-10-0-134-57 kubenswrapper[2567]: E0603 23:28:11.913618 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7\": container with ID starting with 92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7 not found: ID does not exist" containerID="92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7" Jun 03 23:28:11.913737 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.913652 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7"} err="failed to get container status \"92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7\": rpc error: code = NotFound desc = could not find container \"92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7\": container with ID starting with 92441f8cc1a4e7aa8dac9811e380525d8dfc76bc352ee4935bf589119c5b4be7 not found: ID does not exist" Jun 03 23:28:11.926360 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.926326 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6"] Jun 03 23:28:11.930787 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.930698 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tscr6"] Jun 03 23:28:11.986431 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.986385 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-extensions-socket-volume\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:28:11.986431 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:11.986418 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l77vb\" (UniqueName: \"kubernetes.io/projected/6eaabb9a-d71c-48d2-b057-d73fd79e3a59-kube-api-access-l77vb\") on node \"ip-10-0-134-57.ec2.internal\" DevicePath \"\"" Jun 03 23:28:13.636722 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:28:13.636665 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eaabb9a-d71c-48d2-b057-d73fd79e3a59" path="/var/lib/kubelet/pods/6eaabb9a-d71c-48d2-b057-d73fd79e3a59/volumes" Jun 03 23:29:17.526447 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.526407 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d"] Jun 03 23:29:17.526957 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.526770 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eaabb9a-d71c-48d2-b057-d73fd79e3a59" containerName="manager" Jun 03 23:29:17.526957 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.526781 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eaabb9a-d71c-48d2-b057-d73fd79e3a59" containerName="manager" Jun 03 23:29:17.526957 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.526853 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eaabb9a-d71c-48d2-b057-d73fd79e3a59" containerName="manager" Jun 03 23:29:17.529821 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.529800 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.533164 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.533139 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p8fp6\"" Jun 03 23:29:17.548144 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.548107 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d"] Jun 03 23:29:17.567879 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.567841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t69sn\" (UniqueName: \"kubernetes.io/projected/639e5ecf-1e2e-4dee-a2c6-fd7523218cf0-kube-api-access-t69sn\") pod \"kuadrant-operator-controller-manager-86878c769f-9zb4d\" (UID: \"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.568059 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.567935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/639e5ecf-1e2e-4dee-a2c6-fd7523218cf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zb4d\" (UID: \"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.668637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.668592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/639e5ecf-1e2e-4dee-a2c6-fd7523218cf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zb4d\" (UID: \"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.668844 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.668661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t69sn\" (UniqueName: \"kubernetes.io/projected/639e5ecf-1e2e-4dee-a2c6-fd7523218cf0-kube-api-access-t69sn\") pod \"kuadrant-operator-controller-manager-86878c769f-9zb4d\" (UID: \"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.669014 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.668991 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/639e5ecf-1e2e-4dee-a2c6-fd7523218cf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9zb4d\" (UID: \"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.681796 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.681766 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t69sn\" (UniqueName: \"kubernetes.io/projected/639e5ecf-1e2e-4dee-a2c6-fd7523218cf0-kube-api-access-t69sn\") pod \"kuadrant-operator-controller-manager-86878c769f-9zb4d\" (UID: \"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:17.846218 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:17.846114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:18.000642 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:18.000612 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d"] Jun 03 23:29:18.002786 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:29:18.002756 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639e5ecf_1e2e_4dee_a2c6_fd7523218cf0.slice/crio-ae8663e2e7de2690ceef60e7a4bca7ed66c2685301016d53a0933c4cb1f00b41 WatchSource:0}: Error finding container ae8663e2e7de2690ceef60e7a4bca7ed66c2685301016d53a0933c4cb1f00b41: Status 404 returned error can't find the container with id ae8663e2e7de2690ceef60e7a4bca7ed66c2685301016d53a0933c4cb1f00b41 Jun 03 23:29:18.271026 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:18.270987 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" event={"ID":"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0","Type":"ContainerStarted","Data":"96d71104727178dc2857f529cdeb78fda672297e8912203783a0e87459e25961"} Jun 03 23:29:18.271226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:18.271047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" event={"ID":"639e5ecf-1e2e-4dee-a2c6-fd7523218cf0","Type":"ContainerStarted","Data":"ae8663e2e7de2690ceef60e7a4bca7ed66c2685301016d53a0933c4cb1f00b41"} Jun 03 23:29:18.271226 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:18.271103 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:29:18.291452 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:18.291379 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" podStartSLOduration=1.291362274 podStartE2EDuration="1.291362274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:18.290109533 +0000 UTC m=+1599.162785372" watchObservedRunningTime="2026-06-03 23:29:18.291362274 +0000 UTC m=+1599.164038113" Jun 03 23:29:29.279968 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:29:29.279932 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9zb4d" Jun 03 23:31:02.534680 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:31:02.534583 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:32:39.779078 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:32:39.779043 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:32:39.792786 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:32:39.792754 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:34:00.449318 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:34:00.449235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:34:00.534758 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:34:00.534694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:36:32.127919 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:36:32.127881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:37:39.828674 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:37:39.828645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:37:39.839643 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:37:39.839616 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k9njd_06857080-8cde-4d5c-8e54-5547cce76b6c/ovn-acl-logging/0.log" Jun 03 23:38:27.838892 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:38:27.838784 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:38:37.384607 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:38:37.384563 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:39:01.623816 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:01.623777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:39:14.692298 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:14.692259 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:39:26.827940 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:26.827907 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-574764c5bd-2zr7x_57ca6262-0461-4409-ab3d-502b46b59ba8/nginx/0.log" Jun 03 23:39:27.305831 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:27.305798 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-9d5b5566f-rjhgk_c52499f0-8652-4048-aaa7-cde7ba0026d9/maas-api/0.log" Jun 03 23:39:27.642795 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:27.642764 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65fdcf5f97-xtqdl_082b314d-bf60-4206-a9c6-3bb147b2b4c2/manager/0.log" Jun 03 23:39:28.018869 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:28.018775 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-6tj97_5425e493-6474-43cc-b504-6ec41733babd/manager/0.log" Jun 03 23:39:28.026966 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:28.026937 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-6tj97_5425e493-6474-43cc-b504-6ec41733babd/copy-manifests/0.log" Jun 03 23:39:29.119419 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.119384 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2_1bc1ab34-0145-464e-8d8a-7e62f8959b05/pull/0.log" Jun 03 23:39:29.126047 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.126025 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2_1bc1ab34-0145-464e-8d8a-7e62f8959b05/extract/0.log" Jun 03 23:39:29.132198 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.132168 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2_1bc1ab34-0145-464e-8d8a-7e62f8959b05/util/0.log" Jun 03 23:39:29.245654 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.245619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg_71ecca99-3846-446d-a7cc-e97c5e93f371/util/0.log" Jun 03 23:39:29.253271 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.253240 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg_71ecca99-3846-446d-a7cc-e97c5e93f371/pull/0.log" Jun 03 23:39:29.260426 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.260396 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg_71ecca99-3846-446d-a7cc-e97c5e93f371/extract/0.log" Jun 03 23:39:29.375823 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.375734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn_5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6/util/0.log" Jun 03 23:39:29.382241 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.382216 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn_5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6/pull/0.log" Jun 03 23:39:29.389150 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.389125 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn_5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6/extract/0.log" Jun 03 23:39:29.506251 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.506225 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m_e27df7ee-8d67-43c1-b6f6-2686c22d4926/util/0.log" Jun 03 23:39:29.514410 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.514381 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m_e27df7ee-8d67-43c1-b6f6-2686c22d4926/pull/0.log" Jun 03 23:39:29.522243 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.522224 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m_e27df7ee-8d67-43c1-b6f6-2686c22d4926/extract/0.log" Jun 03 23:39:29.766063 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.765970 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mr4fq_ae48c011-2cd4-428b-abe6-fb7a40279517/manager/0.log" Jun 03 23:39:29.873172 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:29.873142 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8br2s_e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76/manager/0.log" Jun 03 23:39:30.101402 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:30.101364 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2bsdp_9bbd9762-9cfa-4eee-b438-b744c1790a41/registry-server/0.log" Jun 03 23:39:30.228168 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:30.228112 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9zb4d_639e5ecf-1e2e-4dee-a2c6-fd7523218cf0/manager/0.log" Jun 03 23:39:30.808806 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:30.808770 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xkrll_969dd539-a811-4f8e-ab14-dcb5645ff884/istio-proxy/0.log" Jun 03 23:39:31.267809 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:31.267768 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/1.log" Jun 03 23:39:31.517532 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:31.517493 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qzmdr_35233120-809a-4ce0-abe3-7e59b66af347/payload-processing/0.log" Jun 03 23:39:32.087295 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:32.087263 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vs4bg_c365d72f-78f2-4bd1-b809-0fc1b41d8cf5/storage-initializer/0.log" Jun 03 23:39:32.097173 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:32.097133 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vs4bg_c365d72f-78f2-4bd1-b809-0fc1b41d8cf5/main/0.log" Jun 03 23:39:32.563513 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:32.563480 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-922rp_da639df4-88f6-46c0-b0a8-2a7eea54feec/main/0.log" Jun 03 23:39:32.570623 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:32.570597 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-922rp_da639df4-88f6-46c0-b0a8-2a7eea54feec/storage-initializer/0.log" Jun 03 23:39:36.414919 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:36.414881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:39:36.513487 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:36.513453 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" limit=1024 Jun 03 23:39:39.580080 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:39.580046 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cwvbb_ae5e4523-ba1b-4d5d-8047-8e5c6bc3b284/global-pull-secret-syncer/0.log" Jun 03 23:39:39.721564 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:39.721530 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-24zzr_d7ae724e-2e2f-46f4-ac73-8234b2e7906e/konnectivity-agent/0.log" Jun 03 23:39:39.931919 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:39.931891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-57.ec2.internal_61ecd56d755653003648b18cd86621d4/haproxy/0.log" Jun 03 23:39:44.756658 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.756628 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2_1bc1ab34-0145-464e-8d8a-7e62f8959b05/extract/0.log" Jun 03 23:39:44.779208 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.779169 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2_1bc1ab34-0145-464e-8d8a-7e62f8959b05/util/0.log" Jun 03 23:39:44.801398 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.801362 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xhnc2_1bc1ab34-0145-464e-8d8a-7e62f8959b05/pull/0.log" Jun 03 23:39:44.831051 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.831022 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg_71ecca99-3846-446d-a7cc-e97c5e93f371/extract/0.log" Jun 03 23:39:44.855690 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.855660 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg_71ecca99-3846-446d-a7cc-e97c5e93f371/util/0.log" Jun 03 23:39:44.887159 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.887121 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vffpg_71ecca99-3846-446d-a7cc-e97c5e93f371/pull/0.log" Jun 03 23:39:44.935559 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.935526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn_5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6/extract/0.log" Jun 03 23:39:44.959005 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.958973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn_5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6/util/0.log" Jun 03 23:39:44.982055 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:44.982026 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ldjhn_5e1a9a6a-8fe2-4580-a2b2-14cf8f6039e6/pull/0.log" Jun 03 23:39:45.013740 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.013640 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m_e27df7ee-8d67-43c1-b6f6-2686c22d4926/extract/0.log" Jun 03 23:39:45.037409 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.037380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m_e27df7ee-8d67-43c1-b6f6-2686c22d4926/util/0.log" Jun 03 23:39:45.063637 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.063605 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9h8m_e27df7ee-8d67-43c1-b6f6-2686c22d4926/pull/0.log" Jun 03 23:39:45.429667 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.429630 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mr4fq_ae48c011-2cd4-428b-abe6-fb7a40279517/manager/0.log" Jun 03 23:39:45.459507 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.459471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8br2s_e64d6c3b-5ef3-46c7-9ba4-a35fda6f6b76/manager/0.log" Jun 03 23:39:45.557650 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.557606 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2bsdp_9bbd9762-9cfa-4eee-b438-b744c1790a41/registry-server/0.log" Jun 03 23:39:45.655294 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:45.655262 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9zb4d_639e5ecf-1e2e-4dee-a2c6-fd7523218cf0/manager/0.log" Jun 03 23:39:47.877773 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:47.877740 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dvxpj_e8be78cb-078f-4adf-a7ad-3a6397bc9a71/node-exporter/0.log" Jun 03 23:39:47.902371 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:47.902343 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dvxpj_e8be78cb-078f-4adf-a7ad-3a6397bc9a71/kube-rbac-proxy/0.log" Jun 03 23:39:47.925169 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:47.925138 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dvxpj_e8be78cb-078f-4adf-a7ad-3a6397bc9a71/init-textfile/0.log" Jun 03 23:39:51.310121 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.310082 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-fppqh_e9a91dcf-af4f-4a76-8a7c-e20e7efc6f73/download-server/0.log" Jun 03 23:39:51.710515 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.710479 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk"] Jun 03 23:39:51.714040 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.714020 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.716655 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.716630 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmvz\"/\"openshift-service-ca.crt\"" Jun 03 23:39:51.717880 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.717859 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bzmvz\"/\"default-dockercfg-jvmb9\"" Jun 03 23:39:51.718011 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.717903 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bzmvz\"/\"kube-root-ca.crt\"" Jun 03 23:39:51.723207 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.723183 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk"] Jun 03 23:39:51.870316 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.870280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-sys\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.870542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.870340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-lib-modules\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.870542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.870368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpv6s\" (UniqueName: \"kubernetes.io/projected/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-kube-api-access-rpv6s\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.870542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.870421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-podres\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.870542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.870470 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-proc\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.971776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-lib-modules\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.971776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpv6s\" (UniqueName: \"kubernetes.io/projected/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-kube-api-access-rpv6s\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.971776 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971761 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-podres\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.972076 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-proc\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.972076 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971850 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-sys\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.972076 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-lib-modules\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.972076 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971917 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-podres\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.972076 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-proc\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.972076 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.971950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-sys\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:51.980429 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:51.980399 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpv6s\" (UniqueName: \"kubernetes.io/projected/ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0-kube-api-access-rpv6s\") pod \"perf-node-gather-daemonset-4rvrk\" (UID: \"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0\") " pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:52.026455 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:52.026412 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:52.172960 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:52.172921 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk"] Jun 03 23:39:52.174297 ip-10-0-134-57 kubenswrapper[2567]: W0603 23:39:52.174264 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podce50d7e8_2f6f_46ec_96b8_91ce6b0aa7f0.slice/crio-7fb80e5f40aa2b73a76626e50c9ece3baa9210d4eb040f27fb29e5d7126ce1fb WatchSource:0}: Error finding container 7fb80e5f40aa2b73a76626e50c9ece3baa9210d4eb040f27fb29e5d7126ce1fb: Status 404 returned error can't find the container with id 7fb80e5f40aa2b73a76626e50c9ece3baa9210d4eb040f27fb29e5d7126ce1fb Jun 03 23:39:52.867994 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:52.867951 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" event={"ID":"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0","Type":"ContainerStarted","Data":"fb556845dceef398008d1fbec525dff6f166c397d0600f2cb797b277cf38c879"} Jun 03 23:39:52.868439 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:52.868009 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" event={"ID":"ce50d7e8-2f6f-46ec-96b8-91ce6b0aa7f0","Type":"ContainerStarted","Data":"7fb80e5f40aa2b73a76626e50c9ece3baa9210d4eb040f27fb29e5d7126ce1fb"} Jun 03 23:39:52.868439 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:52.868029 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:52.886035 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:52.885940 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" podStartSLOduration=1.885925479 podStartE2EDuration="1.885925479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:39:52.88418484 +0000 UTC m=+2233.756860680" watchObservedRunningTime="2026-06-03 23:39:52.885925479 +0000 UTC m=+2233.758601319" Jun 03 23:39:53.229072 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:53.228980 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tn4rt_3910fc8a-96c5-43be-b753-81859eeca4d9/dns/0.log" Jun 03 23:39:53.253726 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:53.253676 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tn4rt_3910fc8a-96c5-43be-b753-81859eeca4d9/kube-rbac-proxy/0.log" Jun 03 23:39:53.366431 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:53.366391 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6lhv_0083f679-5603-4b7f-8098-d478a2f9b68a/dns-node-resolver/0.log" Jun 03 23:39:53.965286 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:53.965252 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64699c8c76-7wfc7_24a1f585-f985-4d31-95b3-0dabeaed934c/registry/0.log" Jun 03 23:39:53.987908 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:53.987877 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5fbtc_119ffaff-1d2f-4fd7-8f1d-24db7f0aa517/node-ca/0.log" Jun 03 23:39:55.032608 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:55.032578 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xkrll_969dd539-a811-4f8e-ab14-dcb5645ff884/istio-proxy/0.log" Jun 03 23:39:55.268542 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:55.268492 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/0.log" Jun 03 23:39:55.332426 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:55.332316 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/1.log" Jun 03 23:39:55.506929 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:55.506903 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qzmdr_35233120-809a-4ce0-abe3-7e59b66af347/payload-processing/0.log" Jun 03 23:39:56.155813 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:56.155778 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-clp57_81a75ce0-3dea-40c6-859e-8d3c77766c39/serve-healthcheck-canary/0.log" Jun 03 23:39:56.936277 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:56.936249 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl7df_25db501a-9cc1-41a3-8a67-73fc9224bb31/kube-rbac-proxy/0.log" Jun 03 23:39:56.960146 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:56.960119 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl7df_25db501a-9cc1-41a3-8a67-73fc9224bb31/exporter/0.log" Jun 03 23:39:56.984439 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:56.984411 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl7df_25db501a-9cc1-41a3-8a67-73fc9224bb31/extractor/0.log" Jun 03 23:39:58.884342 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:58.884316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bzmvz/perf-node-gather-daemonset-4rvrk" Jun 03 23:39:59.547673 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:59.547639 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-574764c5bd-2zr7x_57ca6262-0461-4409-ab3d-502b46b59ba8/nginx/0.log" Jun 03 23:39:59.775782 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:59.775746 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-9d5b5566f-rjhgk_c52499f0-8652-4048-aaa7-cde7ba0026d9/maas-api/0.log" Jun 03 23:39:59.945571 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:39:59.945532 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65fdcf5f97-xtqdl_082b314d-bf60-4206-a9c6-3bb147b2b4c2/manager/0.log" Jun 03 23:40:00.211460 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:00.211364 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-6tj97_5425e493-6474-43cc-b504-6ec41733babd/manager/0.log" Jun 03 23:40:00.232233 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:00.232207 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588c8dd987-6tj97_5425e493-6474-43cc-b504-6ec41733babd/copy-manifests/0.log" Jun 03 23:40:02.204218 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:02.204189 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bbc48ffd-7wccm_1f1587fe-a1db-4d47-b45d-6c950426ebde/manager/0.log" Jun 03 23:40:02.261113 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:02.261078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-sxmxl_d887e2d9-67f7-40e1-84ab-f090f5b692ef/openshift-lws-operator/0.log" Jun 03 23:40:05.594647 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:05.594602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xkrll_969dd539-a811-4f8e-ab14-dcb5645ff884/istio-proxy/0.log" Jun 03 23:40:05.780189 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:05.780150 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/0.log" Jun 03 23:40:05.847425 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:05.847307 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/1.log" Jun 03 23:40:05.995441 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:05.995399 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qzmdr_35233120-809a-4ce0-abe3-7e59b66af347/payload-processing/0.log" Jun 03 23:40:07.121927 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:07.121895 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xkrll_969dd539-a811-4f8e-ab14-dcb5645ff884/istio-proxy/0.log" Jun 03 23:40:07.316016 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:07.315981 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/0.log" Jun 03 23:40:07.381425 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:07.381326 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/1.log" Jun 03 23:40:07.540122 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:07.540082 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qzmdr_35233120-809a-4ce0-abe3-7e59b66af347/payload-processing/0.log" Jun 03 23:40:07.580109 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:07.580080 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-52858_8f0fba53-e401-405c-b25b-82f896c7768d/migrator/0.log" Jun 03 23:40:07.603334 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:07.603307 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-52858_8f0fba53-e401-405c-b25b-82f896c7768d/graceful-termination/0.log" Jun 03 23:40:09.318661 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.318633 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/kube-multus-additional-cni-plugins/0.log" Jun 03 23:40:09.320936 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.320906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xkrll_969dd539-a811-4f8e-ab14-dcb5645ff884/istio-proxy/0.log" Jun 03 23:40:09.342511 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.342485 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/egress-router-binary-copy/0.log" Jun 03 23:40:09.367492 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.367468 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/cni-plugins/0.log" Jun 03 23:40:09.393855 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.393816 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/bond-cni-plugin/0.log" Jun 03 23:40:09.418989 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.418960 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/routeoverride-cni/0.log" Jun 03 23:40:09.442670 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.442644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/whereabouts-cni-bincopy/0.log" Jun 03 23:40:09.467738 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.467692 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2g4cx_1abf7841-3cac-42c7-8f1b-4443501435a1/whereabouts-cni/0.log" Jun 03 23:40:09.498844 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.498808 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/0.log" Jun 03 23:40:09.562955 ip-10-0-134-57 kubenswrapper[2567]: I0603 23:40:09.562922 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6f768_c7beffc9-3576-4742-9fdd-29a93b49d538/istio-proxy/1.log"