Jun 13 00:55:09.614645 ip-10-0-129-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 13 00:55:09.614660 ip-10-0-129-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 13 00:55:09.614669 ip-10-0-129-42 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 13 00:55:09.614994 ip-10-0-129-42 systemd[1]: Failed to start Kubernetes Kubelet. Jun 13 00:55:19.745067 ip-10-0-129-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 13 00:55:19.745082 ip-10-0-129-42 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cd7a7d6e80574026808cbf84d5f2a7e2 -- Jun 13 00:57:41.877584 ip-10-0-129-42 systemd[1]: Starting Kubernetes Kubelet... Jun 13 00:57:42.316633 ip-10-0-129-42 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:57:42.316633 ip-10-0-129-42 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 00:57:42.316633 ip-10-0-129-42 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:57:42.317319 ip-10-0-129-42 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 00:57:42.317319 ip-10-0-129-42 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 00:57:42.317749 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.317644 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 00:57:42.322767 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322751 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:57:42.322767 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322766 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322770 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322774 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322776 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322781 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322783 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322786 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322789 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322791 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322794 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322797 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322799 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322802 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322804 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322807 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322809 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322812 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322815 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322817 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322820 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:57:42.322844 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322822 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322825 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322827 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322830 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322832 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322835 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322837 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322839 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322846 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322848 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322851 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322854 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322857 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322859 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322862 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322864 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322867 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322869 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322872 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:57:42.323329 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322874 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322876 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322879 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322881 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322884 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322886 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322890 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322894 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322897 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322900 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322903 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322905 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322908 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322911 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322915 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322925 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322928 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322930 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322934 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:57:42.323789 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322938 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322941 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322944 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322947 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322949 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322952 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322954 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322957 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322960 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322962 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322965 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322967 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322970 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322972 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322974 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322977 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322979 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322982 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322984 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322987 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:57:42.324306 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322990 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322994 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.322998 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323000 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323003 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323007 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323009 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323012 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323015 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323017 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323020 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323022 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323025 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323027 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323030 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323032 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323035 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323037 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323040 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.323043 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:57:42.324766 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324754 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324762 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324765 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324769 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324773 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324776 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324779 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324781 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324784 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324787 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324790 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324793 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324795 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324797 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324801 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324803 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324806 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324808 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324811 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324813 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:57:42.325249 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324817 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324819 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324822 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324824 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324827 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324829 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324831 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324834 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324836 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324839 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324841 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324844 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324847 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324849 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324852 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324855 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324858 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324860 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324863 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324865 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:57:42.325759 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324868 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324870 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324873 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324875 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324878 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324881 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324883 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324886 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324888 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324891 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324894 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324896 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324899 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324902 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324904 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324906 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324909 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324911 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324914 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324917 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:57:42.326309 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324920 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324922 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324925 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324927 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324929 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324932 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324935 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324938 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324941 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324943 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324946 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324948 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324950 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324952 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324955 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324957 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324959 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324963 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324967 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:57:42.326785 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324970 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324973 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324978 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324982 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324985 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324988 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324991 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324994 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324996 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.324999 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325002 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325006 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325009 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325013 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325015 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325018 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325021 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325023 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325026 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:57:42.327257 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325029 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325417 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325422 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325425 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325428 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325430 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325433 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325435 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325438 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325440 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325443 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325446 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325449 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325451 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325454 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325457 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325459 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325462 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325465 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325467 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:57:42.327722 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325470 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325472 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325475 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325477 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325480 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325482 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325486 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325489 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325492 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325495 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325498 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325501 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325504 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325507 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325510 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325512 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325515 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325517 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325519 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:57:42.328233 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325522 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325524 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325527 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325529 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325532 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325534 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325536 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325539 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325542 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325544 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325547 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325549 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325551 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325554 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325556 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325559 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325561 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325563 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325566 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325571 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:57:42.328685 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325573 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325576 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325578 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325580 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325583 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325586 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325589 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325591 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325594 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325596 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325599 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325602 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325604 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325607 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325610 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325612 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325617 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325620 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325623 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:57:42.329227 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325627 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325630 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325634 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325636 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325638 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325641 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325643 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325646 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325648 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325650 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325653 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325655 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325660 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325662 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325664 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325667 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325670 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325672 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325675 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325678 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:57:42.329683 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325681 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.325683 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325754 2583 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325761 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325767 2583 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325771 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325775 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325778 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325782 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325786 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325789 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325792 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325795 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325801 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325804 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325809 2583 flags.go:64] FLAG: --cgroup-root="" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325812 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325815 2583 flags.go:64] FLAG: --client-ca-file="" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325817 2583 flags.go:64] FLAG: --cloud-provider="external" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325820 2583 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325825 2583 flags.go:64] FLAG: --cluster-domain="" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325827 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325831 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325834 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 00:57:42.330198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325839 2583 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325846 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325849 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325852 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325855 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325858 2583 flags.go:64] FLAG: --contention-profiling="false" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325861 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325864 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325867 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325870 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325874 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325877 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325880 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325882 2583 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325885 2583 flags.go:64] FLAG: --enable-server="true" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325888 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325892 2583 flags.go:64] FLAG: --event-burst="100" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325895 2583 flags.go:64] FLAG: --event-qps="50" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325898 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325900 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325903 2583 flags.go:64] FLAG: --eviction-hard="" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325907 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325910 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325913 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325916 2583 flags.go:64] FLAG: --eviction-soft="" Jun 13 00:57:42.330831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325919 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325922 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325924 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325927 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325930 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325933 2583 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325935 2583 flags.go:64] FLAG: --feature-gates="" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325941 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325944 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325947 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325950 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325953 2583 flags.go:64] FLAG: --healthz-port="10248" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325956 2583 flags.go:64] FLAG: --help="false" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325958 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325970 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325974 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325977 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325980 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325983 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325986 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325989 2583 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325992 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325994 2583 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 00:57:42.331442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.325997 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326000 2583 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326003 2583 flags.go:64] FLAG: --kube-reserved="" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326006 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326008 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326011 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326014 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326016 2583 flags.go:64] FLAG: --lock-file="" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326019 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326023 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326026 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326031 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326034 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326037 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326039 2583 flags.go:64] FLAG: --logging-format="text" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326042 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326048 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326050 2583 flags.go:64] FLAG: --manifest-url="" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326056 2583 flags.go:64] FLAG: --manifest-url-header="" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326060 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326063 2583 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326067 2583 flags.go:64] FLAG: --max-pods="110" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326070 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326073 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326075 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 00:57:42.332010 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326078 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326081 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326084 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326087 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326094 2583 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326096 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326099 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326102 2583 flags.go:64] FLAG: --pod-cidr="" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326105 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326110 2583 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326113 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326116 2583 flags.go:64] FLAG: --pods-per-core="0" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326118 2583 flags.go:64] FLAG: --port="10250" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326121 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326124 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b23e885ba7bc59bc" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326127 2583 flags.go:64] FLAG: --qos-reserved="" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326130 2583 flags.go:64] FLAG: --read-only-port="10255" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326133 2583 flags.go:64] FLAG: --register-node="true" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326136 2583 flags.go:64] FLAG: --register-with-taints="" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326140 2583 flags.go:64] FLAG: --registry-burst="10" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326143 2583 flags.go:64] FLAG: --registry-qps="5" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326159 2583 flags.go:64] FLAG: --reserved-cpus="" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326163 2583 flags.go:64] FLAG: --reserved-memory="" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326168 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326171 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 00:57:42.332635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326174 2583 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326178 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326181 2583 flags.go:64] FLAG: --runonce="false" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326183 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326186 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326189 2583 flags.go:64] FLAG: --seccomp-default="false" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326192 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326194 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326197 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326200 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326203 2583 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326206 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326209 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326211 2583 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326214 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326216 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326219 2583 flags.go:64] FLAG: --system-cgroups="" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326222 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326227 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326230 2583 flags.go:64] FLAG: --tls-cert-file="" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326232 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326237 2583 flags.go:64] FLAG: --tls-min-version="" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326240 2583 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326242 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326245 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 00:57:42.333251 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326249 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326251 2583 flags.go:64] FLAG: --v="2" Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326255 2583 flags.go:64] FLAG: --version="false" Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326259 2583 flags.go:64] FLAG: --vmodule="" Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326262 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.326266 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326381 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326387 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326392 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326395 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326398 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326401 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326404 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326407 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326410 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326412 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326415 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326417 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326420 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326422 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:57:42.333855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326424 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326427 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326429 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326432 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326434 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326437 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326440 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326443 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326446 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326449 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326451 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326454 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326456 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326460 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326462 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326465 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326467 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326471 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326474 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:57:42.334391 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326476 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326480 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326482 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326485 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326487 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326490 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326492 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326495 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326497 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326500 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326502 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326505 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326508 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326511 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326513 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326515 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326518 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326521 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326523 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326526 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:57:42.334854 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326528 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326530 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326533 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326535 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326538 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326540 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326543 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326546 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326549 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326551 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326555 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326557 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326560 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326564 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326566 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326569 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326571 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326574 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326576 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326579 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:57:42.335351 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326581 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326584 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326586 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326589 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326591 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326594 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326596 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326600 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326603 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326605 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326608 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326611 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326614 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326616 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326619 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326622 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326624 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326627 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326629 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:57:42.335828 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326632 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326635 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326637 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326644 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326646 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326649 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.326653 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.327205 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.333763 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.333777 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.333796 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.333801 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333860 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333865 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333869 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:57:42.336296 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333872 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333875 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333878 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333881 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333884 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333886 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333889 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333892 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333894 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333897 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333899 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333901 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333904 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333907 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333909 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333912 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333914 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333916 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333921 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333924 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:57:42.336665 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333928 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333930 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333933 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333936 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333938 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333941 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333945 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333947 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333950 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333952 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333955 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333957 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333968 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333971 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333973 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333976 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333979 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333983 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333986 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:57:42.337160 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333990 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333992 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333995 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.333998 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334000 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334003 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334005 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334008 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334010 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334013 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334015 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334018 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334020 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334023 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334025 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334027 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334030 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334032 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334035 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:57:42.337616 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334039 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334042 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334044 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334047 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334051 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334055 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334058 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334060 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334063 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334065 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334068 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334070 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334073 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334075 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334078 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334080 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334083 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334085 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334088 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334090 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:57:42.338071 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334092 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334095 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334097 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334100 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334103 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334106 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334108 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334110 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334112 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334115 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334117 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334120 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334123 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334125 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334128 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334131 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334133 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:57:42.338580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334136 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.334140 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334267 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334271 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334275 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334277 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334280 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334283 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334285 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334288 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334291 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334293 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334295 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334298 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334300 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 00:57:42.338990 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334303 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334305 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334307 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334310 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334313 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334315 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334318 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334320 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334322 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334325 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334327 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334330 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334332 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334335 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334339 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334344 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334348 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334350 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334353 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 00:57:42.339368 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334356 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334359 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334362 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334364 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334366 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334369 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334371 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334374 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334376 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334378 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334381 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334383 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334386 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334388 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334390 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334393 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334395 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334400 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334403 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 00:57:42.339855 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334406 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334409 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334411 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334414 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334417 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334419 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334422 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334425 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334427 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334430 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334433 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334435 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334437 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334440 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334442 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334445 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334447 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334450 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334452 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334454 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 00:57:42.340312 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334457 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334459 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334461 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334463 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334466 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334468 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334471 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334473 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334475 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334478 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334481 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334483 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334485 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334488 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334490 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334492 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334495 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334497 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334499 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334502 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 00:57:42.340799 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334505 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334507 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334509 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334512 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334515 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334517 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334519 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:42.334522 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.334526 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.334624 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.337300 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.338592 2583 server.go:1019] "Starting client certificate rotation" Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.338698 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 00:57:42.341278 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.338742 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 00:57:42.343568 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.343543 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 00:57:42.347108 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.347094 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 00:57:42.352016 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.351999 2583 log.go:25] "Validated CRI v1 runtime API" Jun 13 00:57:42.354774 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.354756 2583 log.go:25] "Validated CRI v1 image API" Jun 13 00:57:42.358303 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.358287 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 00:57:42.361495 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.361473 2583 fs.go:135] Filesystem UUIDs: map[3859543a-869c-4f6a-a315-5fb7fa1ed26c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ed5b3a5d-d029-4dda-90e9-f102e014b52c:/dev/nvme0n1p4] Jun 13 00:57:42.361587 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.361493 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 00:57:42.367000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.366882 2583 manager.go:216] Machine: {Timestamp:2026-06-13 00:57:42.365655741 +0000 UTC m=+0.361568123 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107115 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec285e921213d3e7cc6216ad577cdfc0 SystemUUID:ec285e92-1213-d3e7-cc62-16ad577cdfc0 BootID:cd7a7d6e-8057-4026-808c-bf84d5f2a7e2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:36:f8:65:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:36:f8:65:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:f4:6b:1a:58:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 00:57:42.367000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.366986 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 00:57:42.367167 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.367119 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 00:57:42.370100 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.370072 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 00:57:42.370216 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.370195 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 00:57:42.370277 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.370100 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 00:57:42.370783 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.370771 2583 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 00:57:42.370832 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.370785 2583 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 00:57:42.370832 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.370793 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 00:57:42.371358 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.371348 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 00:57:42.372475 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.372465 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 00:57:42.376107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376095 2583 state_mem.go:36] "Initialized new in-memory state store" Jun 13 00:57:42.376236 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376226 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 00:57:42.376287 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376255 2583 kubelet.go:486] "Attempting to sync node with API server" Jun 13 00:57:42.376287 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376265 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 00:57:42.376287 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376282 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 00:57:42.376426 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376294 2583 kubelet.go:398] "Adding apiserver pod source" Jun 13 00:57:42.376426 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376305 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 00:57:42.376704 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376689 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 00:57:42.376765 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.376713 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 00:57:42.378882 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.378867 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 00:57:42.387197 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387183 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 00:57:42.387255 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387216 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 00:57:42.387797 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387787 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 00:57:42.387831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387802 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 00:57:42.387831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387809 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 00:57:42.387831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387814 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 00:57:42.387831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387823 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 00:57:42.387831 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387829 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 00:57:42.388000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387838 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 00:57:42.388000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387843 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 00:57:42.388000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387850 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 00:57:42.388000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387855 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 00:57:42.388000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387865 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 00:57:42.388000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.387870 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 00:57:42.388524 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.388514 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 00:57:42.388597 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.388525 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 00:57:42.391741 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.391727 2583 server.go:1268] "Started kubelet" Jun 13 00:57:42.391862 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.391829 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 00:57:42.392000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.391817 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 00:57:42.392093 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.392022 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 00:57:42.396040 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.396022 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 00:57:42.396355 ip-10-0-129-42 systemd[1]: Started Kubernetes Kubelet. Jun 13 00:57:42.400464 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.400446 2583 server.go:310] "Adding debug handlers to kubelet server" Jun 13 00:57:42.400943 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.400920 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 00:57:42.401042 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.401026 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 00:57:42.401091 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.401022 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 00:57:42.401405 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.401384 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 00:57:42.403701 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.402722 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-42.ec2.internal.18b87e1099e789d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-42.ec2.internal,UID:ip-10-0-129-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-42.ec2.internal,},FirstTimestamp:2026-06-13 00:57:42.391695828 +0000 UTC m=+0.387608197,LastTimestamp:2026-06-13 00:57:42.391695828 +0000 UTC m=+0.387608197,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-42.ec2.internal,}" Jun 13 00:57:42.404874 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.404861 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 00:57:42.404874 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.404866 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 00:57:42.404976 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.404916 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:42.405381 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.405363 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 00:57:42.405735 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.405717 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 00:57:42.405735 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.405735 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 00:57:42.405872 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.405809 2583 reconstruct.go:97] "Volume reconstruction finished" Jun 13 00:57:42.405872 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.405818 2583 reconciler.go:29] "Reconciler: start to sync state" Jun 13 00:57:42.407388 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.407372 2583 factory.go:55] Registering systemd factory Jun 13 00:57:42.407450 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.407418 2583 factory.go:223] Registration of the systemd container factory successfully Jun 13 00:57:42.408002 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.407822 2583 factory.go:153] Registering CRI-O factory Jun 13 00:57:42.408002 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.407839 2583 factory.go:223] Registration of the crio container factory successfully Jun 13 00:57:42.408002 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.407887 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 00:57:42.408174 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.408026 2583 factory.go:103] Registering Raw factory Jun 13 00:57:42.408174 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.408094 2583 manager.go:1196] Started watching for new ooms in manager Jun 13 00:57:42.408565 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.408547 2583 manager.go:349] Starting recovery of all containers Jun 13 00:57:42.409376 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.409358 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ghh6n" Jun 13 00:57:42.411970 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.411941 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 00:57:42.412052 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.411965 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 00:57:42.418907 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.418883 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ghh6n" Jun 13 00:57:42.422484 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.422469 2583 manager.go:354] Recovery completed Jun 13 00:57:42.426735 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.426708 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.429026 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429010 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.429084 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429038 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.429084 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429048 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.429644 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429629 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 00:57:42.429644 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429642 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 00:57:42.429767 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429658 2583 state_mem.go:36] "Initialized new in-memory state store" Jun 13 00:57:42.429767 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.429664 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.430840 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.430820 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.430924 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.430858 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.430924 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.430883 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.431578 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.431434 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-42.ec2.internal.18b87e109c2124db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-42.ec2.internal,UID:ip-10-0-129-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-42.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-42.ec2.internal,},FirstTimestamp:2026-06-13 00:57:42.429025499 +0000 UTC m=+0.424937868,LastTimestamp:2026-06-13 00:57:42.429025499 +0000 UTC m=+0.424937868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-42.ec2.internal,}" Jun 13 00:57:42.433113 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.433098 2583 policy_none.go:49] "None policy: Start" Jun 13 00:57:42.433113 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.433116 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 00:57:42.433218 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.433126 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 00:57:42.435070 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.435059 2583 policy_none.go:47] "Start" Jun 13 00:57:42.473716 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.473699 2583 manager.go:337] "Starting Device Plugin manager" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.473737 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.473749 2583 server.go:87] "Starting device plugin registration server" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.473939 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.474029 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.474041 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.474143 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.474230 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.474239 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.474907 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.474956 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.475551 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.475588 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.475606 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.475675 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 00:57:42.485719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.477841 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:57:42.574446 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.574361 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.575407 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.575378 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.575480 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.575418 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.575480 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.575432 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.575480 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.575459 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.575786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.575770 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal"] Jun 13 00:57:42.575835 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.575826 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.576613 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.576594 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.576708 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.576629 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.576708 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.576639 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.578674 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.578661 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.578801 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.578787 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.578836 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.578817 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.579356 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.579332 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.579356 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.579342 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.579519 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.579360 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.579519 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.579367 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.579519 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.579376 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.579519 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.579378 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.581454 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.581437 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.581545 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.581468 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 00:57:42.582178 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.582143 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientMemory" Jun 13 00:57:42.582284 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.582191 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 00:57:42.582284 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.582203 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeHasSufficientPID" Jun 13 00:57:42.590329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.590314 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.590403 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.590332 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-42.ec2.internal\": node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:42.604834 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.604819 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-42.ec2.internal\" not found" node="ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.606767 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.606752 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/981a13f7fca26af32c5802ef7ed2d279-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal\" (UID: \"981a13f7fca26af32c5802ef7ed2d279\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.606817 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.606775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/981a13f7fca26af32c5802ef7ed2d279-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal\" (UID: \"981a13f7fca26af32c5802ef7ed2d279\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.606817 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.606791 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a552396380661cf3c3f2936a8001308d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-42.ec2.internal\" (UID: \"a552396380661cf3c3f2936a8001308d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.609248 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.609233 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-42.ec2.internal\" not found" node="ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.623984 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.623968 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:42.706949 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.706924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/981a13f7fca26af32c5802ef7ed2d279-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal\" (UID: \"981a13f7fca26af32c5802ef7ed2d279\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.707071 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.706957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/981a13f7fca26af32c5802ef7ed2d279-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal\" (UID: \"981a13f7fca26af32c5802ef7ed2d279\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.707071 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.706976 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a552396380661cf3c3f2936a8001308d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-42.ec2.internal\" (UID: \"a552396380661cf3c3f2936a8001308d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.707071 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.707028 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a552396380661cf3c3f2936a8001308d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-42.ec2.internal\" (UID: \"a552396380661cf3c3f2936a8001308d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.707071 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.707036 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/981a13f7fca26af32c5802ef7ed2d279-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal\" (UID: \"981a13f7fca26af32c5802ef7ed2d279\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.707071 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.707026 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/981a13f7fca26af32c5802ef7ed2d279-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal\" (UID: \"981a13f7fca26af32c5802ef7ed2d279\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.724767 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.724737 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:42.825710 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.825641 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:42.908405 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.908378 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.913351 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:42.912740 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" Jun 13 00:57:42.925868 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:42.925849 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.026380 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.026339 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.126855 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.126797 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.227298 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.227271 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.327814 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.327782 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.337963 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.337945 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 00:57:43.338129 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.338112 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 00:57:43.424653 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.424442 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 00:52:42 +0000 UTC" deadline="2028-02-22 14:40:20.576678446 +0000 UTC" Jun 13 00:57:43.424653 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.424613 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14869h42m37.152068862s" Jun 13 00:57:43.428248 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.428229 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.465702 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:43.465658 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda552396380661cf3c3f2936a8001308d.slice/crio-b7d256e16bfda9aed336654c1bfa01eb4c403b7964801893529b5a2df3cae998 WatchSource:0}: Error finding container b7d256e16bfda9aed336654c1bfa01eb4c403b7964801893529b5a2df3cae998: Status 404 returned error can't find the container with id b7d256e16bfda9aed336654c1bfa01eb4c403b7964801893529b5a2df3cae998 Jun 13 00:57:43.466596 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:43.466576 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981a13f7fca26af32c5802ef7ed2d279.slice/crio-86b34e8ff9a888b4e0e13e1ca4bd74b37931753fcd10150f5d1d9cbea284ea25 WatchSource:0}: Error finding container 86b34e8ff9a888b4e0e13e1ca4bd74b37931753fcd10150f5d1d9cbea284ea25: Status 404 returned error can't find the container with id 86b34e8ff9a888b4e0e13e1ca4bd74b37931753fcd10150f5d1d9cbea284ea25 Jun 13 00:57:43.471434 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.471414 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 00:57:43.478986 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.478949 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" event={"ID":"981a13f7fca26af32c5802ef7ed2d279","Type":"ContainerStarted","Data":"86b34e8ff9a888b4e0e13e1ca4bd74b37931753fcd10150f5d1d9cbea284ea25"} Jun 13 00:57:43.480019 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.480002 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" event={"ID":"a552396380661cf3c3f2936a8001308d","Type":"ContainerStarted","Data":"b7d256e16bfda9aed336654c1bfa01eb4c403b7964801893529b5a2df3cae998"} Jun 13 00:57:43.528971 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.528947 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.629451 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:43.629415 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-42.ec2.internal\" not found" Jun 13 00:57:43.648452 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.648426 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:57:43.665137 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.665112 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:57:43.705748 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.705660 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" Jun 13 00:57:43.722481 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.722460 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 00:57:43.723675 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.723662 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" Jun 13 00:57:43.732927 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.732907 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 00:57:43.884432 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:43.884402 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:57:44.378174 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.378125 2583 apiserver.go:52] "Watching apiserver" Jun 13 00:57:44.388588 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.388559 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 00:57:44.388939 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.388915 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-b7dxp","openshift-network-operator/iptables-alerter-lrz9j","openshift-ovn-kubernetes/ovnkube-node-kn9pt","kube-system/konnectivity-agent-6stgw","kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kk2fw","openshift-dns/node-resolver-5m8l8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal","openshift-multus/multus-6kfrl","openshift-multus/multus-additional-cni-plugins-nttmg","openshift-network-diagnostics/network-check-target-2j9fv","kube-system/global-pull-secret-syncer-vpq9m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z","openshift-image-registry/node-ca-zfz9z"] Jun 13 00:57:44.391687 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.391663 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.393836 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.393796 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:44.393927 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.393884 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:44.396085 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.396065 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.396632 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.396611 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.396956 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.396941 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sw4c8\"" Jun 13 00:57:44.397193 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.397140 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.398334 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.398313 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.401417 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.401398 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.402647 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.402628 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 00:57:44.402936 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.402919 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.403129 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.403111 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.403770 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.403748 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 00:57:44.404025 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.403996 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 00:57:44.405465 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.405447 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.405663 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.405648 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qv4s4\"" Jun 13 00:57:44.405716 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.405669 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l4ktl\"" Jun 13 00:57:44.405844 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.405825 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 00:57:44.405907 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.405885 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 00:57:44.405966 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.405837 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.407009 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.406715 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 00:57:44.407009 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.406867 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 00:57:44.407009 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.406977 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 00:57:44.407475 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.407446 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8f4s7\"" Jun 13 00:57:44.407808 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.407790 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.407908 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.407891 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.408632 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.408606 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 00:57:44.408822 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.408791 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.409119 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.409101 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.409245 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.409208 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.409583 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.409561 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 00:57:44.409663 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.409627 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lzkhg\"" Jun 13 00:57:44.409762 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.409746 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.409830 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.409745 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zdd57\"" Jun 13 00:57:44.410056 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.410039 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.410056 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.410048 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 00:57:44.410424 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.410406 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.410538 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.410519 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4vxfk\"" Jun 13 00:57:44.410655 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.410636 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.410941 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.410926 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.412685 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.412627 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.414874 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-sys-fs\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.414913 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-systemd\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.414934 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-socket-dir-parent\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.414955 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-k8s-cni-cncf-io\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.414976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-systemd-units\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415004 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysctl-conf\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-os-release\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.415107 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415099 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed275d27-bea7-4a0e-b232-65e3bee1c108-cni-binary-copy\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.415438 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415138 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-node-log\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.415689 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415658 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:44.415783 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.415750 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:44.415966 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415183 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xbff\" (UniqueName: \"kubernetes.io/projected/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-kube-api-access-5xbff\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.416038 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.415998 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89ae70cd-14ab-4357-9fa2-2353fc19fdc0-agent-certs\") pod \"konnectivity-agent-6stgw\" (UID: \"89ae70cd-14ab-4357-9fa2-2353fc19fdc0\") " pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.416038 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416030 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-hostroot\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.416131 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-ovn\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416191 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416143 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-run\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.416231 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-netns\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.416272 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-daemon-config\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.416272 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416261 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-run-netns\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416348 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-cni-netd\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416348 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416334 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416422 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-env-overrides\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416422 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416403 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kf9q\" (UniqueName: \"kubernetes.io/projected/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-kube-api-access-4kf9q\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.416495 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416433 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-systemd\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416495 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416473 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416579 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-serviceca\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.416579 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416523 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-socket-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.416642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-registration-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.416642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416614 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-kubernetes\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.416642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416618 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 00:57:44.416746 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htl9h\" (UniqueName: \"kubernetes.io/projected/ed275d27-bea7-4a0e-b232-65e3bee1c108-kube-api-access-htl9h\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.416746 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416672 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysconfig\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.416746 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416696 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.416746 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416728 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-device-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.416880 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89ae70cd-14ab-4357-9fa2-2353fc19fdc0-konnectivity-ca\") pod \"konnectivity-agent-6stgw\" (UID: \"89ae70cd-14ab-4357-9fa2-2353fc19fdc0\") " pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.416880 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416852 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-lib-modules\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.416880 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-tmp\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.416970 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416907 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-cni-multus\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.416970 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416930 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-log-socket\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.416970 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.416956 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-cni-bin\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.417095 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e31718b-a295-4dcd-9a26-e6966941a147-tmp-dir\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.417095 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417085 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svgvc\" (UniqueName: \"kubernetes.io/projected/4e31718b-a295-4dcd-9a26-e6966941a147-kube-api-access-svgvc\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.417180 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417115 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-modprobe-d\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.417180 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-tuned\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.417246 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417195 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-cni-bin\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.417277 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-host\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.417277 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417265 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 00:57:44.417330 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417319 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-md9d2\"" Jun 13 00:57:44.417525 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417508 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 00:57:44.417705 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-cni-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.417747 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-kubelet\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.417780 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-kubelet\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.417821 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417807 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-etc-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.417920 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417906 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/313f6d01-b629-4a89-81dd-bb068943c9f2-ovn-node-metrics-cert\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.417975 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-sys\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.418008 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.417974 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-var-lib-kubelet\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.418039 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418021 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-conf-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.418075 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418052 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:44.418113 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418081 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-slash\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.418140 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418107 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.418140 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418128 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 00:57:44.418234 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418136 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-system-cni-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.418234 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418186 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-cnibin\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.418314 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418296 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nbvhb\"" Jun 13 00:57:44.418478 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418464 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.418566 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.418538 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:44.418612 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418296 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e31718b-a295-4dcd-9a26-e6966941a147-hosts-file\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.418612 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418602 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-ovnkube-config\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.418673 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418627 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 00:57:44.418673 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418636 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-etc-kubernetes\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.418734 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418679 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-ovnkube-script-lib\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.418734 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418711 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67mx4\" (UniqueName: \"kubernetes.io/projected/313f6d01-b629-4a89-81dd-bb068943c9f2-kube-api-access-67mx4\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.418825 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-var-lib-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.418825 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5b89\" (UniqueName: \"kubernetes.io/projected/e7e6cec3-96bd-43f2-a058-5042f396e335-kube-api-access-l5b89\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.418825 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418799 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysctl-d\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.418934 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418856 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-host\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.418934 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418886 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.418993 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.418936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-multus-certs\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.428224 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.428203 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 00:57:44.452324 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.452291 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cz94" Jun 13 00:57:44.463929 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.463905 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cz94" Jun 13 00:57:44.507275 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.507244 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 00:57:44.519642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519615 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kf9q\" (UniqueName: \"kubernetes.io/projected/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-kube-api-access-4kf9q\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.519642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519644 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-systemd\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.519838 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519661 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.519838 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519692 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbfk\" (UniqueName: \"kubernetes.io/projected/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-kube-api-access-pnbfk\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.519838 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519740 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-systemd\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.519838 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519753 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.519838 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwhvq\" (UniqueName: \"kubernetes.io/projected/ffea2b39-40c8-4462-9958-75457237e5a9-kube-api-access-bwhvq\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.519838 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-serviceca\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-socket-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-registration-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.519930 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-kubernetes\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520031 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-socket-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520043 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-registration-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htl9h\" (UniqueName: \"kubernetes.io/projected/ed275d27-bea7-4a0e-b232-65e3bee1c108-kube-api-access-htl9h\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cnibin\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520208 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffea2b39-40c8-4462-9958-75457237e5a9-iptables-alerter-script\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysconfig\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520273 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-device-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520320 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-kubernetes\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520330 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysconfig\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89ae70cd-14ab-4357-9fa2-2353fc19fdc0-konnectivity-ca\") pod \"konnectivity-agent-6stgw\" (UID: \"89ae70cd-14ab-4357-9fa2-2353fc19fdc0\") " pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520375 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-lib-modules\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-tmp\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520442 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-cni-multus\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520468 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-log-socket\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520472 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-lib-modules\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520512 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520531 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-log-socket\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520374 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-serviceca\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520556 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-device-dir\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520577 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-cni-bin\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520624 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e31718b-a295-4dcd-9a26-e6966941a147-tmp-dir\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520658 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-cni-bin\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svgvc\" (UniqueName: \"kubernetes.io/projected/4e31718b-a295-4dcd-9a26-e6966941a147-kube-api-access-svgvc\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-modprobe-d\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520725 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-tuned\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520723 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520756 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-cni-bin\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffea2b39-40c8-4462-9958-75457237e5a9-host-slash\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-host\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.520869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-cni-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520905 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-cni-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520957 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89ae70cd-14ab-4357-9fa2-2353fc19fdc0-konnectivity-ca\") pod \"konnectivity-agent-6stgw\" (UID: \"89ae70cd-14ab-4357-9fa2-2353fc19fdc0\") " pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.520624 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-cni-multus\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521007 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-modprobe-d\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521031 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-cni-bin\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521058 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-host\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521060 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e31718b-a295-4dcd-9a26-e6966941a147-tmp-dir\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-kubelet\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521137 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-var-lib-kubelet\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521144 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-kubelet\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-etc-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/313f6d01-b629-4a89-81dd-bb068943c9f2-ovn-node-metrics-cert\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-sys\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-var-lib-kubelet\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521282 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-etc-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-conf-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521314 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-kubelet\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.521728 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521330 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-slash\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521361 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-sys\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521383 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cni-binary-copy\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521411 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-system-cni-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-cnibin\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521570 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e31718b-a295-4dcd-9a26-e6966941a147-hosts-file\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521610 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-ovnkube-config\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521638 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxw2x\" (UniqueName: \"kubernetes.io/projected/cd626bdd-afc8-49c7-8bd0-cf998f381103-kube-api-access-dxw2x\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521667 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-etc-kubernetes\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521696 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-ovnkube-script-lib\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67mx4\" (UniqueName: \"kubernetes.io/projected/313f6d01-b629-4a89-81dd-bb068943c9f2-kube-api-access-67mx4\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521760 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-var-lib-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521790 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5b89\" (UniqueName: \"kubernetes.io/projected/e7e6cec3-96bd-43f2-a058-5042f396e335-kube-api-access-l5b89\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysctl-d\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.522642 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-host\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521878 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521905 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-multus-certs\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-sys-fs\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.521990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-systemd\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522016 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-socket-dir-parent\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-k8s-cni-cncf-io\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522069 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-os-release\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-systemd-units\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysctl-conf\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-os-release\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed275d27-bea7-4a0e-b232-65e3bee1c108-cni-binary-copy\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-node-log\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522259 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xbff\" (UniqueName: \"kubernetes.io/projected/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-kube-api-access-5xbff\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89ae70cd-14ab-4357-9fa2-2353fc19fdc0-agent-certs\") pod \"konnectivity-agent-6stgw\" (UID: \"89ae70cd-14ab-4357-9fa2-2353fc19fdc0\") " pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.523457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-hostroot\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-ovn\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522401 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-system-cni-dir\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522431 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12d1746b-3561-4720-868a-541f21891b97-kubelet-config\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522453 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysctl-d\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522461 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-run\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522511 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-var-lib-kubelet\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-netns\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522561 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-daemon-config\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522576 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-conf-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-run-netns\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-cni-netd\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522675 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522706 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-env-overrides\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522732 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12d1746b-3561-4720-868a-541f21891b97-dbus\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.524329 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522794 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-slash\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522841 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-host\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522872 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522888 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522937 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-cnibin\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522981 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-multus-certs\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523029 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4e31718b-a295-4dcd-9a26-e6966941a147-hosts-file\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523085 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7e6cec3-96bd-43f2-a058-5042f396e335-sys-fs\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523141 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-systemd\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523215 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-socket-dir-parent\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523259 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-k8s-cni-cncf-io\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523322 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-systemd-units\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523423 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-sysctl-conf\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523486 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-os-release\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523519 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-ovnkube-config\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.523588 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-etc-kubernetes\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524025 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed275d27-bea7-4a0e-b232-65e3bee1c108-cni-binary-copy\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524029 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-ovnkube-script-lib\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524104 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-node-log\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524304 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-var-lib-openvswitch\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.522939 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-system-cni-dir\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524559 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-host-run-netns\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524604 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed275d27-bea7-4a0e-b232-65e3bee1c108-hostroot\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524645 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-run-ovn\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524729 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-tmp\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524731 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-run\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524757 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-cni-netd\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524775 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.524819 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/313f6d01-b629-4a89-81dd-bb068943c9f2-host-run-netns\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.525030 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-etc-tuned\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.525626 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/313f6d01-b629-4a89-81dd-bb068943c9f2-env-overrides\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.525786 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.525693 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed275d27-bea7-4a0e-b232-65e3bee1c108-multus-daemon-config\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.526792 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.526773 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89ae70cd-14ab-4357-9fa2-2353fc19fdc0-agent-certs\") pod \"konnectivity-agent-6stgw\" (UID: \"89ae70cd-14ab-4357-9fa2-2353fc19fdc0\") " pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.527294 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.527274 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/313f6d01-b629-4a89-81dd-bb068943c9f2-ovn-node-metrics-cert\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.544068 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.544037 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kf9q\" (UniqueName: \"kubernetes.io/projected/669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3-kube-api-access-4kf9q\") pod \"tuned-kk2fw\" (UID: \"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.550988 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.550949 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:57:44.550988 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.550988 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:57:44.551139 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.551001 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:44.551139 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.551070 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:57:45.051037295 +0000 UTC m=+3.046949651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:44.551289 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.551169 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5b89\" (UniqueName: \"kubernetes.io/projected/e7e6cec3-96bd-43f2-a058-5042f396e335-kube-api-access-l5b89\") pod \"aws-ebs-csi-driver-node-r8n5z\" (UID: \"e7e6cec3-96bd-43f2-a058-5042f396e335\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.551510 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.551492 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xbff\" (UniqueName: \"kubernetes.io/projected/59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f-kube-api-access-5xbff\") pod \"node-ca-zfz9z\" (UID: \"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f\") " pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.551818 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.551800 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svgvc\" (UniqueName: \"kubernetes.io/projected/4e31718b-a295-4dcd-9a26-e6966941a147-kube-api-access-svgvc\") pod \"node-resolver-5m8l8\" (UID: \"4e31718b-a295-4dcd-9a26-e6966941a147\") " pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.553171 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.553116 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htl9h\" (UniqueName: \"kubernetes.io/projected/ed275d27-bea7-4a0e-b232-65e3bee1c108-kube-api-access-htl9h\") pod \"multus-6kfrl\" (UID: \"ed275d27-bea7-4a0e-b232-65e3bee1c108\") " pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.553430 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.553409 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67mx4\" (UniqueName: \"kubernetes.io/projected/313f6d01-b629-4a89-81dd-bb068943c9f2-kube-api-access-67mx4\") pod \"ovnkube-node-kn9pt\" (UID: \"313f6d01-b629-4a89-81dd-bb068943c9f2\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.566357 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.566325 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 00:57:44.623391 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623351 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623391 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-os-release\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623454 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-system-cni-dir\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12d1746b-3561-4720-868a-541f21891b97-kubelet-config\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623534 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-os-release\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623548 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12d1746b-3561-4720-868a-541f21891b97-dbus\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623572 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbfk\" (UniqueName: \"kubernetes.io/projected/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-kube-api-access-pnbfk\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623594 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwhvq\" (UniqueName: \"kubernetes.io/projected/ffea2b39-40c8-4462-9958-75457237e5a9-kube-api-access-bwhvq\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623599 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12d1746b-3561-4720-868a-541f21891b97-kubelet-config\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623597 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-system-cni-dir\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.623626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623619 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cnibin\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623653 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffea2b39-40c8-4462-9958-75457237e5a9-iptables-alerter-script\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623658 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cnibin\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623682 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffea2b39-40c8-4462-9958-75457237e5a9-host-slash\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623715 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cni-binary-copy\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623717 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12d1746b-3561-4720-868a-541f21891b97-dbus\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623730 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623740 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.623751 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxw2x\" (UniqueName: \"kubernetes.io/projected/cd626bdd-afc8-49c7-8bd0-cf998f381103-kube-api-access-dxw2x\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.623812 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.623874 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:45.123855345 +0000 UTC m=+3.119767704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.624021 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:44.624067 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:45.12405642 +0000 UTC m=+3.119968779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.624106 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffea2b39-40c8-4462-9958-75457237e5a9-host-slash\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.624117 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.624258 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.624136 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.624908 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.624470 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffea2b39-40c8-4462-9958-75457237e5a9-iptables-alerter-script\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.624908 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.624490 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-cni-binary-copy\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.640583 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.640520 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxw2x\" (UniqueName: \"kubernetes.io/projected/cd626bdd-afc8-49c7-8bd0-cf998f381103-kube-api-access-dxw2x\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:44.642573 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.642546 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbfk\" (UniqueName: \"kubernetes.io/projected/ed806a51-9d7b-457b-95e2-0556a8ee8cc2-kube-api-access-pnbfk\") pod \"multus-additional-cni-plugins-nttmg\" (UID: \"ed806a51-9d7b-457b-95e2-0556a8ee8cc2\") " pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:44.642674 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.642548 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwhvq\" (UniqueName: \"kubernetes.io/projected/ffea2b39-40c8-4462-9958-75457237e5a9-kube-api-access-bwhvq\") pod \"iptables-alerter-lrz9j\" (UID: \"ffea2b39-40c8-4462-9958-75457237e5a9\") " pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.703594 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.703563 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5m8l8" Jun 13 00:57:44.719562 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.719536 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:57:44.727457 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.727433 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:57:44.734178 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.734142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zfz9z" Jun 13 00:57:44.739713 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.739697 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" Jun 13 00:57:44.746466 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.746449 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6kfrl" Jun 13 00:57:44.753524 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.753507 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" Jun 13 00:57:44.761139 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.761122 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrz9j" Jun 13 00:57:44.765730 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:44.765709 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nttmg" Jun 13 00:57:45.126823 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.126797 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:45.126959 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.126831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:45.126959 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.126868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:45.126959 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.126949 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:45.126959 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.126952 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:57:45.127100 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.126976 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:57:45.127100 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.126986 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:45.127100 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.126996 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:46.126982371 +0000 UTC m=+4.122894727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:45.127100 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.127025 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:57:46.127012663 +0000 UTC m=+4.122925019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:45.127100 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.126950 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:45.127100 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:45.127061 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:46.127047466 +0000 UTC m=+4.122959821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:45.378580 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.378480 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669cc8b9_67b0_41b3_b4bb_0b9f312cb8f3.slice/crio-06a37b200278231e22b20c981fc4592630eda09f3c634222aa17aa950bb390ab WatchSource:0}: Error finding container 06a37b200278231e22b20c981fc4592630eda09f3c634222aa17aa950bb390ab: Status 404 returned error can't find the container with id 06a37b200278231e22b20c981fc4592630eda09f3c634222aa17aa950bb390ab Jun 13 00:57:45.379717 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.379689 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffea2b39_40c8_4462_9958_75457237e5a9.slice/crio-ce2433018325fd8bc954c06ea430c5a191f9150b3be33b4742282f1fdc5736cf WatchSource:0}: Error finding container ce2433018325fd8bc954c06ea430c5a191f9150b3be33b4742282f1fdc5736cf: Status 404 returned error can't find the container with id ce2433018325fd8bc954c06ea430c5a191f9150b3be33b4742282f1fdc5736cf Jun 13 00:57:45.380969 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.380936 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a9ac00_1da7_4a4d_bf04_24ddf0ef6d7f.slice/crio-d3dcebfe5f9b5da9619062c9c2b6cdef4af36a05aab3540028f6f20067dc1974 WatchSource:0}: Error finding container d3dcebfe5f9b5da9619062c9c2b6cdef4af36a05aab3540028f6f20067dc1974: Status 404 returned error can't find the container with id d3dcebfe5f9b5da9619062c9c2b6cdef4af36a05aab3540028f6f20067dc1974 Jun 13 00:57:45.384994 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.384975 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded806a51_9d7b_457b_95e2_0556a8ee8cc2.slice/crio-1577ab5428a983f9be8b17268522f45c35d6868c64a4c602e8914d3818ca4b04 WatchSource:0}: Error finding container 1577ab5428a983f9be8b17268522f45c35d6868c64a4c602e8914d3818ca4b04: Status 404 returned error can't find the container with id 1577ab5428a983f9be8b17268522f45c35d6868c64a4c602e8914d3818ca4b04 Jun 13 00:57:45.406338 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.406318 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded275d27_bea7_4a0e_b232_65e3bee1c108.slice/crio-df4456a2487150ec8868e142d90c549f9c0bc4c5d212e388c7e6bc216a6e1135 WatchSource:0}: Error finding container df4456a2487150ec8868e142d90c549f9c0bc4c5d212e388c7e6bc216a6e1135: Status 404 returned error can't find the container with id df4456a2487150ec8868e142d90c549f9c0bc4c5d212e388c7e6bc216a6e1135 Jun 13 00:57:45.407402 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.407361 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ae70cd_14ab_4357_9fa2_2353fc19fdc0.slice/crio-fdc1f6afd2b5928d499a87ff05512f6f7372240bfa2fe098338acaed780e7679 WatchSource:0}: Error finding container fdc1f6afd2b5928d499a87ff05512f6f7372240bfa2fe098338acaed780e7679: Status 404 returned error can't find the container with id fdc1f6afd2b5928d499a87ff05512f6f7372240bfa2fe098338acaed780e7679 Jun 13 00:57:45.408077 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.408052 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313f6d01_b629_4a89_81dd_bb068943c9f2.slice/crio-5d64a227636062038f9554d93fc13d0c97a73b1846efbb4c6ac17dd69171cebe WatchSource:0}: Error finding container 5d64a227636062038f9554d93fc13d0c97a73b1846efbb4c6ac17dd69171cebe: Status 404 returned error can't find the container with id 5d64a227636062038f9554d93fc13d0c97a73b1846efbb4c6ac17dd69171cebe Jun 13 00:57:45.409406 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:57:45.409287 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e6cec3_96bd_43f2_a058_5042f396e335.slice/crio-fa1b4bf6415fa6d00ef7aaca34f057ab4758961cc41bad2a9b5527a9ca64e63d WatchSource:0}: Error finding container fa1b4bf6415fa6d00ef7aaca34f057ab4758961cc41bad2a9b5527a9ca64e63d: Status 404 returned error can't find the container with id fa1b4bf6415fa6d00ef7aaca34f057ab4758961cc41bad2a9b5527a9ca64e63d Jun 13 00:57:45.467070 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.467031 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 00:52:44 +0000 UTC" deadline="2027-11-29 19:24:18.87870334 +0000 UTC" Jun 13 00:57:45.467070 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.467068 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12834h26m33.411637857s" Jun 13 00:57:45.484259 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.484230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5m8l8" event={"ID":"4e31718b-a295-4dcd-9a26-e6966941a147","Type":"ContainerStarted","Data":"ad51f3d08ca0eff0985701f33bef6a7506f5934292101ea5748843d7fb6d7aae"} Jun 13 00:57:45.485340 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.485307 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" event={"ID":"e7e6cec3-96bd-43f2-a058-5042f396e335","Type":"ContainerStarted","Data":"fa1b4bf6415fa6d00ef7aaca34f057ab4758961cc41bad2a9b5527a9ca64e63d"} Jun 13 00:57:45.486413 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.486393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6stgw" event={"ID":"89ae70cd-14ab-4357-9fa2-2353fc19fdc0","Type":"ContainerStarted","Data":"fdc1f6afd2b5928d499a87ff05512f6f7372240bfa2fe098338acaed780e7679"} Jun 13 00:57:45.488271 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.488246 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" event={"ID":"a552396380661cf3c3f2936a8001308d","Type":"ContainerStarted","Data":"bc1600f9e79fc5edbfdd05c24b5ed9f918cbc31a58a039f1b685c7d325f21040"} Jun 13 00:57:45.489419 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.489397 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"5d64a227636062038f9554d93fc13d0c97a73b1846efbb4c6ac17dd69171cebe"} Jun 13 00:57:45.490454 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.490423 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6kfrl" event={"ID":"ed275d27-bea7-4a0e-b232-65e3bee1c108","Type":"ContainerStarted","Data":"df4456a2487150ec8868e142d90c549f9c0bc4c5d212e388c7e6bc216a6e1135"} Jun 13 00:57:45.491579 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.491554 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerStarted","Data":"1577ab5428a983f9be8b17268522f45c35d6868c64a4c602e8914d3818ca4b04"} Jun 13 00:57:45.493115 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.493091 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfz9z" event={"ID":"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f","Type":"ContainerStarted","Data":"d3dcebfe5f9b5da9619062c9c2b6cdef4af36a05aab3540028f6f20067dc1974"} Jun 13 00:57:45.494197 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.494174 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrz9j" event={"ID":"ffea2b39-40c8-4462-9958-75457237e5a9","Type":"ContainerStarted","Data":"ce2433018325fd8bc954c06ea430c5a191f9150b3be33b4742282f1fdc5736cf"} Jun 13 00:57:45.495412 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.495390 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" event={"ID":"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3","Type":"ContainerStarted","Data":"06a37b200278231e22b20c981fc4592630eda09f3c634222aa17aa950bb390ab"} Jun 13 00:57:45.504209 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:45.504168 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-42.ec2.internal" podStartSLOduration=2.504136434 podStartE2EDuration="2.504136434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:57:45.503731752 +0000 UTC m=+3.499644130" watchObservedRunningTime="2026-06-13 00:57:45.504136434 +0000 UTC m=+3.500048815" Jun 13 00:57:46.138684 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.138638 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:46.138873 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.138731 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:46.138873 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.138766 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:46.138994 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.138901 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:46.138994 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.138965 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:48.138946421 +0000 UTC m=+6.134858795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:46.139401 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.139382 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:46.139470 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.139438 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:48.139423582 +0000 UTC m=+6.135335943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:46.139547 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.139513 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:57:46.139547 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.139527 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:57:46.139547 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.139539 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:46.139685 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.139573 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:57:48.139562547 +0000 UTC m=+6.135474923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:46.467610 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.467494 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 00:52:44 +0000 UTC" deadline="2028-03-08 12:01:40.905591044 +0000 UTC" Jun 13 00:57:46.467610 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.467533 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15227h3m54.438063142s" Jun 13 00:57:46.479336 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.477715 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:46.479336 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.477848 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:46.479336 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.478256 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:46.479336 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.478358 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:46.479336 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.479176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:46.479336 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:46.479269 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:46.541757 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.541725 2583 generic.go:356] "Generic (PLEG): container finished" podID="981a13f7fca26af32c5802ef7ed2d279" containerID="b8a22bd1658a31b41a19f76e49d122a8cd7747b4ef6a4a75aa963d12fe462894" exitCode=0 Jun 13 00:57:46.543066 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:46.542793 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" event={"ID":"981a13f7fca26af32c5802ef7ed2d279","Type":"ContainerDied","Data":"b8a22bd1658a31b41a19f76e49d122a8cd7747b4ef6a4a75aa963d12fe462894"} Jun 13 00:57:47.587525 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:47.587285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" event={"ID":"981a13f7fca26af32c5802ef7ed2d279","Type":"ContainerStarted","Data":"6ed0006167f0a449074f3c5134b3ce9038d992b6e4f024976d491db5c6679e7e"} Jun 13 00:57:48.161353 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:48.161311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:48.161528 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:48.161373 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:48.161528 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:48.161436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:48.161609 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.161575 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:48.161654 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.161646 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:52.161624505 +0000 UTC m=+10.157536879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:48.162130 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.162110 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:57:48.162130 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.162133 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:57:48.162323 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.162164 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:48.162323 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.162214 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:57:52.162199181 +0000 UTC m=+10.158111544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:48.162323 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.162281 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:48.162323 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.162316 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:57:52.162303922 +0000 UTC m=+10.158216280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:48.477438 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:48.477356 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:48.477584 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.477503 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:48.477926 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:48.477901 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:48.478014 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.477997 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:48.478103 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:48.478068 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:48.478176 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:48.478142 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:50.475859 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:50.475829 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:50.476334 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:50.475842 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:50.476334 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:50.475942 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:50.476334 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:50.476026 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:50.476334 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:50.476174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:50.476334 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:50.476242 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:52.201231 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:52.200606 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:52.201231 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:52.200654 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:52.201231 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:52.200699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:52.201231 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.200819 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:52.201231 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.200872 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:00.200855272 +0000 UTC m=+18.196767632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:57:52.201858 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.201277 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:52.201858 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.201309 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:57:52.201858 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.201327 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:57:52.201858 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.201339 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:52.201858 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.201342 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:00.201325362 +0000 UTC m=+18.197237733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:57:52.201858 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.201375 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:58:00.201363784 +0000 UTC m=+18.197276154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:57:52.477084 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:52.476996 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:52.477256 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.477110 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:52.477639 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:52.477348 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:52.477639 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.477480 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:52.477639 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:52.477516 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:52.477639 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:52.477607 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:54.479593 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:54.478816 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:54.479593 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:54.478950 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:54.479593 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:54.479349 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:54.479593 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:54.479454 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:54.479593 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:54.479499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:54.484878 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:54.480548 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:56.476425 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:56.476386 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:56.476425 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:56.476399 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:56.476935 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:56.476515 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:57:56.476935 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:56.476600 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:56.476935 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:56.476618 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:56.476935 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:56.476717 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:58.476452 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:58.476417 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:57:58.476915 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:58.476468 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:57:58.476915 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:57:58.476417 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:57:58.476915 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:58.476549 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:57:58.476915 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:58.476617 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:57:58.476915 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:57:58.476718 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:00.261664 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:00.261625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:00.261674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:00.261733 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261846 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261863 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261868 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261884 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261918 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:16.261901292 +0000 UTC m=+34.257813648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261863 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261938 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:58:16.261927794 +0000 UTC m=+34.257840151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:58:00.262263 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.261962 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:16.261946626 +0000 UTC m=+34.257858995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:58:00.476598 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:00.476562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:00.476772 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:00.476574 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:00.476772 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:00.476691 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:00.476772 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.476694 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:00.476998 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.476766 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:00.476998 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:00.476873 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:02.477298 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:02.477267 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:02.477844 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:02.477368 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:02.477844 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:02.477460 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:02.477844 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:02.477541 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:02.477844 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:02.477573 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:02.477844 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:02.477630 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:04.476574 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:04.476531 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:04.476574 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:04.476556 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:04.477045 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:04.476696 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:04.477045 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:04.476728 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:04.477045 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:04.476812 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:04.477045 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:04.476885 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:05.631426 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.631068 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" event={"ID":"e7e6cec3-96bd-43f2-a058-5042f396e335","Type":"ContainerStarted","Data":"92bfff4797bad2099ab70251d8c3ac9278f7e8fb22831d0d25fc419d2ff1324c"} Jun 13 00:58:05.632541 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.632509 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6stgw" event={"ID":"89ae70cd-14ab-4357-9fa2-2353fc19fdc0","Type":"ContainerStarted","Data":"a8d2da7358df26fcdb7bb4f877c781fb78bf319d54a7653b25b6491b0669a68a"} Jun 13 00:58:05.635229 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635210 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 00:58:05.635535 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635518 2583 generic.go:356] "Generic (PLEG): container finished" podID="313f6d01-b629-4a89-81dd-bb068943c9f2" containerID="d1da218a3614889e2e8a34c91aef765356a2876b4d67a5dc45098b6c347a26c1" exitCode=1 Jun 13 00:58:05.635595 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"327eb0e5dbdcb399e4b8932c6a8e72e6c27907244f50e459d6b1782a1e7fa57f"} Jun 13 00:58:05.635662 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635647 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"745073b39eda887e4f963eb537c3de7841170418b6b02a3ffb7676de2e267f74"} Jun 13 00:58:05.635715 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635703 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"ef6217e2e233fe9ee9eaec47aac4a221103619b5e937aac4a2f078c3b1b94ba0"} Jun 13 00:58:05.635767 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635753 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"b7e566c08db14c88144c6670a733e91ac2e9204990d8572710f37b137989e7ef"} Jun 13 00:58:05.635807 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635794 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerDied","Data":"d1da218a3614889e2e8a34c91aef765356a2876b4d67a5dc45098b6c347a26c1"} Jun 13 00:58:05.635847 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.635824 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"64146b516c725252d76031dbcbff5996e9cab6acfe01578281cfb9bb110a5ec7"} Jun 13 00:58:05.637012 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.636990 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6kfrl" event={"ID":"ed275d27-bea7-4a0e-b232-65e3bee1c108","Type":"ContainerStarted","Data":"c3a202b2773aa2a76dcd8fbb2bf0386644a182774ed09dcd8966efb608abaae8"} Jun 13 00:58:05.638345 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.638325 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed806a51-9d7b-457b-95e2-0556a8ee8cc2" containerID="32293468ef3ec803c4272216e218de8ba4dbde1350fea8a3163838593bc54b7d" exitCode=0 Jun 13 00:58:05.638442 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.638407 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerDied","Data":"32293468ef3ec803c4272216e218de8ba4dbde1350fea8a3163838593bc54b7d"} Jun 13 00:58:05.639815 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.639772 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zfz9z" event={"ID":"59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f","Type":"ContainerStarted","Data":"3521f6a438ac3b35c1b85c651d65326a8f2f25cba42938f54da99d6773586fd2"} Jun 13 00:58:05.641202 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.641179 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" event={"ID":"669cc8b9-67b0-41b3-b4bb-0b9f312cb8f3","Type":"ContainerStarted","Data":"8850896c829af25cb45a22c9757f69125d56ae60e4e545d913bfdf88f1e897b6"} Jun 13 00:58:05.642414 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.642393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5m8l8" event={"ID":"4e31718b-a295-4dcd-9a26-e6966941a147","Type":"ContainerStarted","Data":"454211dc7baf24e0b3ef90274cd74b75095ac858b000125c95057fd357046798"} Jun 13 00:58:05.650980 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.650948 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6stgw" podStartSLOduration=9.467697898 podStartE2EDuration="23.65093723s" totalImagesPullingTime="14.183239332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:05.65086495 +0000 UTC m=+23.646777328" watchObservedRunningTime="2026-06-13 00:58:05.65093723 +0000 UTC m=+23.646849607" Jun 13 00:58:05.651124 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.651106 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-42.ec2.internal" podStartSLOduration=22.651101018 podStartE2EDuration="22.651101018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:57:47.606110829 +0000 UTC m=+5.602023210" watchObservedRunningTime="2026-06-13 00:58:05.651101018 +0000 UTC m=+23.647013396" Jun 13 00:58:05.667128 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.667085 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5m8l8" podStartSLOduration=4.57164495 podStartE2EDuration="23.667072817s" totalImagesPullingTime="19.095427867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:05.666550726 +0000 UTC m=+23.662463103" watchObservedRunningTime="2026-06-13 00:58:05.667072817 +0000 UTC m=+23.662985194" Jun 13 00:58:05.681438 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.681405 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zfz9z" podStartSLOduration=4.597279579 podStartE2EDuration="23.681395571s" totalImagesPullingTime="19.084115992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:05.681187563 +0000 UTC m=+23.677099951" watchObservedRunningTime="2026-06-13 00:58:05.681395571 +0000 UTC m=+23.677307948" Jun 13 00:58:05.700622 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.700583 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kk2fw" podStartSLOduration=4.5675474099999995 podStartE2EDuration="23.700571017s" totalImagesPullingTime="19.133023607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:05.700231003 +0000 UTC m=+23.696143394" watchObservedRunningTime="2026-06-13 00:58:05.700571017 +0000 UTC m=+23.696483395" Jun 13 00:58:05.867547 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.867515 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:05.966695 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.966668 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:05.988203 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:05.988176 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 00:58:06.475967 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.475929 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:06.476170 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.475929 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:06.476170 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:06.476036 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:06.476170 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.476070 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:06.476170 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:06.476138 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:06.476335 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:06.476248 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:06.488358 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.488276 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T00:58:05.988202142Z","UUID":"f9b968f1-7a62-4e69-b841-7316188130b8","Handler":null,"Name":"","Endpoint":""} Jun 13 00:58:06.490050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.490031 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 00:58:06.490199 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.490073 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 00:58:06.594604 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.594571 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfz9z_59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f/node-ca/0.log" Jun 13 00:58:06.647916 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.647878 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrz9j" event={"ID":"ffea2b39-40c8-4462-9958-75457237e5a9","Type":"ContainerStarted","Data":"0878a0b408856eda6ea32b69dca21a68c9137d18edeb10e86ac65a4ca3b44408"} Jun 13 00:58:06.650167 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.650124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" event={"ID":"e7e6cec3-96bd-43f2-a058-5042f396e335","Type":"ContainerStarted","Data":"75d928d27c532df3b36875cd150438403bbb76035702e8a7a6bc9bd621784726"} Jun 13 00:58:06.664338 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.664284 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6kfrl" podStartSLOduration=5.54358436 podStartE2EDuration="24.66426428s" totalImagesPullingTime="19.12067992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:05.742204385 +0000 UTC m=+23.738116781" watchObservedRunningTime="2026-06-13 00:58:06.66426428 +0000 UTC m=+24.660176660" Jun 13 00:58:06.783634 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.783548 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:06.885923 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.885887 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:06.968580 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:06.968551 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:07.036507 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.036438 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:07.530085 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.530037 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:07.654403 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.654362 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" event={"ID":"e7e6cec3-96bd-43f2-a058-5042f396e335","Type":"ContainerStarted","Data":"7ec103f72c61fea750309bf9f69d2d8a6082f62f6473013b65ce4d2935a0408c"} Jun 13 00:58:07.678496 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.678449 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8n5z" podStartSLOduration=4.547474903 podStartE2EDuration="25.678432239s" totalImagesPullingTime="21.130957336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:07.678269162 +0000 UTC m=+25.674181541" watchObservedRunningTime="2026-06-13 00:58:07.678432239 +0000 UTC m=+25.674344617" Jun 13 00:58:07.678655 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.678624 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lrz9j" podStartSLOduration=6.547156576 podStartE2EDuration="25.678616815s" totalImagesPullingTime="19.131460239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:06.663776569 +0000 UTC m=+24.659688949" watchObservedRunningTime="2026-06-13 00:58:07.678616815 +0000 UTC m=+25.674529193" Jun 13 00:58:07.854530 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.854443 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:58:07.855051 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:07.855031 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:58:08.057063 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.057003 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:08.476400 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.476368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:08.476583 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.476368 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:08.476583 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:08.476469 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:08.476583 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.476484 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:08.476583 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:08.476555 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:08.476794 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:08.476632 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:08.659416 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.659385 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 00:58:08.660000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.659759 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"a6cdb8cc369ffc3f64f52f13025a59a04ed8fa845dbf9de4ed2728c6e74f5cc8"} Jun 13 00:58:08.660135 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.660101 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:58:08.660468 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:08.660451 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6stgw" Jun 13 00:58:09.094491 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:09.094462 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:09.343315 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:09.343280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:09.443818 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:09.443784 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:09.545210 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:09.545136 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:09.645423 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:09.645381 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:09.803475 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:09.803433 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:10.476079 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:10.476045 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:10.476079 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:10.476087 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:10.476338 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:10.476056 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:10.476338 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:10.476193 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:10.476338 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:10.476289 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:10.476463 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:10.476349 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:10.597328 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:10.597292 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:11.002725 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.002697 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:11.402440 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.402204 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:11.503988 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.503956 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:11.604179 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.604096 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:11.669818 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.669795 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 00:58:11.670227 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.670194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"c15187c21a9630bca19f53e741021892ef5c4e756abe02676a6280cf7a7e0c3d"} Jun 13 00:58:11.670436 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.670420 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:58:11.670649 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.670632 2583 scope.go:117] "RemoveContainer" containerID="d1da218a3614889e2e8a34c91aef765356a2876b4d67a5dc45098b6c347a26c1" Jun 13 00:58:11.672266 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.672243 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed806a51-9d7b-457b-95e2-0556a8ee8cc2" containerID="391b6691f4da4c3b58f67b0ba1abb832079fda960ed8bebb9b7099d4d0218eb6" exitCode=0 Jun 13 00:58:11.672338 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.672290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerDied","Data":"391b6691f4da4c3b58f67b0ba1abb832079fda960ed8bebb9b7099d4d0218eb6"} Jun 13 00:58:11.687087 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:11.687067 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:58:12.011070 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.011040 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:12.477619 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.477587 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:12.477805 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.477694 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:12.477805 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.477741 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:12.477805 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:12.477734 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:12.477969 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:12.477832 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:12.477969 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:12.477943 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:12.677628 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.677600 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 00:58:12.677924 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.677893 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" event={"ID":"313f6d01-b629-4a89-81dd-bb068943c9f2","Type":"ContainerStarted","Data":"9a49c919c39896155136c1dc22d11c497c3ba763307a1041e2ccf62454692a10"} Jun 13 00:58:12.678055 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.678042 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:58:12.678104 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.678092 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:58:12.693627 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.693603 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:58:12.711132 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.711090 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" podStartSLOduration=11.563333206 podStartE2EDuration="30.71107599s" totalImagesPullingTime="19.147742784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:12.70931958 +0000 UTC m=+30.705231971" watchObservedRunningTime="2026-06-13 00:58:12.71107599 +0000 UTC m=+30.706988367" Jun 13 00:58:12.772379 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.772355 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:12.872415 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:12.872389 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:13.001469 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:13.001435 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:13.196751 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:13.196718 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:13.595692 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:13.595606 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:13.681852 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:13.681822 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed806a51-9d7b-457b-95e2-0556a8ee8cc2" containerID="97bcbb6500d61ea0688bf3a29b45edfa0e847c8d92470143268eedf8ee2d6435" exitCode=0 Jun 13 00:58:13.681991 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:13.681911 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerDied","Data":"97bcbb6500d61ea0688bf3a29b45edfa0e847c8d92470143268eedf8ee2d6435"} Jun 13 00:58:13.696364 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:13.696343 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:14.404024 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.403991 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:14.475849 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.475814 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:14.476012 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.475852 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:14.476012 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.475925 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:14.476012 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:14.475940 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:14.476193 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:14.475999 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:14.476193 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:14.476061 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:14.598003 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.597972 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:14.699099 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.699032 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:14.800161 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.800120 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:14.920520 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:14.920496 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:15.021371 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:15.021292 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:15.207685 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:15.207655 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:15.687990 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:15.687956 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed806a51-9d7b-457b-95e2-0556a8ee8cc2" containerID="4bf99ab44e5d62c31d348d3886ef4d05b9c4db059810ad0b9f4a1631a2ad46c9" exitCode=0 Jun 13 00:58:15.688372 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:15.688005 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerDied","Data":"4bf99ab44e5d62c31d348d3886ef4d05b9c4db059810ad0b9f4a1631a2ad46c9"} Jun 13 00:58:15.799716 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:15.799684 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:16.212307 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.212270 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:16.279288 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.279253 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:16.286654 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.286629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:16.286801 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.286689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:16.286801 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286784 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:58:16.286801 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286799 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 00:58:16.286948 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286818 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 00:58:16.286948 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286830 2583 projected.go:196] Error preparing data for projected volume kube-api-access-97k28 for pod openshift-network-diagnostics/network-check-target-2j9fv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:58:16.286948 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.286825 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:16.286948 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286838 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs podName:cd626bdd-afc8-49c7-8bd0-cf998f381103 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:48.286825439 +0000 UTC m=+66.282737794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs") pod "network-metrics-daemon-b7dxp" (UID: "cd626bdd-afc8-49c7-8bd0-cf998f381103") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 00:58:16.286948 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286878 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28 podName:06530fdb-ef83-43b3-9c95-11d866ffe79e nodeName:}" failed. No retries permitted until 2026-06-13 00:58:48.286863758 +0000 UTC m=+66.282776117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-97k28" (UniqueName: "kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28") pod "network-check-target-2j9fv" (UID: "06530fdb-ef83-43b3-9c95-11d866ffe79e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 00:58:16.286948 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286931 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 00:58:16.287223 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.286986 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret podName:12d1746b-3561-4720-868a-541f21891b97 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:48.286970278 +0000 UTC m=+66.282882636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret") pod "global-pull-secret-syncer-vpq9m" (UID: "12d1746b-3561-4720-868a-541f21891b97") : object "kube-system"/"original-pull-secret" not registered Jun 13 00:58:16.476591 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.476516 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:16.476792 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.476527 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:16.476792 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.476619 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:16.476792 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.476714 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:16.476792 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.476745 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:16.476993 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:16.476817 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:16.655322 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:16.655283 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:17.000410 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:17.000369 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:17.206638 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:17.206606 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:17.603122 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:17.603091 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:18.405959 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:18.405927 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:18.475869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:18.475841 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:18.475869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:18.475872 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:18.476106 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:18.475844 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:18.476106 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:18.475969 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:18.476106 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:18.476056 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:18.476281 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:18.476139 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:18.835560 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:18.835472 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:19.038925 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:19.038893 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:19.201707 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:19.201670 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:19.304222 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:19.304186 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:19.407843 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:19.407812 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:19.799712 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:19.799685 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:20.476294 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:20.476255 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:20.476294 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:20.476282 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:20.476899 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:20.476260 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:20.476899 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:20.476386 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:20.476899 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:20.476499 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:20.476899 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:20.476567 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:21.706034 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:21.706004 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed806a51-9d7b-457b-95e2-0556a8ee8cc2" containerID="806ca5d05f3c941ae5925729c1594f6334dbfa51819b57dc6d385a575f38abc9" exitCode=0 Jun 13 00:58:21.706389 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:21.706046 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerDied","Data":"806ca5d05f3c941ae5925729c1594f6334dbfa51819b57dc6d385a575f38abc9"} Jun 13 00:58:22.477122 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:22.477093 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:22.477273 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:22.477244 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:22.477340 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:22.477324 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:22.477432 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:22.477422 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:22.477466 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:22.477435 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:22.477496 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:22.477478 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:22.713625 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:22.713588 2583 generic.go:356] "Generic (PLEG): container finished" podID="ed806a51-9d7b-457b-95e2-0556a8ee8cc2" containerID="1ab6a953e6e94edca140a0281bfe4d62fb4d52573140786c3d8155d7e773d6c5" exitCode=0 Jun 13 00:58:22.714190 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:22.713646 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerDied","Data":"1ab6a953e6e94edca140a0281bfe4d62fb4d52573140786c3d8155d7e773d6c5"} Jun 13 00:58:23.140380 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:23.140340 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:23.719205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:23.719171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nttmg" event={"ID":"ed806a51-9d7b-457b-95e2-0556a8ee8cc2","Type":"ContainerStarted","Data":"5dd701581881f6e2ed5a06055e9533e7475c79cc95fc6762630e61588de231df"} Jun 13 00:58:23.741858 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:23.741814 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nttmg" podStartSLOduration=9.132306291999999 podStartE2EDuration="41.741799134s" totalImagesPullingTime="32.609492842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:23.740470777 +0000 UTC m=+41.736383155" watchObservedRunningTime="2026-06-13 00:58:23.741799134 +0000 UTC m=+41.737711511" Jun 13 00:58:24.351406 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.351347 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:24.452089 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.452029 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:24.476301 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.476272 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:24.476411 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.476318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:24.476445 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:24.476405 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:24.476492 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.476455 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:24.476540 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:24.476523 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:24.476610 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:24.476594 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:24.552538 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.552508 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:24.653794 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:24.653755 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:25.014354 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:25.014273 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:25.213626 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:25.213594 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:25.314577 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:25.314496 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:25.413623 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:25.413592 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:25.514789 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:25.514758 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:25.840957 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:25.840928 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:26.026773 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.026740 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:26.476331 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.476293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:26.476331 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.476320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:26.476589 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.476303 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:26.476589 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:26.476401 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:26.476589 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:26.476484 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:26.476589 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:26.476565 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:26.519190 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.519135 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:26.864666 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.864637 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:26.961207 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:26.961172 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:27.128174 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:27.128081 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:27.211249 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:27.211218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:27.311339 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:27.311302 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:27.645133 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:27.645094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:27.700198 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:27.700166 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:28.127209 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:28.126959 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2j9fv"] Jun 13 00:58:28.127363 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:28.127269 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:28.127425 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:28.127382 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:28.130234 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:28.130209 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7dxp"] Jun 13 00:58:28.130743 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:28.130305 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:28.130743 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:28.130404 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:28.130920 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:28.130902 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vpq9m"] Jun 13 00:58:28.130997 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:28.130981 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:28.131202 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:28.131077 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:29.220272 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:29.220237 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:29.321629 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:29.321592 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:29.377764 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:29.377721 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:29.476613 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:29.476542 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:29.476740 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:29.476550 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:29.476740 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:29.476629 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j9fv" podUID="06530fdb-ef83-43b3-9c95-11d866ffe79e" Jun 13 00:58:29.476808 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:29.476732 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vpq9m" podUID="12d1746b-3561-4720-868a-541f21891b97" Jun 13 00:58:30.479663 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:30.479636 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:30.480036 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:30.479735 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7dxp" podUID="cd626bdd-afc8-49c7-8bd0-cf998f381103" Jun 13 00:58:31.214949 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.214914 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:31.294819 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.294795 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-42.ec2.internal" event="NodeReady" Jun 13 00:58:31.294964 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.294930 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 00:58:31.314738 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.314707 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:31.329222 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.329198 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67bccd7596-d8hds"] Jun 13 00:58:31.340302 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.340281 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.343412 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.343388 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w5kbk\"" Jun 13 00:58:31.343709 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.343688 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 00:58:31.343848 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.343714 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 00:58:31.343848 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.343750 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 00:58:31.344117 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.344099 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nxxdn"] Jun 13 00:58:31.349993 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.349970 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bccd7596-d8hds"] Jun 13 00:58:31.350110 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.350091 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.350524 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.350492 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 00:58:31.352805 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.352509 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 00:58:31.352805 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.352624 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 00:58:31.352805 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.352679 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 00:58:31.353000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.352629 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-shlq8\"" Jun 13 00:58:31.355322 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.355303 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6nxmv"] Jun 13 00:58:31.360088 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.360070 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxxdn"] Jun 13 00:58:31.360208 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.360180 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.363175 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.363139 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 00:58:31.363266 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.363139 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 00:58:31.363266 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.363212 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 00:58:31.363361 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.363346 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8s5gl\"" Jun 13 00:58:31.363397 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.363368 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 00:58:31.369104 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.369085 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nxmv"] Jun 13 00:58:31.403488 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403465 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6215b405-5036-4f1a-8350-064b173bf048-ca-trust-extracted\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403599 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403492 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6215b405-5036-4f1a-8350-064b173bf048-installation-pull-secrets\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403599 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403508 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-bound-sa-token\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403599 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7sj\" (UniqueName: \"kubernetes.io/projected/e36cda4d-62a4-491a-8d7b-5fae94685235-kube-api-access-5p7sj\") pod \"ingress-canary-nxxdn\" (UID: \"e36cda4d-62a4-491a-8d7b-5fae94685235\") " pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.403599 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwnnt\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-kube-api-access-fwnnt\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403730 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403610 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.403730 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403637 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.403730 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52fbr\" (UniqueName: \"kubernetes.io/projected/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-kube-api-access-52fbr\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.403730 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403668 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e36cda4d-62a4-491a-8d7b-5fae94685235-cert\") pod \"ingress-canary-nxxdn\" (UID: \"e36cda4d-62a4-491a-8d7b-5fae94685235\") " pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.403730 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403720 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6215b405-5036-4f1a-8350-064b173bf048-registry-certificates\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403892 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403746 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6215b405-5036-4f1a-8350-064b173bf048-image-registry-private-configuration\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403892 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-data-volume\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.403892 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403779 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6215b405-5036-4f1a-8350-064b173bf048-trusted-ca\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403892 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-registry-tls\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.403892 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.403844 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-crio-socket\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.440545 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.440524 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hwtns"] Jun 13 00:58:31.454953 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.454932 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hwtns"] Jun 13 00:58:31.455067 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.455046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.457447 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.457431 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 00:58:31.457579 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.457564 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lpgrx\"" Jun 13 00:58:31.457649 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.457589 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 00:58:31.475843 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.475795 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:31.475918 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.475795 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:31.478348 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.478328 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cnntc\"" Jun 13 00:58:31.478440 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.478328 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 00:58:31.478440 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.478330 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 00:58:31.478440 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.478378 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 00:58:31.505001 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.504976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51fd3448-2691-40cb-857c-86346334c688-tmp-dir\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505023 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6215b405-5036-4f1a-8350-064b173bf048-registry-certificates\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6215b405-5036-4f1a-8350-064b173bf048-image-registry-private-configuration\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvpw5\" (UniqueName: \"kubernetes.io/projected/51fd3448-2691-40cb-857c-86346334c688-kube-api-access-zvpw5\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505095 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-data-volume\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fd3448-2691-40cb-857c-86346334c688-metrics-tls\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6215b405-5036-4f1a-8350-064b173bf048-trusted-ca\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505202 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-registry-tls\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-crio-socket\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6215b405-5036-4f1a-8350-064b173bf048-ca-trust-extracted\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6215b405-5036-4f1a-8350-064b173bf048-installation-pull-secrets\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505344 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-bound-sa-token\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.505360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7sj\" (UniqueName: \"kubernetes.io/projected/e36cda4d-62a4-491a-8d7b-5fae94685235-kube-api-access-5p7sj\") pod \"ingress-canary-nxxdn\" (UID: \"e36cda4d-62a4-491a-8d7b-5fae94685235\") " pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwnnt\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-kube-api-access-fwnnt\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505462 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52fbr\" (UniqueName: \"kubernetes.io/projected/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-kube-api-access-52fbr\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505476 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-data-volume\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505485 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e36cda4d-62a4-491a-8d7b-5fae94685235-cert\") pod \"ingress-canary-nxxdn\" (UID: \"e36cda4d-62a4-491a-8d7b-5fae94685235\") " pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505544 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51fd3448-2691-40cb-857c-86346334c688-config-volume\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.505475 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-crio-socket\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.506050 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.506049 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6215b405-5036-4f1a-8350-064b173bf048-ca-trust-extracted\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.506507 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.506230 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6215b405-5036-4f1a-8350-064b173bf048-registry-certificates\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.506507 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.506359 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.506741 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.506720 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6215b405-5036-4f1a-8350-064b173bf048-trusted-ca\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.509652 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.509631 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.509740 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.509688 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6215b405-5036-4f1a-8350-064b173bf048-installation-pull-secrets\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.509790 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.509773 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6215b405-5036-4f1a-8350-064b173bf048-image-registry-private-configuration\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.509790 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.509781 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e36cda4d-62a4-491a-8d7b-5fae94685235-cert\") pod \"ingress-canary-nxxdn\" (UID: \"e36cda4d-62a4-491a-8d7b-5fae94685235\") " pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.510028 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.510013 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-registry-tls\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.513963 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.513940 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-bound-sa-token\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.514239 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.514216 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7sj\" (UniqueName: \"kubernetes.io/projected/e36cda4d-62a4-491a-8d7b-5fae94685235-kube-api-access-5p7sj\") pod \"ingress-canary-nxxdn\" (UID: \"e36cda4d-62a4-491a-8d7b-5fae94685235\") " pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.514536 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.514519 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwnnt\" (UniqueName: \"kubernetes.io/projected/6215b405-5036-4f1a-8350-064b173bf048-kube-api-access-fwnnt\") pod \"image-registry-67bccd7596-d8hds\" (UID: \"6215b405-5036-4f1a-8350-064b173bf048\") " pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.514640 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.514622 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52fbr\" (UniqueName: \"kubernetes.io/projected/9f16cb0b-0269-4cd2-92fd-1a18f0d59520-kube-api-access-52fbr\") pod \"insights-runtime-extractor-6nxmv\" (UID: \"9f16cb0b-0269-4cd2-92fd-1a18f0d59520\") " pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.545557 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.545530 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:31.606344 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.606320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51fd3448-2691-40cb-857c-86346334c688-config-volume\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.606420 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.606348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51fd3448-2691-40cb-857c-86346334c688-tmp-dir\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.606420 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.606396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvpw5\" (UniqueName: \"kubernetes.io/projected/51fd3448-2691-40cb-857c-86346334c688-kube-api-access-zvpw5\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.606420 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.606413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fd3448-2691-40cb-857c-86346334c688-metrics-tls\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.606692 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.606672 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51fd3448-2691-40cb-857c-86346334c688-tmp-dir\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.606823 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.606805 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51fd3448-2691-40cb-857c-86346334c688-config-volume\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.608682 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.608662 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fd3448-2691-40cb-857c-86346334c688-metrics-tls\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.609600 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.609567 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:31.614298 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.614281 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvpw5\" (UniqueName: \"kubernetes.io/projected/51fd3448-2691-40cb-857c-86346334c688-kube-api-access-zvpw5\") pod \"dns-default-hwtns\" (UID: \"51fd3448-2691-40cb-857c-86346334c688\") " pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.652264 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.652242 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:31.659275 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.659253 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxxdn" Jun 13 00:58:31.668437 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.668413 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nxmv" Jun 13 00:58:31.763796 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.763408 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:31.882589 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.882233 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxxdn"] Jun 13 00:58:31.886738 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.885505 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nxmv"] Jun 13 00:58:31.886738 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.885578 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bccd7596-d8hds"] Jun 13 00:58:31.886907 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:31.886825 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36cda4d_62a4_491a_8d7b_5fae94685235.slice/crio-3f3c811d6fc4c28841b3689d8732ef6f2e7bbf3311351287d7bf08f83f0020d0 WatchSource:0}: Error finding container 3f3c811d6fc4c28841b3689d8732ef6f2e7bbf3311351287d7bf08f83f0020d0: Status 404 returned error can't find the container with id 3f3c811d6fc4c28841b3689d8732ef6f2e7bbf3311351287d7bf08f83f0020d0 Jun 13 00:58:31.894819 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:31.894797 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f16cb0b_0269_4cd2_92fd_1a18f0d59520.slice/crio-32df19fa5fe5fd5b6c5ae73732c5b9aa3590afef1a2d1593921700d09c50d01f WatchSource:0}: Error finding container 32df19fa5fe5fd5b6c5ae73732c5b9aa3590afef1a2d1593921700d09c50d01f: Status 404 returned error can't find the container with id 32df19fa5fe5fd5b6c5ae73732c5b9aa3590afef1a2d1593921700d09c50d01f Jun 13 00:58:31.895403 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:31.895334 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6215b405_5036_4f1a_8350_064b173bf048.slice/crio-73f5d11a32dce52a0d5fe7b1acad10537f7a601a109a61b45ba2ed1e82cd57f6 WatchSource:0}: Error finding container 73f5d11a32dce52a0d5fe7b1acad10537f7a601a109a61b45ba2ed1e82cd57f6: Status 404 returned error can't find the container with id 73f5d11a32dce52a0d5fe7b1acad10537f7a601a109a61b45ba2ed1e82cd57f6 Jun 13 00:58:31.927931 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:31.927906 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hwtns"] Jun 13 00:58:31.934328 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:31.934304 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fd3448_2691_40cb_857c_86346334c688.slice/crio-770596d2ab7b51c8eae1b7b4fdd70b51995a2d4e14cdac945253a78003b8b351 WatchSource:0}: Error finding container 770596d2ab7b51c8eae1b7b4fdd70b51995a2d4e14cdac945253a78003b8b351: Status 404 returned error can't find the container with id 770596d2ab7b51c8eae1b7b4fdd70b51995a2d4e14cdac945253a78003b8b351 Jun 13 00:58:32.484984 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.484328 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:32.490802 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.490431 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 00:58:32.490802 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.490604 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vcpsp\"" Jun 13 00:58:32.603653 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.599349 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:32.699517 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.699269 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:32.744311 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.744232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hwtns" event={"ID":"51fd3448-2691-40cb-857c-86346334c688","Type":"ContainerStarted","Data":"770596d2ab7b51c8eae1b7b4fdd70b51995a2d4e14cdac945253a78003b8b351"} Jun 13 00:58:32.746866 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.746835 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxxdn" event={"ID":"e36cda4d-62a4-491a-8d7b-5fae94685235","Type":"ContainerStarted","Data":"3f3c811d6fc4c28841b3689d8732ef6f2e7bbf3311351287d7bf08f83f0020d0"} Jun 13 00:58:32.749849 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.749769 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" event={"ID":"6215b405-5036-4f1a-8350-064b173bf048","Type":"ContainerStarted","Data":"7645a84f172634b9b0fcd9f3cb154688dd2f9bbd42e99070e2aa0a0016950d7d"} Jun 13 00:58:32.749849 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.749813 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" event={"ID":"6215b405-5036-4f1a-8350-064b173bf048","Type":"ContainerStarted","Data":"73f5d11a32dce52a0d5fe7b1acad10537f7a601a109a61b45ba2ed1e82cd57f6"} Jun 13 00:58:32.753054 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.751641 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:32.753054 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.752132 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh"] Jun 13 00:58:32.766364 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.765628 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nxmv" event={"ID":"9f16cb0b-0269-4cd2-92fd-1a18f0d59520","Type":"ContainerStarted","Data":"32df19fa5fe5fd5b6c5ae73732c5b9aa3590afef1a2d1593921700d09c50d01f"} Jun 13 00:58:32.766364 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.765680 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh"] Jun 13 00:58:32.766364 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.765783 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:32.766364 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.766050 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:32.768698 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.768517 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 13 00:58:32.768698 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.768602 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gbswl\"" Jun 13 00:58:32.776395 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.776357 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" podStartSLOduration=6.77634123 podStartE2EDuration="6.77634123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:32.774415374 +0000 UTC m=+50.770327753" watchObservedRunningTime="2026-06-13 00:58:32.77634123 +0000 UTC m=+50.772253608" Jun 13 00:58:32.815547 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.815516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b20aabc9-466c-40b1-9ed4-32ed7218b63f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-n9mkh\" (UID: \"b20aabc9-466c-40b1-9ed4-32ed7218b63f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:32.916360 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:32.916318 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b20aabc9-466c-40b1-9ed4-32ed7218b63f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-n9mkh\" (UID: \"b20aabc9-466c-40b1-9ed4-32ed7218b63f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:32.916570 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:32.916481 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 13 00:58:32.916570 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:32.916568 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b20aabc9-466c-40b1-9ed4-32ed7218b63f-tls-certificates podName:b20aabc9-466c-40b1-9ed4-32ed7218b63f nodeName:}" failed. No retries permitted until 2026-06-13 00:58:33.416546221 +0000 UTC m=+51.412458588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b20aabc9-466c-40b1-9ed4-32ed7218b63f-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-n9mkh" (UID: "b20aabc9-466c-40b1-9ed4-32ed7218b63f") : secret "prometheus-operator-admission-webhook-tls" not found Jun 13 00:58:33.037482 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.037406 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:33.140126 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.140032 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:33.214174 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.214068 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:33.422857 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.422176 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b20aabc9-466c-40b1-9ed4-32ed7218b63f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-n9mkh\" (UID: \"b20aabc9-466c-40b1-9ed4-32ed7218b63f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:33.433815 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.433750 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b20aabc9-466c-40b1-9ed4-32ed7218b63f-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-n9mkh\" (UID: \"b20aabc9-466c-40b1-9ed4-32ed7218b63f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:33.451545 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.451465 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:33.555885 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.555844 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:33.680426 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:33.680342 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:37.540825 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:37.540582 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh"] Jun 13 00:58:37.673728 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:37.673701 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20aabc9_466c_40b1_9ed4_32ed7218b63f.slice/crio-142f44317962419fb0b240e0bd81c28ab1f04cfb1e4205b9c4cbb89d3423dab6 WatchSource:0}: Error finding container 142f44317962419fb0b240e0bd81c28ab1f04cfb1e4205b9c4cbb89d3423dab6: Status 404 returned error can't find the container with id 142f44317962419fb0b240e0bd81c28ab1f04cfb1e4205b9c4cbb89d3423dab6 Jun 13 00:58:37.768324 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:37.768115 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxxdn" event={"ID":"e36cda4d-62a4-491a-8d7b-5fae94685235","Type":"ContainerStarted","Data":"02f5c1c1c2dc795f98a6a08337c243fd3468e3e30182527e06806ab1ddce97eb"} Jun 13 00:58:37.769316 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:37.769292 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" event={"ID":"b20aabc9-466c-40b1-9ed4-32ed7218b63f","Type":"ContainerStarted","Data":"142f44317962419fb0b240e0bd81c28ab1f04cfb1e4205b9c4cbb89d3423dab6"} Jun 13 00:58:37.770753 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:37.770730 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hwtns" event={"ID":"51fd3448-2691-40cb-857c-86346334c688","Type":"ContainerStarted","Data":"80d2e67ccf8aa163c247d2c80a96ab6adb27ff3388426208d6518c3d19e9e972"} Jun 13 00:58:37.785600 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:37.785558 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nxxdn" podStartSLOduration=1.268130306 podStartE2EDuration="6.785544029s" totalImagesPullingTime="5.517413723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:37.784898317 +0000 UTC m=+55.780810715" watchObservedRunningTime="2026-06-13 00:58:37.785544029 +0000 UTC m=+55.781456385" Jun 13 00:58:38.775000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:38.774968 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hwtns" event={"ID":"51fd3448-2691-40cb-857c-86346334c688","Type":"ContainerStarted","Data":"3607822b4e944aa298d81c54c4b5dbc947273ce91ae4680901bc5f09edbf6bc5"} Jun 13 00:58:38.775444 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:38.775071 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:38.776423 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:38.776400 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nxmv" event={"ID":"9f16cb0b-0269-4cd2-92fd-1a18f0d59520","Type":"ContainerStarted","Data":"1d22a292dc0d2c714c8b97cac92f2354f2b984bedbdcd3dffbd5e587fdefaa23"} Jun 13 00:58:38.793639 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:38.793603 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hwtns" podStartSLOduration=2.324914282 podStartE2EDuration="7.793590098s" totalImagesPullingTime="5.468675816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:38.79191056 +0000 UTC m=+56.787822950" watchObservedRunningTime="2026-06-13 00:58:38.793590098 +0000 UTC m=+56.789502475" Jun 13 00:58:39.259700 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.259670 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:39.317821 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.317790 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:39.782382 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.782344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nxmv" event={"ID":"9f16cb0b-0269-4cd2-92fd-1a18f0d59520","Type":"ContainerStarted","Data":"69e975548050c9036d9c7b05567d6f86b04e4b82325b8b3ad2b4a4c5897bb699"} Jun 13 00:58:39.784233 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.784204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" event={"ID":"b20aabc9-466c-40b1-9ed4-32ed7218b63f","Type":"ContainerStarted","Data":"f35d69a01558b5758738a7913b13b09b18f1dfc889993929612a805e4eeade86"} Jun 13 00:58:39.800284 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.800243 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" podStartSLOduration=6.312014414 podStartE2EDuration="7.800228799s" totalImagesPullingTime="1.488214385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:39.799341118 +0000 UTC m=+57.795253496" watchObservedRunningTime="2026-06-13 00:58:39.800228799 +0000 UTC m=+57.796141169" Jun 13 00:58:39.852954 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.852889 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:39.907093 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:39.907058 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:40.789853 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:40.789821 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:40.795330 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:40.795305 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-n9mkh" Jun 13 00:58:41.055229 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.055111 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:41.115363 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.115321 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:41.794239 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.794204 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nxmv" event={"ID":"9f16cb0b-0269-4cd2-92fd-1a18f0d59520","Type":"ContainerStarted","Data":"141c95900136ad96f7519e998ec2325e83cc9635fea70516c885cf4e888ecaa3"} Jun 13 00:58:41.804888 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.804867 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:41.814407 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.814371 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6nxmv" podStartSLOduration=2.012476375 podStartE2EDuration="10.81435813s" totalImagesPullingTime="8.801881755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:58:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:41.812830065 +0000 UTC m=+59.808742442" watchObservedRunningTime="2026-06-13 00:58:41.81435813 +0000 UTC m=+59.810270515" Jun 13 00:58:41.847087 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.847062 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5"] Jun 13 00:58:41.848915 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.848901 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.851806 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.851667 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 00:58:41.851806 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.851679 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 00:58:41.851806 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.851696 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 00:58:41.851806 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.851706 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 13 00:58:41.851806 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.851679 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-26hw9\"" Jun 13 00:58:41.851806 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.851719 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 13 00:58:41.858139 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.858119 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5"] Jun 13 00:58:41.880779 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.880751 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:41.885856 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.885824 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.885962 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.885872 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2879f971-3db3-4cf4-855d-e3c2ebcc7983-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.886090 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.886072 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.886179 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.886103 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtnnz\" (UniqueName: \"kubernetes.io/projected/2879f971-3db3-4cf4-855d-e3c2ebcc7983-kube-api-access-gtnnz\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.986856 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.986820 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.987006 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.986861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtnnz\" (UniqueName: \"kubernetes.io/projected/2879f971-3db3-4cf4-855d-e3c2ebcc7983-kube-api-access-gtnnz\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.987006 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.986938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.987006 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.986967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2879f971-3db3-4cf4-855d-e3c2ebcc7983-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.987184 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:41.987120 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 13 00:58:41.987243 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:41.987221 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-tls podName:2879f971-3db3-4cf4-855d-e3c2ebcc7983 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:42.487200419 +0000 UTC m=+60.483112777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-rkfc5" (UID: "2879f971-3db3-4cf4-855d-e3c2ebcc7983") : secret "prometheus-operator-tls" not found Jun 13 00:58:41.987791 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.987769 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2879f971-3db3-4cf4-855d-e3c2ebcc7983-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.991085 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.991056 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:41.997396 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:41.997376 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtnnz\" (UniqueName: \"kubernetes.io/projected/2879f971-3db3-4cf4-855d-e3c2ebcc7983-kube-api-access-gtnnz\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:42.130899 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:42.130865 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:42.490990 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:42.490919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:42.493253 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:42.493227 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2879f971-3db3-4cf4-855d-e3c2ebcc7983-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-rkfc5\" (UID: \"2879f971-3db3-4cf4-855d-e3c2ebcc7983\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:42.760978 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:42.760898 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-26hw9\"" Jun 13 00:58:42.768945 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:42.768928 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" Jun 13 00:58:42.892026 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:42.891995 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5"] Jun 13 00:58:42.900883 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:42.899483 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2879f971_3db3_4cf4_855d_e3c2ebcc7983.slice/crio-a10b467130aa8e048d5c53556a2256bfb844fe4dc01954fd781378004e50f3c1 WatchSource:0}: Error finding container a10b467130aa8e048d5c53556a2256bfb844fe4dc01954fd781378004e50f3c1: Status 404 returned error can't find the container with id a10b467130aa8e048d5c53556a2256bfb844fe4dc01954fd781378004e50f3c1 Jun 13 00:58:43.800986 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:43.800953 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" event={"ID":"2879f971-3db3-4cf4-855d-e3c2ebcc7983","Type":"ContainerStarted","Data":"a10b467130aa8e048d5c53556a2256bfb844fe4dc01954fd781378004e50f3c1"} Jun 13 00:58:44.463604 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.463574 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:44.694849 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.694823 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9pt" Jun 13 00:58:44.810187 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.810134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" event={"ID":"2879f971-3db3-4cf4-855d-e3c2ebcc7983","Type":"ContainerStarted","Data":"4de097ee84c127fd0345491afb8e55edbe503343d9b3bbe74656743ebbf301c2"} Jun 13 00:58:44.810376 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.810242 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" event={"ID":"2879f971-3db3-4cf4-855d-e3c2ebcc7983","Type":"ContainerStarted","Data":"5bbf1994c4f4c4b35326009822af6f115bcc68487d615a4b1535810436d477ad"} Jun 13 00:58:44.826683 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.826628 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-rkfc5" podStartSLOduration=2.5105841890000002 podStartE2EDuration="3.826611521s" totalImagesPullingTime="1.316027332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:44.82565805 +0000 UTC m=+62.821570429" watchObservedRunningTime="2026-06-13 00:58:44.826611521 +0000 UTC m=+62.822523900" Jun 13 00:58:44.830697 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.830676 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:44.891461 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:44.891435 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:45.247242 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:45.247196 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:45.308687 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:45.308658 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:46.212307 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:46.212274 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:46.263406 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:46.263376 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:46.847323 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:46.847290 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:46.956214 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:46.956184 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.050879 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.050847 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.153683 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.153650 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.219570 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.219543 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m52ff"] Jun 13 00:58:47.221819 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.221804 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.224436 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.224419 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 00:58:47.224562 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.224449 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 00:58:47.224562 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.224452 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mccg7\"" Jun 13 00:58:47.224818 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.224803 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 00:58:47.252739 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.252710 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.324899 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.324867 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.326944 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.326922 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-sys\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327064 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.326958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-tls\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327064 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-wtmp\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327064 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327043 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327233 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-root\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327233 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7910bbbb-3678-4369-893d-9b8b37ddebd2-metrics-client-ca\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327233 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327369 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327249 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dltn7\" (UniqueName: \"kubernetes.io/projected/7910bbbb-3678-4369-893d-9b8b37ddebd2-kube-api-access-dltn7\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.327369 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.327305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-textfile\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.423043 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.422954 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.428088 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-textfile\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428264 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428104 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-sys\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428264 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428132 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-tls\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428264 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428215 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-sys\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428264 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:47.428259 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428287 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-wtmp\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:47.428326 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-tls podName:7910bbbb-3678-4369-893d-9b8b37ddebd2 nodeName:}" failed. No retries permitted until 2026-06-13 00:58:47.928306565 +0000 UTC m=+65.924218929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-tls") pod "node-exporter-m52ff" (UID: "7910bbbb-3678-4369-893d-9b8b37ddebd2") : secret "node-exporter-tls" not found Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-root\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7910bbbb-3678-4369-893d-9b8b37ddebd2-metrics-client-ca\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428413 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-wtmp\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428479 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428458 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7910bbbb-3678-4369-893d-9b8b37ddebd2-root\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428857 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dltn7\" (UniqueName: \"kubernetes.io/projected/7910bbbb-3678-4369-893d-9b8b37ddebd2-kube-api-access-dltn7\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428857 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428568 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-textfile\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.428960 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428941 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7910bbbb-3678-4369-893d-9b8b37ddebd2-metrics-client-ca\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.429000 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.428951 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-accelerators-collector-config\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.430864 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.430842 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.438445 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.438417 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dltn7\" (UniqueName: \"kubernetes.io/projected/7910bbbb-3678-4369-893d-9b8b37ddebd2-kube-api-access-dltn7\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.521693 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.521656 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.653635 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.653603 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.742192 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.742096 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.813945 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.813920 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:47.932915 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.932875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-tls\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:47.935301 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:47.935282 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7910bbbb-3678-4369-893d-9b8b37ddebd2-node-exporter-tls\") pod \"node-exporter-m52ff\" (UID: \"7910bbbb-3678-4369-893d-9b8b37ddebd2\") " pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:48.130249 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.130199 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m52ff" Jun 13 00:58:48.142211 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:48.142183 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7910bbbb_3678_4369_893d_9b8b37ddebd2.slice/crio-e34d64659cfb66056eb0697169fe3b1653355a617adf1ca1d97ad14041bac28a WatchSource:0}: Error finding container e34d64659cfb66056eb0697169fe3b1653355a617adf1ca1d97ad14041bac28a: Status 404 returned error can't find the container with id e34d64659cfb66056eb0697169fe3b1653355a617adf1ca1d97ad14041bac28a Jun 13 00:58:48.201548 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.201515 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:48.287887 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.287853 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 00:58:48.290763 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.290731 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:48.290886 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.290853 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.294852 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.294828 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 00:58:48.294974 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.294901 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 00:58:48.295227 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295211 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 00:58:48.295328 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295298 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 00:58:48.295425 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295410 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s8rp8\"" Jun 13 00:58:48.295570 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295526 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 00:58:48.295676 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295651 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 00:58:48.295785 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295689 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 00:58:48.295785 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.295751 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 00:58:48.299271 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.298761 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 00:58:48.307492 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.307471 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 00:58:48.338746 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338712 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zjx4\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-kube-api-access-7zjx4\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.338746 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.338942 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338771 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.338942 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338842 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.338942 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338883 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-out\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.338942 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:48.339104 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338952 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339104 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.338984 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339104 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339009 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339104 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:48.339326 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339110 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339326 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339193 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339326 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339259 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:48.339326 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-web-config\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339510 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339325 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.339510 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.339357 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.341790 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.341767 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 00:58:48.341983 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.341964 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 00:58:48.342040 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.342024 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 00:58:48.351511 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.351492 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12d1746b-3561-4720-868a-541f21891b97-original-pull-secret\") pod \"global-pull-secret-syncer-vpq9m\" (UID: \"12d1746b-3561-4720-868a-541f21891b97\") " pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:48.351629 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.351613 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd626bdd-afc8-49c7-8bd0-cf998f381103-metrics-certs\") pod \"network-metrics-daemon-b7dxp\" (UID: \"cd626bdd-afc8-49c7-8bd0-cf998f381103\") " pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:48.351784 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.351771 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 00:58:48.362126 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.362106 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97k28\" (UniqueName: \"kubernetes.io/projected/06530fdb-ef83-43b3-9c95-11d866ffe79e-kube-api-access-97k28\") pod \"network-check-target-2j9fv\" (UID: \"06530fdb-ef83-43b3-9c95-11d866ffe79e\") " pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:48.401847 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.401776 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vcpsp\"" Jun 13 00:58:48.410011 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.409990 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7dxp" Jun 13 00:58:48.440760 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.440925 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.440925 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440814 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.440925 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440846 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.440925 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-web-config\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.440925 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:48.440917 2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zjx4\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-kube-api-access-7zjx4\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.440986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:48.441005 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls podName:ad0a979d-453a-4218-a3df-fb5f71c2c32c nodeName:}" failed. No retries permitted until 2026-06-13 00:58:48.940980482 +0000 UTC m=+66.936892839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c") : secret "alertmanager-main-tls" not found Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.441061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: E0613 00:58:48.441106 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle podName:ad0a979d-453a-4218-a3df-fb5f71c2c32c nodeName:}" failed. No retries permitted until 2026-06-13 00:58:48.941088441 +0000 UTC m=+66.937000805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c") : configmap references non-existent config key: ca-bundle.crt Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.441127 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441205 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.441180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-out\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.441643 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.441225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.442241 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.442214 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.444590 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.444242 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.444590 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.444458 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.444590 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.444473 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.444590 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.444544 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.444855 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.444681 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.445302 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.445276 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.445410 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.445365 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-out\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.445455 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.445425 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-web-config\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.446269 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.446248 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.455140 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.455101 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zjx4\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-kube-api-access-7zjx4\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.548069 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.548035 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7dxp"] Jun 13 00:58:48.551201 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:48.551175 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd626bdd_afc8_49c7_8bd0_cf998f381103.slice/crio-f4346a94bcc34a2f244138b9252b74e4abe3ceb8702e3aa0367c32031b85a32b WatchSource:0}: Error finding container f4346a94bcc34a2f244138b9252b74e4abe3ceb8702e3aa0367c32031b85a32b: Status 404 returned error can't find the container with id f4346a94bcc34a2f244138b9252b74e4abe3ceb8702e3aa0367c32031b85a32b Jun 13 00:58:48.587126 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.587097 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cnntc\"" Jun 13 00:58:48.589182 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.589138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vpq9m" Jun 13 00:58:48.595101 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.595078 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:48.737180 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.737089 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vpq9m"] Jun 13 00:58:48.741906 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:48.741864 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d1746b_3561_4720_868a_541f21891b97.slice/crio-331443068e4ed626ab134c4cddce033f49f5472225b9480d374743dd9568ac9f WatchSource:0}: Error finding container 331443068e4ed626ab134c4cddce033f49f5472225b9480d374743dd9568ac9f: Status 404 returned error can't find the container with id 331443068e4ed626ab134c4cddce033f49f5472225b9480d374743dd9568ac9f Jun 13 00:58:48.754291 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.754268 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2j9fv"] Jun 13 00:58:48.757418 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:48.757392 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06530fdb_ef83_43b3_9c95_11d866ffe79e.slice/crio-be92bed9ea5b4424d15303a548abe14d6db51b25c6ec0cdd2691c3006e38bacf WatchSource:0}: Error finding container be92bed9ea5b4424d15303a548abe14d6db51b25c6ec0cdd2691c3006e38bacf: Status 404 returned error can't find the container with id be92bed9ea5b4424d15303a548abe14d6db51b25c6ec0cdd2691c3006e38bacf Jun 13 00:58:48.787035 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.787008 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hwtns" Jun 13 00:58:48.825004 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.824605 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2j9fv" event={"ID":"06530fdb-ef83-43b3-9c95-11d866ffe79e","Type":"ContainerStarted","Data":"be92bed9ea5b4424d15303a548abe14d6db51b25c6ec0cdd2691c3006e38bacf"} Jun 13 00:58:48.827528 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.827439 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7dxp" event={"ID":"cd626bdd-afc8-49c7-8bd0-cf998f381103","Type":"ContainerStarted","Data":"f4346a94bcc34a2f244138b9252b74e4abe3ceb8702e3aa0367c32031b85a32b"} Jun 13 00:58:48.828891 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.828864 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vpq9m" event={"ID":"12d1746b-3561-4720-868a-541f21891b97","Type":"ContainerStarted","Data":"331443068e4ed626ab134c4cddce033f49f5472225b9480d374743dd9568ac9f"} Jun 13 00:58:48.830203 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.830179 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m52ff" event={"ID":"7910bbbb-3678-4369-893d-9b8b37ddebd2","Type":"ContainerStarted","Data":"e34d64659cfb66056eb0697169fe3b1653355a617adf1ca1d97ad14041bac28a"} Jun 13 00:58:48.867359 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.867327 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:48.945997 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.945898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.945997 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.945989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.946807 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.946781 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:48.948673 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:48.948650 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:49.202605 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:49.202524 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 00:58:49.376597 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:49.376570 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 00:58:49.566623 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:49.566542 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0a979d_453a_4218_a3df_fb5f71c2c32c.slice/crio-36202b29abe3ad30e7f5882f2bd3c09583276412fb032b749ea801d845f4d493 WatchSource:0}: Error finding container 36202b29abe3ad30e7f5882f2bd3c09583276412fb032b749ea801d845f4d493: Status 404 returned error can't find the container with id 36202b29abe3ad30e7f5882f2bd3c09583276412fb032b749ea801d845f4d493 Jun 13 00:58:49.837292 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:49.837260 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"36202b29abe3ad30e7f5882f2bd3c09583276412fb032b749ea801d845f4d493"} Jun 13 00:58:49.839846 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:49.839819 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7dxp" event={"ID":"cd626bdd-afc8-49c7-8bd0-cf998f381103","Type":"ContainerStarted","Data":"bb1c047383cf0bd8bd94682e6e84ecd9d58405ccd72d13b6cc22e38caed06edc"} Jun 13 00:58:49.841723 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:49.841696 2583 generic.go:356] "Generic (PLEG): container finished" podID="7910bbbb-3678-4369-893d-9b8b37ddebd2" containerID="406744be1ea1209d8b5e1f6aa5ff14628771b7a317317df2d2b4a0f281e50cb2" exitCode=0 Jun 13 00:58:49.841851 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:49.841733 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m52ff" event={"ID":"7910bbbb-3678-4369-893d-9b8b37ddebd2","Type":"ContainerDied","Data":"406744be1ea1209d8b5e1f6aa5ff14628771b7a317317df2d2b4a0f281e50cb2"} Jun 13 00:58:50.156144 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.156107 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:50.247894 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.247855 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:50.412905 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.412704 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:50.533048 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.533008 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:50.847902 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.847848 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4" exitCode=0 Jun 13 00:58:50.848079 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.847919 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4"} Jun 13 00:58:50.850995 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.850581 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7dxp" event={"ID":"cd626bdd-afc8-49c7-8bd0-cf998f381103","Type":"ContainerStarted","Data":"ff733701613be01549ebf70e3309077a894fd6ec42740464f6635a1bdc782de7"} Jun 13 00:58:50.853310 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.853285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m52ff" event={"ID":"7910bbbb-3678-4369-893d-9b8b37ddebd2","Type":"ContainerStarted","Data":"c939f4b13e3a09db3649d71514a40bd2fe841740d2d63563628c5d48f6fb9353"} Jun 13 00:58:50.853422 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.853335 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m52ff" event={"ID":"7910bbbb-3678-4369-893d-9b8b37ddebd2","Type":"ContainerStarted","Data":"93b478d9c2017c3966e16809cf3d7ba181cfea07e2ea0ea162eed5e1f26e9582"} Jun 13 00:58:50.898963 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.898901 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b7dxp" podStartSLOduration=67.837535722 podStartE2EDuration="1m8.898881653s" totalImagesPullingTime="1.061345931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:50.898199231 +0000 UTC m=+68.894111602" watchObservedRunningTime="2026-06-13 00:58:50.898881653 +0000 UTC m=+68.894794032" Jun 13 00:58:50.928556 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:50.928435 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m52ff" podStartSLOduration=2.898222032 podStartE2EDuration="3.928414386s" totalImagesPullingTime="941.057608ms" totalInitContainerRuntime="89.134746ms" isStatefulPod=true podCreationTimestamp="2026-06-13 00:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:50.928109093 +0000 UTC m=+68.924021483" watchObservedRunningTime="2026-06-13 00:58:50.928414386 +0000 UTC m=+68.924326745" Jun 13 00:58:51.045779 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.045692 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:51.114409 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.114372 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:51.511724 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.510676 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68b5674c87-6scsp"] Jun 13 00:58:51.515975 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.515595 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.519483 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.519454 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 00:58:51.519602 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.519494 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 13 00:58:51.519744 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.519728 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8nbzx\"" Jun 13 00:58:51.519955 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.519942 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 13 00:58:51.520097 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.520085 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4p20csu765cj6\"" Jun 13 00:58:51.520333 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.520318 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 13 00:58:51.523049 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.523025 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68b5674c87-6scsp"] Jun 13 00:58:51.569412 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569370 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-client-ca-bundle\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.569596 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569429 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-secret-metrics-server-tls\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.569596 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569456 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/389be8f9-628c-4948-aa5b-2e293da9dddb-metrics-server-audit-profiles\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.569596 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569514 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/389be8f9-628c-4948-aa5b-2e293da9dddb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.569747 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569606 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdbpl\" (UniqueName: \"kubernetes.io/projected/389be8f9-628c-4948-aa5b-2e293da9dddb-kube-api-access-jdbpl\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.569747 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569633 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-secret-metrics-server-client-certs\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.569747 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.569663 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/389be8f9-628c-4948-aa5b-2e293da9dddb-audit-log\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670512 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-secret-metrics-server-tls\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670512 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/389be8f9-628c-4948-aa5b-2e293da9dddb-metrics-server-audit-profiles\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670763 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/389be8f9-628c-4948-aa5b-2e293da9dddb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670763 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdbpl\" (UniqueName: \"kubernetes.io/projected/389be8f9-628c-4948-aa5b-2e293da9dddb-kube-api-access-jdbpl\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670763 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-secret-metrics-server-client-certs\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670763 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670655 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/389be8f9-628c-4948-aa5b-2e293da9dddb-audit-log\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.670763 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.670728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-client-ca-bundle\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.671795 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.671719 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/389be8f9-628c-4948-aa5b-2e293da9dddb-audit-log\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.672223 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.672196 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/389be8f9-628c-4948-aa5b-2e293da9dddb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.672423 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.672393 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/389be8f9-628c-4948-aa5b-2e293da9dddb-metrics-server-audit-profiles\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.674019 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.673969 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-secret-metrics-server-client-certs\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.674495 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.674476 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-client-ca-bundle\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.675869 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.675821 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/389be8f9-628c-4948-aa5b-2e293da9dddb-secret-metrics-server-tls\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.684321 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.684287 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdbpl\" (UniqueName: \"kubernetes.io/projected/389be8f9-628c-4948-aa5b-2e293da9dddb-kube-api-access-jdbpl\") pod \"metrics-server-68b5674c87-6scsp\" (UID: \"389be8f9-628c-4948-aa5b-2e293da9dddb\") " pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.829724 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.829636 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:58:51.983919 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:51.983887 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:52.079720 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:52.079684 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:52.267391 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:52.267356 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:53.164562 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:53.164503 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:53.316658 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:53.316568 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:53.416290 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:53.416138 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:53.498940 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:53.498901 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:53.964965 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:53.964936 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68b5674c87-6scsp"] Jun 13 00:58:53.970389 ip-10-0-129-42 kubenswrapper[2583]: W0613 00:58:53.970298 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389be8f9_628c_4948_aa5b_2e293da9dddb.slice/crio-9601034c668c70a2ba2ca20173dd0cae37cd86b41c62700c7cd120383f559073 WatchSource:0}: Error finding container 9601034c668c70a2ba2ca20173dd0cae37cd86b41c62700c7cd120383f559073: Status 404 returned error can't find the container with id 9601034c668c70a2ba2ca20173dd0cae37cd86b41c62700c7cd120383f559073 Jun 13 00:58:54.644223 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.644175 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:54.745063 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.745024 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:54.763714 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.763691 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67bccd7596-d8hds" Jun 13 00:58:54.871298 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.871256 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vpq9m" event={"ID":"12d1746b-3561-4720-868a-541f21891b97","Type":"ContainerStarted","Data":"e239fbbf4ad0a2b92afee703309332e5d35453f3baf4f56d0263b33932e280d1"} Jun 13 00:58:54.872829 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.872779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" event={"ID":"389be8f9-628c-4948-aa5b-2e293da9dddb","Type":"ContainerStarted","Data":"9601034c668c70a2ba2ca20173dd0cae37cd86b41c62700c7cd120383f559073"} Jun 13 00:58:54.874563 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.874536 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2j9fv" event={"ID":"06530fdb-ef83-43b3-9c95-11d866ffe79e","Type":"ContainerStarted","Data":"515ca7a1e615ee51a654d842d42b9c0f0e3b1f7d9ab91681d1000dd7b8bc8b60"} Jun 13 00:58:54.874712 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.874683 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:58:54.890021 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.889978 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vpq9m" podStartSLOduration=67.81930468 podStartE2EDuration="1m12.889962933s" totalImagesPullingTime="5.070658253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:54.889276567 +0000 UTC m=+72.885188946" watchObservedRunningTime="2026-06-13 00:58:54.889962933 +0000 UTC m=+72.885875311" Jun 13 00:58:54.906768 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.906656 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2j9fv" podStartSLOduration=67.864406511 podStartE2EDuration="1m12.906640911s" totalImagesPullingTime="5.0422344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:54.905787173 +0000 UTC m=+72.901699551" watchObservedRunningTime="2026-06-13 00:58:54.906640911 +0000 UTC m=+72.902553323" Jun 13 00:58:54.926453 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.926424 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:54.994487 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:54.994453 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:55.055850 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.055817 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:55.108814 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.108780 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:55.674293 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.674266 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:55.774944 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.774914 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:55.881357 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.881318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846"} Jun 13 00:58:55.881539 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.881433 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147"} Jun 13 00:58:55.881539 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.881473 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55"} Jun 13 00:58:55.881539 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.881509 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1"} Jun 13 00:58:55.881686 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.881544 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f"} Jun 13 00:58:55.883432 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.883403 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" event={"ID":"389be8f9-628c-4948-aa5b-2e293da9dddb","Type":"ContainerStarted","Data":"d75577c3522bf557808fee4c3d03853a8826e28708bae7d889abec9626cec829"} Jun 13 00:58:55.908327 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:55.908281 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" podStartSLOduration=3.540718962 podStartE2EDuration="4.908267056s" totalImagesPullingTime="1.367548094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:55.906092994 +0000 UTC m=+73.902005371" watchObservedRunningTime="2026-06-13 00:58:55.908267056 +0000 UTC m=+73.904179435" Jun 13 00:58:56.129178 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:56.129113 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:56.195065 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:56.194972 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:56.890639 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:56.890606 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerStarted","Data":"5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1"} Jun 13 00:58:56.919330 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:56.919277 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.709208443 podStartE2EDuration="8.919257948s" totalImagesPullingTime="6.190987893s" totalInitContainerRuntime="19.061612ms" isStatefulPod=false podCreationTimestamp="2026-06-13 00:58:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 00:58:56.917393636 +0000 UTC m=+74.913306013" watchObservedRunningTime="2026-06-13 00:58:56.919257948 +0000 UTC m=+74.915170328" Jun 13 00:58:57.450100 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:57.450069 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:57.496980 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:57.496954 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:59.402138 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:59.402099 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:58:59.502299 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:58:59.502266 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:01.002944 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:01.002910 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:01.103506 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:01.103470 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:01.220445 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:01.220377 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:01.320696 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:01.320607 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:04.422772 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:04.422739 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:04.525254 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:04.525218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:04.582427 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:04.582392 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:04.747960 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:04.747880 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:04.801227 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:04.801195 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:09.998638 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:09.998603 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:10.101748 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:10.101711 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:11.829867 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:11.829824 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:59:11.830312 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:11.829922 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:59:16.216926 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:16.216866 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:16.269660 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:16.269629 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:18.559303 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:18.559264 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:18.663859 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:18.663827 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:18.716394 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:18.716362 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:25.886518 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:25.886484 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2j9fv" Jun 13 00:59:30.856880 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:30.856845 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 00:59:31.840701 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:31.840666 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 00:59:31.846719 ip-10-0-129-42 kubenswrapper[2583]: I0613 00:59:31.846647 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68b5674c87-6scsp" Jun 13 01:00:06.438724 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:06.438688 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:06.834293 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:06.834191 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:07.500285 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500248 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:00:07.500701 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500545 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="alertmanager" containerID="cri-o://17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f" gracePeriod=120 Jun 13 01:00:07.500701 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500619 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-web" containerID="cri-o://71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55" gracePeriod=120 Jun 13 01:00:07.500701 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500678 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-metric" containerID="cri-o://17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846" gracePeriod=120 Jun 13 01:00:07.500873 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500683 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy" containerID="cri-o://f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147" gracePeriod=120 Jun 13 01:00:07.500873 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500694 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="config-reloader" containerID="cri-o://05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1" gracePeriod=120 Jun 13 01:00:07.500873 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:07.500760 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="prom-label-proxy" containerID="cri-o://5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1" gracePeriod=120 Jun 13 01:00:08.137170 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137117 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1" exitCode=0 Jun 13 01:00:08.137170 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137142 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846" exitCode=0 Jun 13 01:00:08.137170 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137166 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147" exitCode=0 Jun 13 01:00:08.137170 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137175 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1" exitCode=0 Jun 13 01:00:08.137170 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137183 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f" exitCode=0 Jun 13 01:00:08.137448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137175 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1"} Jun 13 01:00:08.137448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846"} Jun 13 01:00:08.137448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147"} Jun 13 01:00:08.137448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137344 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1"} Jun 13 01:00:08.137448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.137369 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f"} Jun 13 01:00:08.749387 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.749365 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:08.849972 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.849943 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-tls-assets\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.849985 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-volume\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850016 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-out\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850034 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850064 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850086 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zjx4\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-kube-api-access-7zjx4\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850112 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-web\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850483 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850174 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-cluster-tls-config\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850483 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850214 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850483 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850241 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-main-db\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850483 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850273 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850483 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850309 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-metrics-client-ca\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850483 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850336 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-web-config\") pod \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\" (UID: \"ad0a979d-453a-4218-a3df-fb5f71c2c32c\") " Jun 13 01:00:08.850943 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.850591 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:00:08.853098 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.852848 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:00:08.853098 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.853143 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 01:00:08.853459 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.853405 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-kube-api-access-7zjx4" (OuterVolumeSpecName: "kube-api-access-7zjx4") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "kube-api-access-7zjx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:00:08.854236 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.854207 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.854343 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.854229 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:00:08.854408 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.854338 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-volume" (OuterVolumeSpecName: "config-volume") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.854408 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.854361 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-out" (OuterVolumeSpecName: "config-out") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:00:08.854524 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.854509 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.855025 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.854999 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.855236 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.855217 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.857973 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.857953 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.864328 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.864165 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-web-config" (OuterVolumeSpecName: "web-config") pod "ad0a979d-453a-4218-a3df-fb5f71c2c32c" (UID: "ad0a979d-453a-4218-a3df-fb5f71c2c32c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 01:00:08.951717 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951674 2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-cluster-tls-config\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951717 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951712 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951717 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951722 2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-main-db\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951717 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951734 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951742 2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-metrics-client-ca\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951751 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-web-config\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951761 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-tls-assets\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951769 2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-volume\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951776 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad0a979d-453a-4218-a3df-fb5f71c2c32c-config-out\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951783 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-main-tls\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951792 2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad0a979d-453a-4218-a3df-fb5f71c2c32c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951800 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zjx4\" (UniqueName: \"kubernetes.io/projected/ad0a979d-453a-4218-a3df-fb5f71c2c32c-kube-api-access-7zjx4\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:08.951961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:08.951809 2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad0a979d-453a-4218-a3df-fb5f71c2c32c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:00:09.144106 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.144075 2583 generic.go:356] "Generic (PLEG): container finished" podID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerID="71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55" exitCode=0 Jun 13 01:00:09.144265 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.144168 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.144265 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.144174 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55"} Jun 13 01:00:09.144265 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.144237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ad0a979d-453a-4218-a3df-fb5f71c2c32c","Type":"ContainerDied","Data":"36202b29abe3ad30e7f5882f2bd3c09583276412fb032b749ea801d845f4d493"} Jun 13 01:00:09.144364 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.144281 2583 scope.go:117] "RemoveContainer" containerID="5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1" Jun 13 01:00:09.152049 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.152025 2583 scope.go:117] "RemoveContainer" containerID="17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846" Jun 13 01:00:09.164008 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.163989 2583 scope.go:117] "RemoveContainer" containerID="f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147" Jun 13 01:00:09.170668 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.170649 2583 scope.go:117] "RemoveContainer" containerID="71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55" Jun 13 01:00:09.175798 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.175772 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:00:09.177872 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.177855 2583 scope.go:117] "RemoveContainer" containerID="05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1" Jun 13 01:00:09.180245 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.180226 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:00:09.184900 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.184882 2583 scope.go:117] "RemoveContainer" containerID="17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f" Jun 13 01:00:09.191195 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.191179 2583 scope.go:117] "RemoveContainer" containerID="fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4" Jun 13 01:00:09.197844 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.197829 2583 scope.go:117] "RemoveContainer" containerID="5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1" Jun 13 01:00:09.198121 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.198098 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1\": container with ID starting with 5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1 not found: ID does not exist" containerID="5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1" Jun 13 01:00:09.198225 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198125 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1"} err="failed to get container status \"5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1\": rpc error: code = NotFound desc = could not find container \"5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1\": container with ID starting with 5665319f4e42d59d51a2b69f239c2a6b5500e68c343b42f1bb1100c4fdce50c1 not found: ID does not exist" Jun 13 01:00:09.198225 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198175 2583 scope.go:117] "RemoveContainer" containerID="17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846" Jun 13 01:00:09.198400 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.198384 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846\": container with ID starting with 17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846 not found: ID does not exist" containerID="17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846" Jun 13 01:00:09.198441 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198403 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846"} err="failed to get container status \"17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846\": rpc error: code = NotFound desc = could not find container \"17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846\": container with ID starting with 17300fbb24ac1a7d62134000809bd409de9350d0ac2457bfa58a699da058c846 not found: ID does not exist" Jun 13 01:00:09.198441 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198415 2583 scope.go:117] "RemoveContainer" containerID="f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147" Jun 13 01:00:09.198603 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.198589 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147\": container with ID starting with f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147 not found: ID does not exist" containerID="f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147" Jun 13 01:00:09.198648 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198606 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147"} err="failed to get container status \"f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147\": rpc error: code = NotFound desc = could not find container \"f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147\": container with ID starting with f7936b290ca31f4708f03449ab06a0d15abb046b647cc3f8d826d9fb9f6c6147 not found: ID does not exist" Jun 13 01:00:09.198648 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198618 2583 scope.go:117] "RemoveContainer" containerID="71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55" Jun 13 01:00:09.198801 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.198786 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55\": container with ID starting with 71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55 not found: ID does not exist" containerID="71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55" Jun 13 01:00:09.198840 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198801 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55"} err="failed to get container status \"71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55\": rpc error: code = NotFound desc = could not find container \"71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55\": container with ID starting with 71255ad89896cf257dff8fa0b82a8dbf72fc290b72e010950b827f79f2eade55 not found: ID does not exist" Jun 13 01:00:09.198840 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.198812 2583 scope.go:117] "RemoveContainer" containerID="05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1" Jun 13 01:00:09.199010 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.198993 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1\": container with ID starting with 05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1 not found: ID does not exist" containerID="05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1" Jun 13 01:00:09.199056 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.199015 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1"} err="failed to get container status \"05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1\": rpc error: code = NotFound desc = could not find container \"05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1\": container with ID starting with 05a20c02ab4abcf9abed81d63cab4bd9422d17cfb123280469585e82eb04bdc1 not found: ID does not exist" Jun 13 01:00:09.199056 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.199031 2583 scope.go:117] "RemoveContainer" containerID="17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f" Jun 13 01:00:09.199245 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.199229 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f\": container with ID starting with 17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f not found: ID does not exist" containerID="17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f" Jun 13 01:00:09.199323 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.199246 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f"} err="failed to get container status \"17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f\": rpc error: code = NotFound desc = could not find container \"17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f\": container with ID starting with 17a016aca41574efcd65c147ac1bea54fa3b39db8d5c9b2478fdf48e79df800f not found: ID does not exist" Jun 13 01:00:09.199323 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.199258 2583 scope.go:117] "RemoveContainer" containerID="fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4" Jun 13 01:00:09.199470 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:00:09.199453 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4\": container with ID starting with fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4 not found: ID does not exist" containerID="fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4" Jun 13 01:00:09.199506 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.199475 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4"} err="failed to get container status \"fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4\": rpc error: code = NotFound desc = could not find container \"fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4\": container with ID starting with fdd90798f899c1c5cc8abda037c3bee41d486a3fc0210c5f7544666104990df4 not found: ID does not exist" Jun 13 01:00:09.205810 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.205792 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:00:09.206066 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206053 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206068 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206081 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="alertmanager" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206086 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="alertmanager" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206091 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="config-reloader" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206096 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="config-reloader" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206104 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-metric" Jun 13 01:00:09.206110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206109 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-metric" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206115 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="prom-label-proxy" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206120 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="prom-label-proxy" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206128 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="init-config-reloader" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206132 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="init-config-reloader" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206137 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-web" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206142 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-web" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206206 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="alertmanager" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206213 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-web" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206219 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy-metric" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206225 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="prom-label-proxy" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206232 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="config-reloader" Jun 13 01:00:09.206348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.206237 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" containerName="kube-rbac-proxy" Jun 13 01:00:09.212686 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.212667 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.215321 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215302 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 01:00:09.215438 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215419 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 01:00:09.215511 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215452 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 01:00:09.215511 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215483 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 01:00:09.215610 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215521 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 01:00:09.215772 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215756 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 01:00:09.215940 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.215921 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 01:00:09.216054 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.216040 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s8rp8\"" Jun 13 01:00:09.216133 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.216096 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 01:00:09.220791 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.220772 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 01:00:09.223481 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.223462 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253476 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253521 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253552 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253575 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c87a62b7-f0a0-461c-8085-86d6fe299580-config-out\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c87a62b7-f0a0-461c-8085-86d6fe299580-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253637 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c87a62b7-f0a0-461c-8085-86d6fe299580-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253672 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c87a62b7-f0a0-461c-8085-86d6fe299580-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253697 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd4xx\" (UniqueName: \"kubernetes.io/projected/c87a62b7-f0a0-461c-8085-86d6fe299580-kube-api-access-hd4xx\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253736 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-web-config\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87a62b7-f0a0-461c-8085-86d6fe299580-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253818 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-config-volume\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.253991 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.253841 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354305 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c87a62b7-f0a0-461c-8085-86d6fe299580-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354305 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354319 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c87a62b7-f0a0-461c-8085-86d6fe299580-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354511 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c87a62b7-f0a0-461c-8085-86d6fe299580-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354511 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354493 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd4xx\" (UniqueName: \"kubernetes.io/projected/c87a62b7-f0a0-461c-8085-86d6fe299580-kube-api-access-hd4xx\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354577 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354542 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354617 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354589 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-web-config\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354653 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354615 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87a62b7-f0a0-461c-8085-86d6fe299580-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354653 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-config-volume\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354743 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354743 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354729 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354743 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354735 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c87a62b7-f0a0-461c-8085-86d6fe299580-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354904 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354768 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354904 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354801 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.354904 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.354833 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c87a62b7-f0a0-461c-8085-86d6fe299580-config-out\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.355240 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.355212 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c87a62b7-f0a0-461c-8085-86d6fe299580-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.356098 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.356076 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87a62b7-f0a0-461c-8085-86d6fe299580-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.357724 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.357695 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c87a62b7-f0a0-461c-8085-86d6fe299580-config-out\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.357724 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.357712 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c87a62b7-f0a0-461c-8085-86d6fe299580-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.357895 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.357851 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.358000 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.357980 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.358128 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.358107 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-web-config\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.358247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.358231 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.358536 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.358508 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-config-volume\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.358891 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.358875 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.359587 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.359573 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c87a62b7-f0a0-461c-8085-86d6fe299580-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.362894 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.362866 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd4xx\" (UniqueName: \"kubernetes.io/projected/c87a62b7-f0a0-461c-8085-86d6fe299580-kube-api-access-hd4xx\") pod \"alertmanager-main-0\" (UID: \"c87a62b7-f0a0-461c-8085-86d6fe299580\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.521947 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.521862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 01:00:09.655045 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:09.655023 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 01:00:09.657131 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:00:09.657104 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87a62b7_f0a0_461c_8085_86d6fe299580.slice/crio-7d5be2c3434e4173bb45da207cd17577cb9ade951359da4224cfd8e32d4f2579 WatchSource:0}: Error finding container 7d5be2c3434e4173bb45da207cd17577cb9ade951359da4224cfd8e32d4f2579: Status 404 returned error can't find the container with id 7d5be2c3434e4173bb45da207cd17577cb9ade951359da4224cfd8e32d4f2579 Jun 13 01:00:10.149943 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:10.149904 2583 generic.go:356] "Generic (PLEG): container finished" podID="c87a62b7-f0a0-461c-8085-86d6fe299580" containerID="2ef8dd20dd547c9fe35046f5d6a5beba5bc77be6aa9063bde9e6b44190ce8500" exitCode=0 Jun 13 01:00:10.150362 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:10.149964 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerDied","Data":"2ef8dd20dd547c9fe35046f5d6a5beba5bc77be6aa9063bde9e6b44190ce8500"} Jun 13 01:00:10.150362 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:10.150015 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"7d5be2c3434e4173bb45da207cd17577cb9ade951359da4224cfd8e32d4f2579"} Jun 13 01:00:10.481632 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:10.481605 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0a979d-453a-4218-a3df-fb5f71c2c32c" path="/var/lib/kubelet/pods/ad0a979d-453a-4218-a3df-fb5f71c2c32c/volumes" Jun 13 01:00:11.157392 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.157358 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"72eb85da9c5ca8d4f266956ab93bae789bfd7d7bfe790a60c42c8730aaa0cb61"} Jun 13 01:00:11.157747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.157445 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"3879c8d0172660669b05a69b0b8bbb0bcca9af04d3c35b235e98be4b0d3b9fd9"} Jun 13 01:00:11.157747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.157470 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"dce98a5407c86cd969418ae11e7dfbf4eb0a7fd111defa2745caab8e19fb1871"} Jun 13 01:00:11.157747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.157496 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"6ff4324a66d78284792efe57cf244992453337c6bb5c5b9ceb22deea48008d33"} Jun 13 01:00:11.157747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.157520 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"21378de7c74daff41289e44ff5a2440271a62ecb07f18105bd7746d3e5762e16"} Jun 13 01:00:11.157747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.157543 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c87a62b7-f0a0-461c-8085-86d6fe299580","Type":"ContainerStarted","Data":"5a4cbb21cda79bdeab6c63709d400106e7df2588bebdb11e66e635666b591086"} Jun 13 01:00:11.184078 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.184024 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.16715052 podStartE2EDuration="2.184008149s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.857629ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:11.182268874 +0000 UTC m=+149.178181252" watchObservedRunningTime="2026-06-13 01:00:11.184008149 +0000 UTC m=+149.179920547" Jun 13 01:00:11.519770 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.519678 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz"] Jun 13 01:00:11.523401 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.523377 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.525979 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.525943 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lwfsm\"" Jun 13 01:00:11.526091 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.525994 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 13 01:00:11.526091 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.526074 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 13 01:00:11.526299 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.526281 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 13 01:00:11.526363 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.526342 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 13 01:00:11.526422 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.526380 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 13 01:00:11.532100 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.532080 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 13 01:00:11.536725 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.536691 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz"] Jun 13 01:00:11.572024 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.571992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-serving-certs-ca-bundle\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572206 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572041 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-telemeter-client-tls\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572206 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572068 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-federate-client-tls\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572206 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572084 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572206 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-secret-telemeter-client\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572206 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572175 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572368 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572216 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxv29\" (UniqueName: \"kubernetes.io/projected/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-kube-api-access-fxv29\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.572368 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.572248 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-metrics-client-ca\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.672932 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.672895 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-telemeter-client-tls\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.672932 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.672933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-federate-client-tls\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.673191 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.672949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.673191 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.672971 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-secret-telemeter-client\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.674563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.673383 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.674563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.673443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxv29\" (UniqueName: \"kubernetes.io/projected/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-kube-api-access-fxv29\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.674563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.673483 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-metrics-client-ca\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.674563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.673531 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-serving-certs-ca-bundle\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.674563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.674256 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-serving-certs-ca-bundle\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.674563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.674549 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.675763 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.675735 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-metrics-client-ca\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.675983 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.675954 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-secret-telemeter-client\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.676262 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.676240 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-telemeter-client-tls\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.676833 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.676811 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-federate-client-tls\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.677592 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.677564 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.683004 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.682978 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxv29\" (UniqueName: \"kubernetes.io/projected/c7d97bcd-229d-4d27-8a40-b5cd7fccfff6-kube-api-access-fxv29\") pod \"telemeter-client-7bfb666bc7-7bsjz\" (UID: \"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6\") " pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.834174 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.834066 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" Jun 13 01:00:11.979429 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:11.979275 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz"] Jun 13 01:00:11.983736 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:00:11.983709 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d97bcd_229d_4d27_8a40_b5cd7fccfff6.slice/crio-a1781e8e16eca8d445373952fe672f21611c201d843bdd638dfa90ea9416db8b WatchSource:0}: Error finding container a1781e8e16eca8d445373952fe672f21611c201d843bdd638dfa90ea9416db8b: Status 404 returned error can't find the container with id a1781e8e16eca8d445373952fe672f21611c201d843bdd638dfa90ea9416db8b Jun 13 01:00:12.162894 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:12.162862 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" event={"ID":"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6","Type":"ContainerStarted","Data":"a1781e8e16eca8d445373952fe672f21611c201d843bdd638dfa90ea9416db8b"} Jun 13 01:00:14.171507 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:14.171474 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" event={"ID":"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6","Type":"ContainerStarted","Data":"9176aeae8e58cce18c4dcb39466d41d89cccb69622abf995043daddb88ad6abc"} Jun 13 01:00:14.171869 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:14.171572 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" event={"ID":"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6","Type":"ContainerStarted","Data":"03e89e00c529ccdf02b453036edd1fa51f70d02724a11c124fbb83c1cc936d99"} Jun 13 01:00:14.171869 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:14.171593 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" event={"ID":"c7d97bcd-229d-4d27-8a40-b5cd7fccfff6","Type":"ContainerStarted","Data":"2fc0ca55f8b699ad4a07c4ebae5d219092f1b13bfe311cc18af4fc36b028e9d1"} Jun 13 01:00:14.195022 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:14.194966 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bfb666bc7-7bsjz" podStartSLOduration=1.336020247 podStartE2EDuration="3.194948294s" totalImagesPullingTime="1.858928047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:00:14.192389273 +0000 UTC m=+152.188301668" watchObservedRunningTime="2026-06-13 01:00:14.194948294 +0000 UTC m=+152.190860677" Jun 13 01:00:14.975570 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:14.975534 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:15.077946 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:15.077905 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:15.126104 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:15.126075 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:15.680872 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:15.680841 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:15.726587 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:15.726555 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:18.285796 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:18.285761 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:23.788402 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:23.788370 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:25.769964 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:25.769928 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:25.832046 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:25.832011 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:25.889375 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:25.889344 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:50.018474 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:50.018438 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:00:50.118948 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:00:50.118913 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:21.665775 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:21.665738 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:21.766255 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:21.766208 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:24.602097 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:24.602051 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:24.653269 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:24.653240 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:33.642960 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:33.642927 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:33.742659 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:33.742628 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:35.020630 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:35.020596 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:35.070127 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:35.070094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:46.228787 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:46.228751 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:46.329308 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:46.329271 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:46.587268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:46.587172 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:01:46.663043 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:01:46.663013 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:22.362141 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:22.362038 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:22.992415 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:22.992379 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4"] Jun 13 01:02:22.995395 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:22.995380 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:22.998374 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:22.998344 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:02:22.998515 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:22.998406 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:02:23.002175 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:22.999174 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m6kw\"" Jun 13 01:02:23.006302 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.006275 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4"] Jun 13 01:02:23.059565 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.059535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gwg9\" (UniqueName: \"kubernetes.io/projected/31a7a44e-ad39-408e-a8bc-c817235c6dbf-kube-api-access-5gwg9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.059693 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.059586 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.059693 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.059619 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.160097 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.160056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.160097 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.160098 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.160323 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.160174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gwg9\" (UniqueName: \"kubernetes.io/projected/31a7a44e-ad39-408e-a8bc-c817235c6dbf-kube-api-access-5gwg9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.160467 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.160446 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.160526 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.160506 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.169228 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.169206 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gwg9\" (UniqueName: \"kubernetes.io/projected/31a7a44e-ad39-408e-a8bc-c817235c6dbf-kube-api-access-5gwg9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.307260 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.307144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:23.411798 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.411756 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:23.432496 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.432474 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4"] Jun 13 01:02:23.434515 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:02:23.434490 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a7a44e_ad39_408e_a8bc_c817235c6dbf.slice/crio-6f66daa9996f2e6be2ced82b9479fd6d756b758a78707e7880eb3a52e0dfb5e8 WatchSource:0}: Error finding container 6f66daa9996f2e6be2ced82b9479fd6d756b758a78707e7880eb3a52e0dfb5e8: Status 404 returned error can't find the container with id 6f66daa9996f2e6be2ced82b9479fd6d756b758a78707e7880eb3a52e0dfb5e8 Jun 13 01:02:23.623553 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:23.623519 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" event={"ID":"31a7a44e-ad39-408e-a8bc-c817235c6dbf","Type":"ContainerStarted","Data":"6f66daa9996f2e6be2ced82b9479fd6d756b758a78707e7880eb3a52e0dfb5e8"} Jun 13 01:02:30.653917 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:30.653886 2583 generic.go:356] "Generic (PLEG): container finished" podID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerID="e2c31ed26e6cc316b54f7ed3c890f0831c5e00b42323bfacc35052369facae64" exitCode=0 Jun 13 01:02:30.654311 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:30.653983 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" event={"ID":"31a7a44e-ad39-408e-a8bc-c817235c6dbf","Type":"ContainerDied","Data":"e2c31ed26e6cc316b54f7ed3c890f0831c5e00b42323bfacc35052369facae64"} Jun 13 01:02:33.164084 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:02:33.164049 2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a7a44e_ad39_408e_a8bc_c817235c6dbf.slice/crio-b69605dc8b5b692867336066eecc01346d8a80739a5422ef6a49b9e18e350b65.scope\": RecentStats: unable to find data in memory cache]" Jun 13 01:02:33.669128 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:33.669091 2583 generic.go:356] "Generic (PLEG): container finished" podID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerID="b69605dc8b5b692867336066eecc01346d8a80739a5422ef6a49b9e18e350b65" exitCode=0 Jun 13 01:02:33.669308 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:33.669144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" event={"ID":"31a7a44e-ad39-408e-a8bc-c817235c6dbf","Type":"ContainerDied","Data":"b69605dc8b5b692867336066eecc01346d8a80739a5422ef6a49b9e18e350b65"} Jun 13 01:02:40.704243 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:40.704200 2583 generic.go:356] "Generic (PLEG): container finished" podID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerID="7a12e9fae21e459bc8a127bccec64694b3ee07d4ea9d169fccc960dba6570ec1" exitCode=0 Jun 13 01:02:40.704613 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:40.704282 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" event={"ID":"31a7a44e-ad39-408e-a8bc-c817235c6dbf","Type":"ContainerDied","Data":"7a12e9fae21e459bc8a127bccec64694b3ee07d4ea9d169fccc960dba6570ec1"} Jun 13 01:02:41.840610 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.840587 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:41.914805 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.914772 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-util\") pod \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " Jun 13 01:02:41.914970 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.914821 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gwg9\" (UniqueName: \"kubernetes.io/projected/31a7a44e-ad39-408e-a8bc-c817235c6dbf-kube-api-access-5gwg9\") pod \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " Jun 13 01:02:41.914970 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.914852 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-bundle\") pod \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\" (UID: \"31a7a44e-ad39-408e-a8bc-c817235c6dbf\") " Jun 13 01:02:41.915532 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.915507 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-bundle" (OuterVolumeSpecName: "bundle") pod "31a7a44e-ad39-408e-a8bc-c817235c6dbf" (UID: "31a7a44e-ad39-408e-a8bc-c817235c6dbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:02:41.917133 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.917108 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a7a44e-ad39-408e-a8bc-c817235c6dbf-kube-api-access-5gwg9" (OuterVolumeSpecName: "kube-api-access-5gwg9") pod "31a7a44e-ad39-408e-a8bc-c817235c6dbf" (UID: "31a7a44e-ad39-408e-a8bc-c817235c6dbf"). InnerVolumeSpecName "kube-api-access-5gwg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:02:41.919878 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:41.919851 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-util" (OuterVolumeSpecName: "util") pod "31a7a44e-ad39-408e-a8bc-c817235c6dbf" (UID: "31a7a44e-ad39-408e-a8bc-c817235c6dbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:02:42.016084 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.016007 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gwg9\" (UniqueName: \"kubernetes.io/projected/31a7a44e-ad39-408e-a8bc-c817235c6dbf-kube-api-access-5gwg9\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:02:42.016084 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.016035 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:02:42.016084 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.016044 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31a7a44e-ad39-408e-a8bc-c817235c6dbf-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:02:42.423577 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.423549 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:02:42.429223 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.429195 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:02:42.430365 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.430343 2583 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 01:02:42.713544 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.713470 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" Jun 13 01:02:42.713704 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.713472 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dd48t4" event={"ID":"31a7a44e-ad39-408e-a8bc-c817235c6dbf","Type":"ContainerDied","Data":"6f66daa9996f2e6be2ced82b9479fd6d756b758a78707e7880eb3a52e0dfb5e8"} Jun 13 01:02:42.713704 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:42.713588 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f66daa9996f2e6be2ced82b9479fd6d756b758a78707e7880eb3a52e0dfb5e8" Jun 13 01:02:43.999923 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:43.999887 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:44.720916 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:44.720866 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:45.923207 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923174 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p"] Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923450 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="extract" Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923460 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="extract" Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923469 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="util" Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923475 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="util" Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923487 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="pull" Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923492 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="pull" Jun 13 01:02:45.923562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.923525 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a7a44e-ad39-408e-a8bc-c817235c6dbf" containerName="extract" Jun 13 01:02:45.968345 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.968303 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p"] Jun 13 01:02:45.968501 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.968441 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:45.971129 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.971105 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:02:45.971129 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.971105 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 13 01:02:45.971313 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:45.971204 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lmsth\"" Jun 13 01:02:46.050787 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.050750 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfvd\" (UniqueName: \"kubernetes.io/projected/9dfc82f1-7bfa-4e8d-aab2-5e5973726c22-kube-api-access-9wfvd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xvv5p\" (UID: \"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.050965 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.050797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dfc82f1-7bfa-4e8d-aab2-5e5973726c22-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xvv5p\" (UID: \"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.151504 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.151467 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfvd\" (UniqueName: \"kubernetes.io/projected/9dfc82f1-7bfa-4e8d-aab2-5e5973726c22-kube-api-access-9wfvd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xvv5p\" (UID: \"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.151674 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.151513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dfc82f1-7bfa-4e8d-aab2-5e5973726c22-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xvv5p\" (UID: \"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.151952 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.151935 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dfc82f1-7bfa-4e8d-aab2-5e5973726c22-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xvv5p\" (UID: \"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.159937 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.159909 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfvd\" (UniqueName: \"kubernetes.io/projected/9dfc82f1-7bfa-4e8d-aab2-5e5973726c22-kube-api-access-9wfvd\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xvv5p\" (UID: \"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.278095 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.278017 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" Jun 13 01:02:46.425570 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.425536 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p"] Jun 13 01:02:46.428840 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:02:46.428806 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dfc82f1_7bfa_4e8d_aab2_5e5973726c22.slice/crio-279959eefd6fccd58cd5b1786e90ccc5e2050e27261a01810c9a601c4f20ca51 WatchSource:0}: Error finding container 279959eefd6fccd58cd5b1786e90ccc5e2050e27261a01810c9a601c4f20ca51: Status 404 returned error can't find the container with id 279959eefd6fccd58cd5b1786e90ccc5e2050e27261a01810c9a601c4f20ca51 Jun 13 01:02:46.432196 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.432180 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:02:46.732361 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:46.732330 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" event={"ID":"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22","Type":"ContainerStarted","Data":"279959eefd6fccd58cd5b1786e90ccc5e2050e27261a01810c9a601c4f20ca51"} Jun 13 01:02:47.569848 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:47.569766 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:47.676826 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:47.676757 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:49.748435 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:49.748386 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" event={"ID":"9dfc82f1-7bfa-4e8d-aab2-5e5973726c22","Type":"ContainerStarted","Data":"a44b54033fbe11fa09a6e98111f7fd2728be7902b4f366399d0a1e7d2b797b92"} Jun 13 01:02:49.778443 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:49.778392 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xvv5p" podStartSLOduration=2.386148974 podStartE2EDuration="4.778370851s" totalImagesPullingTime="2.392221877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:02:49.776772172 +0000 UTC m=+307.772684564" watchObservedRunningTime="2026-06-13 01:02:49.778370851 +0000 UTC m=+307.774283230" Jun 13 01:02:49.779084 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:49.779045 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:49.878428 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:49.878395 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:50.169106 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.169064 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:50.306035 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.306004 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:50.347025 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.346995 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd"] Jun 13 01:02:50.349272 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.349257 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.354411 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.354384 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m6kw\"" Jun 13 01:02:50.354541 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.354428 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:02:50.354541 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.354432 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:02:50.375132 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.375105 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd"] Jun 13 01:02:50.489218 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.489108 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.489218 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.489172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8npq\" (UniqueName: \"kubernetes.io/projected/e3732a1f-7922-4857-94dc-e59cb473c312-kube-api-access-q8npq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.489396 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.489240 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.589992 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.589955 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.590204 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.590032 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.590204 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.590049 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8npq\" (UniqueName: \"kubernetes.io/projected/e3732a1f-7922-4857-94dc-e59cb473c312-kube-api-access-q8npq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.590372 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.590352 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.590452 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.590432 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.606778 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.606756 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8npq\" (UniqueName: \"kubernetes.io/projected/e3732a1f-7922-4857-94dc-e59cb473c312-kube-api-access-q8npq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.659946 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.659903 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:50.790823 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:50.790796 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd"] Jun 13 01:02:50.793521 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:02:50.793496 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3732a1f_7922_4857_94dc_e59cb473c312.slice/crio-4a612a857ff297b58f5ff22a281c53e68d2b3f5cdca65dc8f7a33506b9f3f770 WatchSource:0}: Error finding container 4a612a857ff297b58f5ff22a281c53e68d2b3f5cdca65dc8f7a33506b9f3f770: Status 404 returned error can't find the container with id 4a612a857ff297b58f5ff22a281c53e68d2b3f5cdca65dc8f7a33506b9f3f770 Jun 13 01:02:51.759492 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:51.759458 2583 generic.go:356] "Generic (PLEG): container finished" podID="e3732a1f-7922-4857-94dc-e59cb473c312" containerID="ba5d3895078e43cbbe4436ac193e27720c15476c74d7e76fb9dfd377848f0b65" exitCode=0 Jun 13 01:02:51.759626 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:51.759498 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" event={"ID":"e3732a1f-7922-4857-94dc-e59cb473c312","Type":"ContainerDied","Data":"ba5d3895078e43cbbe4436ac193e27720c15476c74d7e76fb9dfd377848f0b65"} Jun 13 01:02:51.759626 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:51.759538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" event={"ID":"e3732a1f-7922-4857-94dc-e59cb473c312","Type":"ContainerStarted","Data":"4a612a857ff297b58f5ff22a281c53e68d2b3f5cdca65dc8f7a33506b9f3f770"} Jun 13 01:02:53.069241 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:53.069205 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:53.674970 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:53.674947 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:53.772106 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:53.772074 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" event={"ID":"e3732a1f-7922-4857-94dc-e59cb473c312","Type":"ContainerStarted","Data":"94c9068595ac530d09f282472ff55cd8971e19684008d0add299df4a4cc8dbf3"} Jun 13 01:02:54.554720 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:54.554684 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:54.615252 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:54.615222 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:02:54.777819 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:54.777773 2583 generic.go:356] "Generic (PLEG): container finished" podID="e3732a1f-7922-4857-94dc-e59cb473c312" containerID="94c9068595ac530d09f282472ff55cd8971e19684008d0add299df4a4cc8dbf3" exitCode=0 Jun 13 01:02:54.777995 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:54.777865 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" event={"ID":"e3732a1f-7922-4857-94dc-e59cb473c312","Type":"ContainerDied","Data":"94c9068595ac530d09f282472ff55cd8971e19684008d0add299df4a4cc8dbf3"} Jun 13 01:02:55.452271 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.452233 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9"] Jun 13 01:02:55.455377 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.455358 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.458177 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.458144 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dpgp9\"" Jun 13 01:02:55.458248 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.458221 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 01:02:55.458248 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.458238 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 01:02:55.464962 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.464944 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9"] Jun 13 01:02:55.532747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.532706 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bkmt9\" (UID: \"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.532747 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.532749 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98bk\" (UniqueName: \"kubernetes.io/projected/e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092-kube-api-access-h98bk\") pod \"cert-manager-cainjector-5d99449ffd-bkmt9\" (UID: \"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.634086 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.634046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bkmt9\" (UID: \"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.634516 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.634096 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98bk\" (UniqueName: \"kubernetes.io/projected/e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092-kube-api-access-h98bk\") pod \"cert-manager-cainjector-5d99449ffd-bkmt9\" (UID: \"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.645860 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.645835 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98bk\" (UniqueName: \"kubernetes.io/projected/e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092-kube-api-access-h98bk\") pod \"cert-manager-cainjector-5d99449ffd-bkmt9\" (UID: \"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.645975 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.645927 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-bkmt9\" (UID: \"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.779491 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.779405 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" Jun 13 01:02:55.784264 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.784240 2583 generic.go:356] "Generic (PLEG): container finished" podID="e3732a1f-7922-4857-94dc-e59cb473c312" containerID="374469ffffbc9b72d9be92ac46719a05ae315d84738f1f5566557ca79f1d21e5" exitCode=0 Jun 13 01:02:55.784380 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.784282 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" event={"ID":"e3732a1f-7922-4857-94dc-e59cb473c312","Type":"ContainerDied","Data":"374469ffffbc9b72d9be92ac46719a05ae315d84738f1f5566557ca79f1d21e5"} Jun 13 01:02:55.907484 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:55.907460 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9"] Jun 13 01:02:55.909438 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:02:55.909414 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2ebbdf2_ca60_4be8_b4c1_cd2d13dca092.slice/crio-97999c7c5a1e4e999965c490d4930dac47eea61a5cb93ef7c1c1cf2f959d92eb WatchSource:0}: Error finding container 97999c7c5a1e4e999965c490d4930dac47eea61a5cb93ef7c1c1cf2f959d92eb: Status 404 returned error can't find the container with id 97999c7c5a1e4e999965c490d4930dac47eea61a5cb93ef7c1c1cf2f959d92eb Jun 13 01:02:56.790660 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:56.790620 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" event={"ID":"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092","Type":"ContainerStarted","Data":"97999c7c5a1e4e999965c490d4930dac47eea61a5cb93ef7c1c1cf2f959d92eb"} Jun 13 01:02:56.928877 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:56.928852 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:57.047378 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.047299 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8npq\" (UniqueName: \"kubernetes.io/projected/e3732a1f-7922-4857-94dc-e59cb473c312-kube-api-access-q8npq\") pod \"e3732a1f-7922-4857-94dc-e59cb473c312\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " Jun 13 01:02:57.047547 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.047389 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-util\") pod \"e3732a1f-7922-4857-94dc-e59cb473c312\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " Jun 13 01:02:57.047547 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.047426 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-bundle\") pod \"e3732a1f-7922-4857-94dc-e59cb473c312\" (UID: \"e3732a1f-7922-4857-94dc-e59cb473c312\") " Jun 13 01:02:57.047933 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.047909 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-bundle" (OuterVolumeSpecName: "bundle") pod "e3732a1f-7922-4857-94dc-e59cb473c312" (UID: "e3732a1f-7922-4857-94dc-e59cb473c312"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:02:57.049844 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.049815 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3732a1f-7922-4857-94dc-e59cb473c312-kube-api-access-q8npq" (OuterVolumeSpecName: "kube-api-access-q8npq") pod "e3732a1f-7922-4857-94dc-e59cb473c312" (UID: "e3732a1f-7922-4857-94dc-e59cb473c312"). InnerVolumeSpecName "kube-api-access-q8npq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:02:57.053432 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.053408 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-util" (OuterVolumeSpecName: "util") pod "e3732a1f-7922-4857-94dc-e59cb473c312" (UID: "e3732a1f-7922-4857-94dc-e59cb473c312"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:02:57.055287 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055241 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2w857"] Jun 13 01:02:57.055699 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055680 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="util" Jun 13 01:02:57.055776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055702 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="util" Jun 13 01:02:57.055776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055722 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="extract" Jun 13 01:02:57.055776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055731 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="extract" Jun 13 01:02:57.055776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055755 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="pull" Jun 13 01:02:57.055776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055763 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="pull" Jun 13 01:02:57.055949 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.055808 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3732a1f-7922-4857-94dc-e59cb473c312" containerName="extract" Jun 13 01:02:57.059567 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.059549 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.064052 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.064032 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8kcw5\"" Jun 13 01:02:57.073635 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.073614 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2w857"] Jun 13 01:02:57.148689 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.148657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm9r7\" (UniqueName: \"kubernetes.io/projected/29425335-e722-440a-814e-c2c455523fd5-kube-api-access-jm9r7\") pod \"cert-manager-webhook-7dc76cbb94-2w857\" (UID: \"29425335-e722-440a-814e-c2c455523fd5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.148854 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.148800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29425335-e722-440a-814e-c2c455523fd5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2w857\" (UID: \"29425335-e722-440a-814e-c2c455523fd5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.148921 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.148897 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:02:57.148969 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.148920 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3732a1f-7922-4857-94dc-e59cb473c312-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:02:57.148969 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.148933 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8npq\" (UniqueName: \"kubernetes.io/projected/e3732a1f-7922-4857-94dc-e59cb473c312-kube-api-access-q8npq\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:02:57.250092 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.250048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29425335-e722-440a-814e-c2c455523fd5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2w857\" (UID: \"29425335-e722-440a-814e-c2c455523fd5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.250287 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.250126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm9r7\" (UniqueName: \"kubernetes.io/projected/29425335-e722-440a-814e-c2c455523fd5-kube-api-access-jm9r7\") pod \"cert-manager-webhook-7dc76cbb94-2w857\" (UID: \"29425335-e722-440a-814e-c2c455523fd5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.259838 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.259813 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm9r7\" (UniqueName: \"kubernetes.io/projected/29425335-e722-440a-814e-c2c455523fd5-kube-api-access-jm9r7\") pod \"cert-manager-webhook-7dc76cbb94-2w857\" (UID: \"29425335-e722-440a-814e-c2c455523fd5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.259996 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.259899 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29425335-e722-440a-814e-c2c455523fd5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-2w857\" (UID: \"29425335-e722-440a-814e-c2c455523fd5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.369880 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.369831 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:02:57.543605 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.543505 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-2w857"] Jun 13 01:02:57.797433 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.797345 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" event={"ID":"e3732a1f-7922-4857-94dc-e59cb473c312","Type":"ContainerDied","Data":"4a612a857ff297b58f5ff22a281c53e68d2b3f5cdca65dc8f7a33506b9f3f770"} Jun 13 01:02:57.797433 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.797398 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2tvmd" Jun 13 01:02:57.797433 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:57.797428 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a612a857ff297b58f5ff22a281c53e68d2b3f5cdca65dc8f7a33506b9f3f770" Jun 13 01:02:58.366422 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:02:58.366391 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29425335_e722_440a_814e_c2c455523fd5.slice/crio-3919c702af76eb6cbcab0742e11ca941c163ad13da4eed933fdbe77d3cf9faae WatchSource:0}: Error finding container 3919c702af76eb6cbcab0742e11ca941c163ad13da4eed933fdbe77d3cf9faae: Status 404 returned error can't find the container with id 3919c702af76eb6cbcab0742e11ca941c163ad13da4eed933fdbe77d3cf9faae Jun 13 01:02:58.803461 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:58.803371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" event={"ID":"e2ebbdf2-ca60-4be8-b4c1-cd2d13dca092","Type":"ContainerStarted","Data":"11302798c477100b4e3f377f84f07ad070b75451709657c5b76956ba4611de52"} Jun 13 01:02:58.804598 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:58.804574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" event={"ID":"29425335-e722-440a-814e-c2c455523fd5","Type":"ContainerStarted","Data":"3919c702af76eb6cbcab0742e11ca941c163ad13da4eed933fdbe77d3cf9faae"} Jun 13 01:02:58.821641 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:02:58.821593 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-bkmt9" podStartSLOduration=1.308433315 podStartE2EDuration="3.821577775s" totalImagesPullingTime="2.51314446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:02:58.820441202 +0000 UTC m=+316.816353583" watchObservedRunningTime="2026-06-13 01:02:58.821577775 +0000 UTC m=+316.817490152" Jun 13 01:03:00.077497 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:00.077423 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:00.129829 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:00.129795 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:00.813899 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:00.813864 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" event={"ID":"29425335-e722-440a-814e-c2c455523fd5","Type":"ContainerStarted","Data":"4159e4fd4e421696d7175c94b8ccab6d11d956b314a1ec291cea18eb8a60aef6"} Jun 13 01:03:00.814109 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:00.814091 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:03:00.832634 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:00.832582 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" podStartSLOduration=2.388388339 podStartE2EDuration="3.832567125s" totalImagesPullingTime="1.444178786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:00.830647707 +0000 UTC m=+318.826560085" watchObservedRunningTime="2026-06-13 01:03:00.832567125 +0000 UTC m=+318.828479503" Jun 13 01:03:01.660790 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:01.660757 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:06.207564 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:06.207532 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:06.304309 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:06.304284 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:06.819772 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:06.819742 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-2w857" Jun 13 01:03:08.217622 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.217582 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5"] Jun 13 01:03:08.220848 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.220832 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.223902 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.223874 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 01:03:08.224114 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.224099 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kj2f9\"" Jun 13 01:03:08.225043 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.225023 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 01:03:08.230032 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.230000 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5"] Jun 13 01:03:08.340304 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.340257 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44t6r\" (UniqueName: \"kubernetes.io/projected/92b68873-e80c-40c9-9de4-8e9e233b7723-kube-api-access-44t6r\") pod \"openshift-lws-operator-fd8ccff4c-tmkr5\" (UID: \"92b68873-e80c-40c9-9de4-8e9e233b7723\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.340454 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.340320 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b68873-e80c-40c9-9de4-8e9e233b7723-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tmkr5\" (UID: \"92b68873-e80c-40c9-9de4-8e9e233b7723\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.441349 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.441304 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44t6r\" (UniqueName: \"kubernetes.io/projected/92b68873-e80c-40c9-9de4-8e9e233b7723-kube-api-access-44t6r\") pod \"openshift-lws-operator-fd8ccff4c-tmkr5\" (UID: \"92b68873-e80c-40c9-9de4-8e9e233b7723\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.441349 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.441358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b68873-e80c-40c9-9de4-8e9e233b7723-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tmkr5\" (UID: \"92b68873-e80c-40c9-9de4-8e9e233b7723\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.441685 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.441670 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b68873-e80c-40c9-9de4-8e9e233b7723-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tmkr5\" (UID: \"92b68873-e80c-40c9-9de4-8e9e233b7723\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.450985 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.450960 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44t6r\" (UniqueName: \"kubernetes.io/projected/92b68873-e80c-40c9-9de4-8e9e233b7723-kube-api-access-44t6r\") pod \"openshift-lws-operator-fd8ccff4c-tmkr5\" (UID: \"92b68873-e80c-40c9-9de4-8e9e233b7723\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.530050 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.529961 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" Jun 13 01:03:08.680017 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.679989 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5"] Jun 13 01:03:08.681809 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:03:08.681777 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92b68873_e80c_40c9_9de4_8e9e233b7723.slice/crio-644a53a81ae0d3c7e8d392ef1eeab1ee892e5edd78640fbad29e234a8f084bf9 WatchSource:0}: Error finding container 644a53a81ae0d3c7e8d392ef1eeab1ee892e5edd78640fbad29e234a8f084bf9: Status 404 returned error can't find the container with id 644a53a81ae0d3c7e8d392ef1eeab1ee892e5edd78640fbad29e234a8f084bf9 Jun 13 01:03:08.845668 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:08.845582 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" event={"ID":"92b68873-e80c-40c9-9de4-8e9e233b7723","Type":"ContainerStarted","Data":"644a53a81ae0d3c7e8d392ef1eeab1ee892e5edd78640fbad29e234a8f084bf9"} Jun 13 01:03:12.865625 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:12.865589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" event={"ID":"92b68873-e80c-40c9-9de4-8e9e233b7723","Type":"ContainerStarted","Data":"ef0bf08a778fdeadce1bf9aba79e204f0f859e75b296f642f3ca616ed8d8063d"} Jun 13 01:03:12.883409 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:12.883364 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tmkr5" podStartSLOduration=1.685571329 podStartE2EDuration="4.883350753s" totalImagesPullingTime="3.197779424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:12.881608091 +0000 UTC m=+330.877520468" watchObservedRunningTime="2026-06-13 01:03:12.883350753 +0000 UTC m=+330.879263130" Jun 13 01:03:13.488725 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:13.488687 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:13.585773 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:13.585741 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:15.492081 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:15.492035 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:16.869062 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.869020 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd"] Jun 13 01:03:16.871559 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.871537 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.874618 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.874595 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:03:16.874828 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.874814 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:03:16.875864 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.875830 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m6kw\"" Jun 13 01:03:16.882448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.882425 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd"] Jun 13 01:03:16.898423 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.898403 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8fmd\" (UniqueName: \"kubernetes.io/projected/536c113d-4fe9-469f-bcdd-3a643b023fcf-kube-api-access-f8fmd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.898522 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.898450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.898522 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.898513 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.998816 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.998778 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.998986 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.998823 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8fmd\" (UniqueName: \"kubernetes.io/projected/536c113d-4fe9-469f-bcdd-3a643b023fcf-kube-api-access-f8fmd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.998986 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.998856 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.999188 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.999168 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:16.999241 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:16.999196 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:17.008377 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:17.008346 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8fmd\" (UniqueName: \"kubernetes.io/projected/536c113d-4fe9-469f-bcdd-3a643b023fcf-kube-api-access-f8fmd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:17.180950 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:17.180862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:17.318291 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:17.318265 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd"] Jun 13 01:03:17.320649 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:03:17.320618 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536c113d_4fe9_469f_bcdd_3a643b023fcf.slice/crio-ed8afdbadca06838597bc2f464fd5458ed9710349014c392c1f057811f63c69a WatchSource:0}: Error finding container ed8afdbadca06838597bc2f464fd5458ed9710349014c392c1f057811f63c69a: Status 404 returned error can't find the container with id ed8afdbadca06838597bc2f464fd5458ed9710349014c392c1f057811f63c69a Jun 13 01:03:17.889054 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:17.889013 2583 generic.go:356] "Generic (PLEG): container finished" podID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerID="0d00d5e15bb2214e851387fd3deb72dffacf365c205482616f1c3e8d83a78433" exitCode=0 Jun 13 01:03:17.889521 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:17.889067 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" event={"ID":"536c113d-4fe9-469f-bcdd-3a643b023fcf","Type":"ContainerDied","Data":"0d00d5e15bb2214e851387fd3deb72dffacf365c205482616f1c3e8d83a78433"} Jun 13 01:03:17.889521 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:17.889101 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" event={"ID":"536c113d-4fe9-469f-bcdd-3a643b023fcf","Type":"ContainerStarted","Data":"ed8afdbadca06838597bc2f464fd5458ed9710349014c392c1f057811f63c69a"} Jun 13 01:03:18.896461 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:18.896430 2583 generic.go:356] "Generic (PLEG): container finished" podID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerID="57923a9d84210fabc1b2cc010553cce2dd2dc1eb0e4c412a34202fce36508ccb" exitCode=0 Jun 13 01:03:18.896857 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:18.896516 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" event={"ID":"536c113d-4fe9-469f-bcdd-3a643b023fcf","Type":"ContainerDied","Data":"57923a9d84210fabc1b2cc010553cce2dd2dc1eb0e4c412a34202fce36508ccb"} Jun 13 01:03:19.902970 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:19.902937 2583 generic.go:356] "Generic (PLEG): container finished" podID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerID="edd5b4c075533e43479ad5d59c6597e87ee6f7643ef2e7fa6ebb3e88d67305b5" exitCode=0 Jun 13 01:03:19.902970 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:19.902972 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" event={"ID":"536c113d-4fe9-469f-bcdd-3a643b023fcf","Type":"ContainerDied","Data":"edd5b4c075533e43479ad5d59c6597e87ee6f7643ef2e7fa6ebb3e88d67305b5"} Jun 13 01:03:21.027480 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.027454 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:21.126315 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.126269 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8fmd\" (UniqueName: \"kubernetes.io/projected/536c113d-4fe9-469f-bcdd-3a643b023fcf-kube-api-access-f8fmd\") pod \"536c113d-4fe9-469f-bcdd-3a643b023fcf\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " Jun 13 01:03:21.126315 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.126324 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-bundle\") pod \"536c113d-4fe9-469f-bcdd-3a643b023fcf\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " Jun 13 01:03:21.126539 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.126356 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-util\") pod \"536c113d-4fe9-469f-bcdd-3a643b023fcf\" (UID: \"536c113d-4fe9-469f-bcdd-3a643b023fcf\") " Jun 13 01:03:21.127167 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.127116 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-bundle" (OuterVolumeSpecName: "bundle") pod "536c113d-4fe9-469f-bcdd-3a643b023fcf" (UID: "536c113d-4fe9-469f-bcdd-3a643b023fcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:03:21.128487 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.128459 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/536c113d-4fe9-469f-bcdd-3a643b023fcf-kube-api-access-f8fmd" (OuterVolumeSpecName: "kube-api-access-f8fmd") pod "536c113d-4fe9-469f-bcdd-3a643b023fcf" (UID: "536c113d-4fe9-469f-bcdd-3a643b023fcf"). InnerVolumeSpecName "kube-api-access-f8fmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:03:21.131924 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.131885 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-util" (OuterVolumeSpecName: "util") pod "536c113d-4fe9-469f-bcdd-3a643b023fcf" (UID: "536c113d-4fe9-469f-bcdd-3a643b023fcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:03:21.227041 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.226951 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8fmd\" (UniqueName: \"kubernetes.io/projected/536c113d-4fe9-469f-bcdd-3a643b023fcf-kube-api-access-f8fmd\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:03:21.227041 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.226981 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:03:21.227041 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.226991 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/536c113d-4fe9-469f-bcdd-3a643b023fcf-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:03:21.913142 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.913105 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" Jun 13 01:03:21.913142 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.913106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdkhthd" event={"ID":"536c113d-4fe9-469f-bcdd-3a643b023fcf","Type":"ContainerDied","Data":"ed8afdbadca06838597bc2f464fd5458ed9710349014c392c1f057811f63c69a"} Jun 13 01:03:21.913414 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:21.913203 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed8afdbadca06838597bc2f464fd5458ed9710349014c392c1f057811f63c69a" Jun 13 01:03:27.059578 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:27.059543 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:27.213503 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:27.213468 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:27.768447 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:27.768354 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:27.907044 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:27.907007 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:28.590952 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.590923 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:28.691110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.691079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:28.717719 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.717679 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv"] Jun 13 01:03:28.717975 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.717963 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="pull" Jun 13 01:03:28.718021 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.717977 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="pull" Jun 13 01:03:28.718021 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.717990 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="extract" Jun 13 01:03:28.718021 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.717995 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="extract" Jun 13 01:03:28.718021 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.718005 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="util" Jun 13 01:03:28.718021 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.718010 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="util" Jun 13 01:03:28.718187 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.718062 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="536c113d-4fe9-469f-bcdd-3a643b023fcf" containerName="extract" Jun 13 01:03:28.742718 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.742693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.745304 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.745275 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv"] Jun 13 01:03:28.745952 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.745909 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 01:03:28.745952 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.745910 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 01:03:28.746131 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.745932 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 01:03:28.746131 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.745940 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 01:03:28.746462 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.746446 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tnhb8\"" Jun 13 01:03:28.787078 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.787052 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qx6b\" (UniqueName: \"kubernetes.io/projected/43e5399e-5c2d-4272-b6bd-21845af1dd7e-kube-api-access-4qx6b\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.787230 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.787095 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43e5399e-5c2d-4272-b6bd-21845af1dd7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.787230 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.787183 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43e5399e-5c2d-4272-b6bd-21845af1dd7e-manifests\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.787299 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.787233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43e5399e-5c2d-4272-b6bd-21845af1dd7e-tmp\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.787299 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.787257 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43e5399e-5c2d-4272-b6bd-21845af1dd7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.887642 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.887607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43e5399e-5c2d-4272-b6bd-21845af1dd7e-tmp\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.887809 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.887647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43e5399e-5c2d-4272-b6bd-21845af1dd7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.887809 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.887673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qx6b\" (UniqueName: \"kubernetes.io/projected/43e5399e-5c2d-4272-b6bd-21845af1dd7e-kube-api-access-4qx6b\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.887809 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.887696 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43e5399e-5c2d-4272-b6bd-21845af1dd7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.887809 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.887726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43e5399e-5c2d-4272-b6bd-21845af1dd7e-manifests\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.888121 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.888092 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/43e5399e-5c2d-4272-b6bd-21845af1dd7e-manifests\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.889955 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.889929 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43e5399e-5c2d-4272-b6bd-21845af1dd7e-tmp\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.890195 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.890138 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/43e5399e-5c2d-4272-b6bd-21845af1dd7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.890296 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.890277 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43e5399e-5c2d-4272-b6bd-21845af1dd7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.898067 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.898043 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qx6b\" (UniqueName: \"kubernetes.io/projected/43e5399e-5c2d-4272-b6bd-21845af1dd7e-kube-api-access-4qx6b\") pod \"opendatahub-operator-controller-manager-c9cbf4b47-vnztv\" (UID: \"43e5399e-5c2d-4272-b6bd-21845af1dd7e\") " pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:28.992881 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:28.992841 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.054264 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.054227 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:29.109721 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.109684 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.200593 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.200566 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv"] Jun 13 01:03:29.202028 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:03:29.202003 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e5399e_5c2d_4272_b6bd_21845af1dd7e.slice/crio-ad6876472e75bb1c75390bdd582dc9f344267060bb7089280c29eba19380e679 WatchSource:0}: Error finding container ad6876472e75bb1c75390bdd582dc9f344267060bb7089280c29eba19380e679: Status 404 returned error can't find the container with id ad6876472e75bb1c75390bdd582dc9f344267060bb7089280c29eba19380e679 Jun 13 01:03:29.221543 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.221511 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.344159 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.344116 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.466041 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.465957 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.561478 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.561447 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.666820 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.666785 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.825605 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.825468 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:29.948433 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.948395 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" event={"ID":"43e5399e-5c2d-4272-b6bd-21845af1dd7e","Type":"ContainerStarted","Data":"ad6876472e75bb1c75390bdd582dc9f344267060bb7089280c29eba19380e679"} Jun 13 01:03:29.992592 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:29.992557 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:32.962631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:32.962593 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" event={"ID":"43e5399e-5c2d-4272-b6bd-21845af1dd7e","Type":"ContainerStarted","Data":"2fa36705d86417c139a2fa650d5b1e06233879f6fd4d08ff82d74f6fce6b731b"} Jun 13 01:03:33.968655 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:33.968619 2583 generic.go:356] "Generic (PLEG): container finished" podID="43e5399e-5c2d-4272-b6bd-21845af1dd7e" containerID="2fa36705d86417c139a2fa650d5b1e06233879f6fd4d08ff82d74f6fce6b731b" exitCode=0 Jun 13 01:03:33.969141 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:33.968709 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" event={"ID":"43e5399e-5c2d-4272-b6bd-21845af1dd7e","Type":"ContainerDied","Data":"2fa36705d86417c139a2fa650d5b1e06233879f6fd4d08ff82d74f6fce6b731b"} Jun 13 01:03:34.976649 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:34.976609 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" event={"ID":"43e5399e-5c2d-4272-b6bd-21845af1dd7e","Type":"ContainerStarted","Data":"3ecabed04dae90a37450bf4232bd6921230b83a0d1d5b819e85bfd02520cb1c2"} Jun 13 01:03:34.977073 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:34.976742 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:35.001562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:35.001503 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" podStartSLOduration=2.299073635 podStartE2EDuration="7.001481615s" totalImagesPullingTime="3.782485222s" totalInitContainerRuntime="919.922758ms" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:34.999450725 +0000 UTC m=+352.995363102" watchObservedRunningTime="2026-06-13 01:03:35.001481615 +0000 UTC m=+352.997393994" Jun 13 01:03:40.614830 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:40.614797 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:40.714544 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:40.714507 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:45.983933 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:45.983893 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c9cbf4b47-vnztv" Jun 13 01:03:49.474767 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:49.474729 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:49.670924 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:49.670878 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:49.969606 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:49.969573 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:50.304783 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.304690 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:50.380931 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.380898 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7"] Jun 13 01:03:50.389330 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.389303 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.399469 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.399452 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 01:03:50.400828 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.400809 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 01:03:50.401071 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.401055 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 01:03:50.402026 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.402007 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 01:03:50.402118 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.402014 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9cpsw\"" Jun 13 01:03:50.416972 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.416924 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7"] Jun 13 01:03:50.473489 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.473454 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-tls-certs\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.473489 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.473492 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwrrd\" (UniqueName: \"kubernetes.io/projected/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-kube-api-access-fwrrd\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.473727 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.473594 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-tmp\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.575045 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.574949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-tls-certs\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.575045 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.574985 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwrrd\" (UniqueName: \"kubernetes.io/projected/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-kube-api-access-fwrrd\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.575045 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.575041 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-tmp\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.577649 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.577620 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-tmp\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.577951 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.577922 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-tls-certs\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.603730 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.603696 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwrrd\" (UniqueName: \"kubernetes.io/projected/6be7f4d8-edc8-434b-87ee-ae7be7cd15ea-kube-api-access-fwrrd\") pod \"kube-auth-proxy-5bfb695fcc-qh5x7\" (UID: \"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea\") " pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.655205 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.655171 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:50.692648 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.692608 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4857f"] Jun 13 01:03:50.696053 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.696028 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:50.700941 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.700919 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 13 01:03:50.702050 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.702028 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" Jun 13 01:03:50.703791 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.703766 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jhjxz\"" Jun 13 01:03:50.736430 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.736398 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4857f"] Jun 13 01:03:50.776827 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.776794 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-cert\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:50.776965 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.776861 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrwm\" (UniqueName: \"kubernetes.io/projected/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-kube-api-access-ddrwm\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:50.865790 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.865756 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:50.877648 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.877584 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-cert\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:50.877648 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.877632 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrwm\" (UniqueName: \"kubernetes.io/projected/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-kube-api-access-ddrwm\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:50.878037 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:03:50.877908 2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 13 01:03:50.878037 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:03:50.878003 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-cert podName:d77ee9f5-cfb0-4167-8c1c-543c9e5b8724 nodeName:}" failed. No retries permitted until 2026-06-13 01:03:51.377981291 +0000 UTC m=+369.373893652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-cert") pod "odh-model-controller-6dc94f689f-4857f" (UID: "d77ee9f5-cfb0-4167-8c1c-543c9e5b8724") : secret "odh-model-controller-webhook-cert" not found Jun 13 01:03:50.879426 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.879403 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7"] Jun 13 01:03:50.880527 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:03:50.880506 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be7f4d8_edc8_434b_87ee_ae7be7cd15ea.slice/crio-5bd19b20c66ccc237bf092d335c5654ada097d737bd3b2fb457f7c3e227eb189 WatchSource:0}: Error finding container 5bd19b20c66ccc237bf092d335c5654ada097d737bd3b2fb457f7c3e227eb189: Status 404 returned error can't find the container with id 5bd19b20c66ccc237bf092d335c5654ada097d737bd3b2fb457f7c3e227eb189 Jun 13 01:03:50.892646 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:50.892617 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrwm\" (UniqueName: \"kubernetes.io/projected/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-kube-api-access-ddrwm\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:51.052873 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.052840 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" event={"ID":"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea","Type":"ContainerStarted","Data":"5bd19b20c66ccc237bf092d335c5654ada097d737bd3b2fb457f7c3e227eb189"} Jun 13 01:03:51.181224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.181098 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:51.373106 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.373068 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:51.383342 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.383317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-cert\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:51.386109 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.386082 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d77ee9f5-cfb0-4167-8c1c-543c9e5b8724-cert\") pod \"odh-model-controller-6dc94f689f-4857f\" (UID: \"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724\") " pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:51.608598 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.608277 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:51.827878 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:51.827844 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-4857f"] Jun 13 01:03:51.832539 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:03:51.830735 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77ee9f5_cfb0_4167_8c1c_543c9e5b8724.slice/crio-b4d51ac7b219f2fd0170552d28714e9ff297f3e0e4ade10219e7dc4e3b0a371d WatchSource:0}: Error finding container b4d51ac7b219f2fd0170552d28714e9ff297f3e0e4ade10219e7dc4e3b0a371d: Status 404 returned error can't find the container with id b4d51ac7b219f2fd0170552d28714e9ff297f3e0e4ade10219e7dc4e3b0a371d Jun 13 01:03:52.008217 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.008121 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r"] Jun 13 01:03:52.013190 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.013162 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.033374 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.033343 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m6kw\"" Jun 13 01:03:52.033512 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.033496 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:03:52.041800 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.041777 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:03:52.063979 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.063946 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" event={"ID":"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724","Type":"ContainerStarted","Data":"b4d51ac7b219f2fd0170552d28714e9ff297f3e0e4ade10219e7dc4e3b0a371d"} Jun 13 01:03:52.088110 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.088080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2cjr\" (UniqueName: \"kubernetes.io/projected/f53be357-f1de-4563-bebb-a42c13c9723e-kube-api-access-k2cjr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.088308 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.088224 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.088308 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.088257 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.187818 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.187777 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r"] Jun 13 01:03:52.189323 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.189290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2cjr\" (UniqueName: \"kubernetes.io/projected/f53be357-f1de-4563-bebb-a42c13c9723e-kube-api-access-k2cjr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.189469 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.189406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.189469 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.189435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.190416 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.189814 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.190416 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.190366 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.226443 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.226410 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2cjr\" (UniqueName: \"kubernetes.io/projected/f53be357-f1de-4563-bebb-a42c13c9723e-kube-api-access-k2cjr\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.294237 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.294075 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:52.325369 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.325332 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:03:52.583170 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.583108 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r"] Jun 13 01:03:52.710217 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:52.710137 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:03:54.317797 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:03:54.317761 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53be357_f1de_4563_bebb_a42c13c9723e.slice/crio-e56b10e04ca7ded4bb123a6769ecd5ee2c499460cb04fd379ae3922ec85826c0 WatchSource:0}: Error finding container e56b10e04ca7ded4bb123a6769ecd5ee2c499460cb04fd379ae3922ec85826c0: Status 404 returned error can't find the container with id e56b10e04ca7ded4bb123a6769ecd5ee2c499460cb04fd379ae3922ec85826c0 Jun 13 01:03:55.084789 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:55.084746 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" event={"ID":"f53be357-f1de-4563-bebb-a42c13c9723e","Type":"ContainerStarted","Data":"e56b10e04ca7ded4bb123a6769ecd5ee2c499460cb04fd379ae3922ec85826c0"} Jun 13 01:03:56.091781 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:56.091740 2583 generic.go:356] "Generic (PLEG): container finished" podID="f53be357-f1de-4563-bebb-a42c13c9723e" containerID="8ab058f001d71599f5e4ecd0ff30513daaf56161015d280e25f94f93edb7fe4e" exitCode=0 Jun 13 01:03:56.092274 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:56.091821 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" event={"ID":"f53be357-f1de-4563-bebb-a42c13c9723e","Type":"ContainerDied","Data":"8ab058f001d71599f5e4ecd0ff30513daaf56161015d280e25f94f93edb7fe4e"} Jun 13 01:03:56.094211 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:56.094184 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" event={"ID":"d77ee9f5-cfb0-4167-8c1c-543c9e5b8724","Type":"ContainerStarted","Data":"5e80d3c3416f77ee986eb114e9ffc83e00dd20c71798d950a641b65ecd6a97cb"} Jun 13 01:03:56.094319 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:56.094239 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:03:56.095909 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:56.095887 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" event={"ID":"6be7f4d8-edc8-434b-87ee-ae7be7cd15ea","Type":"ContainerStarted","Data":"247cacf781a16eb98c190a84e293d018907d1cd28533371ce42b23506a9c9851"} Jun 13 01:03:56.173677 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:56.173610 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bfb695fcc-qh5x7" podStartSLOduration=1.479652745 podStartE2EDuration="6.173592235s" totalImagesPullingTime="4.69393949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:56.17280991 +0000 UTC m=+374.168722305" watchObservedRunningTime="2026-06-13 01:03:56.173592235 +0000 UTC m=+374.169504612" Jun 13 01:03:58.107738 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:58.107696 2583 generic.go:356] "Generic (PLEG): container finished" podID="f53be357-f1de-4563-bebb-a42c13c9723e" containerID="ff4f9cb5b23eaffc5cde3890327af670ab4d0158c6fd385bf9127bc46735b0ae" exitCode=0 Jun 13 01:03:58.108118 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:58.107776 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" event={"ID":"f53be357-f1de-4563-bebb-a42c13c9723e","Type":"ContainerDied","Data":"ff4f9cb5b23eaffc5cde3890327af670ab4d0158c6fd385bf9127bc46735b0ae"} Jun 13 01:03:58.235286 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:58.235235 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" podStartSLOduration=4.45211199 podStartE2EDuration="8.235218035s" totalImagesPullingTime="3.783106045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:03:56.217801393 +0000 UTC m=+374.213713770" watchObservedRunningTime="2026-06-13 01:03:58.235218035 +0000 UTC m=+376.231130443" Jun 13 01:03:59.115433 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:59.115170 2583 generic.go:356] "Generic (PLEG): container finished" podID="f53be357-f1de-4563-bebb-a42c13c9723e" containerID="b3aab9af99d69095a4f782b994ffff55f7291030fcdc9c1f2828400c9c07e7cd" exitCode=0 Jun 13 01:03:59.115433 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:03:59.115298 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" event={"ID":"f53be357-f1de-4563-bebb-a42c13c9723e","Type":"ContainerDied","Data":"b3aab9af99d69095a4f782b994ffff55f7291030fcdc9c1f2828400c9c07e7cd"} Jun 13 01:04:00.256459 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.256433 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:04:00.367543 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.367505 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-util\") pod \"f53be357-f1de-4563-bebb-a42c13c9723e\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " Jun 13 01:04:00.367715 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.367554 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2cjr\" (UniqueName: \"kubernetes.io/projected/f53be357-f1de-4563-bebb-a42c13c9723e-kube-api-access-k2cjr\") pod \"f53be357-f1de-4563-bebb-a42c13c9723e\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " Jun 13 01:04:00.367715 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.367603 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-bundle\") pod \"f53be357-f1de-4563-bebb-a42c13c9723e\" (UID: \"f53be357-f1de-4563-bebb-a42c13c9723e\") " Jun 13 01:04:00.368544 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.368518 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-bundle" (OuterVolumeSpecName: "bundle") pod "f53be357-f1de-4563-bebb-a42c13c9723e" (UID: "f53be357-f1de-4563-bebb-a42c13c9723e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:04:00.369852 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.369808 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53be357-f1de-4563-bebb-a42c13c9723e-kube-api-access-k2cjr" (OuterVolumeSpecName: "kube-api-access-k2cjr") pod "f53be357-f1de-4563-bebb-a42c13c9723e" (UID: "f53be357-f1de-4563-bebb-a42c13c9723e"). InnerVolumeSpecName "kube-api-access-k2cjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:04:00.372866 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.372844 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-util" (OuterVolumeSpecName: "util") pod "f53be357-f1de-4563-bebb-a42c13c9723e" (UID: "f53be357-f1de-4563-bebb-a42c13c9723e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:04:00.468899 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.468865 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:04:00.468899 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.468893 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2cjr\" (UniqueName: \"kubernetes.io/projected/f53be357-f1de-4563-bebb-a42c13c9723e-kube-api-access-k2cjr\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:04:00.468899 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:00.468905 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f53be357-f1de-4563-bebb-a42c13c9723e-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:04:01.126422 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:01.126384 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" event={"ID":"f53be357-f1de-4563-bebb-a42c13c9723e","Type":"ContainerDied","Data":"e56b10e04ca7ded4bb123a6769ecd5ee2c499460cb04fd379ae3922ec85826c0"} Jun 13 01:04:01.126422 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:01.126424 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06c9m5r" Jun 13 01:04:01.126656 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:01.126430 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e56b10e04ca7ded4bb123a6769ecd5ee2c499460cb04fd379ae3922ec85826c0" Jun 13 01:04:02.369445 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.369410 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:02.441490 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441456 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xpswd"] Jun 13 01:04:02.441787 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441774 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="util" Jun 13 01:04:02.441837 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441788 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="util" Jun 13 01:04:02.441837 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441805 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="pull" Jun 13 01:04:02.441837 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441810 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="pull" Jun 13 01:04:02.441837 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441821 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="extract" Jun 13 01:04:02.441837 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441826 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="extract" Jun 13 01:04:02.441987 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.441877 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53be357-f1de-4563-bebb-a42c13c9723e" containerName="extract" Jun 13 01:04:02.445064 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.445043 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.447893 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.447870 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv"] Jun 13 01:04:02.448797 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.448776 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xmrc9\"" Jun 13 01:04:02.449044 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.449019 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 13 01:04:02.450829 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.450809 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.453319 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.453301 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4wnns\"" Jun 13 01:04:02.454039 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.454022 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 13 01:04:02.472207 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.472182 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xpswd"] Jun 13 01:04:02.474024 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.473996 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv"] Jun 13 01:04:02.496409 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.496366 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:02.589064 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.589024 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9lqk\" (UniqueName: \"kubernetes.io/projected/ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9-kube-api-access-k9lqk\") pod \"kserve-controller-manager-69fc866d76-xpswd\" (UID: \"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.589064 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.589063 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52af57b3-4de5-4f96-a346-c20aec1538c9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-c9xnv\" (UID: \"52af57b3-4de5-4f96-a346-c20aec1538c9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.589258 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.589092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9-cert\") pod \"kserve-controller-manager-69fc866d76-xpswd\" (UID: \"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.589258 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.589229 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8z97\" (UniqueName: \"kubernetes.io/projected/52af57b3-4de5-4f96-a346-c20aec1538c9-kube-api-access-z8z97\") pod \"llmisvc-controller-manager-864bfd7bc9-c9xnv\" (UID: \"52af57b3-4de5-4f96-a346-c20aec1538c9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.622380 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.622284 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:02.689947 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.689903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9lqk\" (UniqueName: \"kubernetes.io/projected/ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9-kube-api-access-k9lqk\") pod \"kserve-controller-manager-69fc866d76-xpswd\" (UID: \"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.690127 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.689958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52af57b3-4de5-4f96-a346-c20aec1538c9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-c9xnv\" (UID: \"52af57b3-4de5-4f96-a346-c20aec1538c9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.690127 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.689985 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9-cert\") pod \"kserve-controller-manager-69fc866d76-xpswd\" (UID: \"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.690127 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.690043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8z97\" (UniqueName: \"kubernetes.io/projected/52af57b3-4de5-4f96-a346-c20aec1538c9-kube-api-access-z8z97\") pod \"llmisvc-controller-manager-864bfd7bc9-c9xnv\" (UID: \"52af57b3-4de5-4f96-a346-c20aec1538c9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.692516 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.692492 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9-cert\") pod \"kserve-controller-manager-69fc866d76-xpswd\" (UID: \"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.692666 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.692645 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52af57b3-4de5-4f96-a346-c20aec1538c9-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-c9xnv\" (UID: \"52af57b3-4de5-4f96-a346-c20aec1538c9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.704374 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.704346 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9lqk\" (UniqueName: \"kubernetes.io/projected/ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9-kube-api-access-k9lqk\") pod \"kserve-controller-manager-69fc866d76-xpswd\" (UID: \"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.708832 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.708808 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8z97\" (UniqueName: \"kubernetes.io/projected/52af57b3-4de5-4f96-a346-c20aec1538c9-kube-api-access-z8z97\") pod \"llmisvc-controller-manager-864bfd7bc9-c9xnv\" (UID: \"52af57b3-4de5-4f96-a346-c20aec1538c9\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.755937 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.755897 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:02.762591 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.762571 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:02.782903 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.782874 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:02.910739 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.910667 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xpswd"] Jun 13 01:04:02.916061 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:04:02.916037 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2407b2_824f_4f1d_8a3f_c9b32b2de9a9.slice/crio-ddf426b1c8eb2f34b51c3628971b99121790816740873927707d8b250d826d07 WatchSource:0}: Error finding container ddf426b1c8eb2f34b51c3628971b99121790816740873927707d8b250d826d07: Status 404 returned error can't find the container with id ddf426b1c8eb2f34b51c3628971b99121790816740873927707d8b250d826d07 Jun 13 01:04:02.923212 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.923181 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:02.936402 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:02.936378 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv"] Jun 13 01:04:02.937082 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:04:02.937055 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod52af57b3_4de5_4f96_a346_c20aec1538c9.slice/crio-9e911bd894a232d7fb5e4c66d89698204d257a47ea562a24e614ed77b630b283 WatchSource:0}: Error finding container 9e911bd894a232d7fb5e4c66d89698204d257a47ea562a24e614ed77b630b283: Status 404 returned error can't find the container with id 9e911bd894a232d7fb5e4c66d89698204d257a47ea562a24e614ed77b630b283 Jun 13 01:04:03.083232 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:03.083185 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:03.137731 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:03.137693 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" event={"ID":"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9","Type":"ContainerStarted","Data":"ddf426b1c8eb2f34b51c3628971b99121790816740873927707d8b250d826d07"} Jun 13 01:04:03.138943 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:03.138922 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" event={"ID":"52af57b3-4de5-4f96-a346-c20aec1538c9","Type":"ContainerStarted","Data":"9e911bd894a232d7fb5e4c66d89698204d257a47ea562a24e614ed77b630b283"} Jun 13 01:04:06.157004 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:06.156971 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" event={"ID":"ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9","Type":"ContainerStarted","Data":"094e21b9ed1ff03572742f29270e141daedc1f8b13ca0f9eca70e0dc9b135ab6"} Jun 13 01:04:06.157420 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:06.157082 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:06.176416 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:06.176370 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" podStartSLOduration=1.367913164 podStartE2EDuration="4.176354994s" totalImagesPullingTime="2.80844183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:06.174412638 +0000 UTC m=+384.170325016" watchObservedRunningTime="2026-06-13 01:04:06.176354994 +0000 UTC m=+384.172267372" Jun 13 01:04:07.103876 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:07.103801 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-4857f" Jun 13 01:04:07.164979 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:07.164939 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" event={"ID":"52af57b3-4de5-4f96-a346-c20aec1538c9","Type":"ContainerStarted","Data":"5ae0acd8f6967e085af4dd938c864007f4d93dd26bb5f18c980064de83178ecf"} Jun 13 01:04:07.165429 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:07.165030 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:07.189036 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:07.188986 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" podStartSLOduration=1.32824935 podStartE2EDuration="5.188970904s" totalImagesPullingTime="3.860721554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:07.18758478 +0000 UTC m=+385.183497186" watchObservedRunningTime="2026-06-13 01:04:07.188970904 +0000 UTC m=+385.184883281" Jun 13 01:04:12.677199 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:12.677142 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:12.786928 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:12.786884 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:13.913366 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:13.913334 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:14.065759 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.065730 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2"] Jun 13 01:04:14.068336 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.068321 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.072857 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.072834 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m6kw\"" Jun 13 01:04:14.073763 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.073743 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:04:14.074029 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.074007 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:04:14.086592 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.086568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.086710 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.086652 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.086710 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.086674 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nslln\" (UniqueName: \"kubernetes.io/projected/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-kube-api-access-nslln\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.092456 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.092434 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2"] Jun 13 01:04:14.116186 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.116140 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:14.187162 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.187066 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.187300 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.187173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.187300 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.187207 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslln\" (UniqueName: \"kubernetes.io/projected/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-kube-api-access-nslln\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.187477 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.187460 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.187524 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.187507 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.207598 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.207562 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nslln\" (UniqueName: \"kubernetes.io/projected/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-kube-api-access-nslln\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.327814 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.327775 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:14.377864 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.377815 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:14.556304 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.556273 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2"] Jun 13 01:04:14.557721 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:04:14.557698 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b546a77_2f93_4b68_b95e_4dcc89fe8afd.slice/crio-4c17602e684ddd32552fe28616611f7842cb6bea2c688a88cf955f6702b87981 WatchSource:0}: Error finding container 4c17602e684ddd32552fe28616611f7842cb6bea2c688a88cf955f6702b87981: Status 404 returned error can't find the container with id 4c17602e684ddd32552fe28616611f7842cb6bea2c688a88cf955f6702b87981 Jun 13 01:04:14.635238 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.635190 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:14.902867 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:14.902831 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:15.031346 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.031313 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-88ksm"] Jun 13 01:04:15.033601 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.033585 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.036888 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.036864 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 13 01:04:15.037405 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.037380 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 13 01:04:15.037513 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.037413 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qzh29\"" Jun 13 01:04:15.051929 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.051899 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-88ksm"] Jun 13 01:04:15.095298 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.095254 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b06c848f-1766-448b-830b-39fe18cf71d7-operator-config\") pod \"servicemesh-operator3-57f65f65fb-88ksm\" (UID: \"b06c848f-1766-448b-830b-39fe18cf71d7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.095470 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.095325 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6lf\" (UniqueName: \"kubernetes.io/projected/b06c848f-1766-448b-830b-39fe18cf71d7-kube-api-access-sg6lf\") pod \"servicemesh-operator3-57f65f65fb-88ksm\" (UID: \"b06c848f-1766-448b-830b-39fe18cf71d7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.196524 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.196427 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b06c848f-1766-448b-830b-39fe18cf71d7-operator-config\") pod \"servicemesh-operator3-57f65f65fb-88ksm\" (UID: \"b06c848f-1766-448b-830b-39fe18cf71d7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.196524 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.196487 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6lf\" (UniqueName: \"kubernetes.io/projected/b06c848f-1766-448b-830b-39fe18cf71d7-kube-api-access-sg6lf\") pod \"servicemesh-operator3-57f65f65fb-88ksm\" (UID: \"b06c848f-1766-448b-830b-39fe18cf71d7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.199371 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.199345 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b06c848f-1766-448b-830b-39fe18cf71d7-operator-config\") pod \"servicemesh-operator3-57f65f65fb-88ksm\" (UID: \"b06c848f-1766-448b-830b-39fe18cf71d7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.204178 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.204132 2583 generic.go:356] "Generic (PLEG): container finished" podID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerID="8bb2b2f1edbe11af45941c6abc3f8231fcf1a927897e1c74a04ef6097ae4130c" exitCode=0 Jun 13 01:04:15.204284 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.204190 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" event={"ID":"2b546a77-2f93-4b68-b95e-4dcc89fe8afd","Type":"ContainerDied","Data":"8bb2b2f1edbe11af45941c6abc3f8231fcf1a927897e1c74a04ef6097ae4130c"} Jun 13 01:04:15.204284 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.204252 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" event={"ID":"2b546a77-2f93-4b68-b95e-4dcc89fe8afd","Type":"ContainerStarted","Data":"4c17602e684ddd32552fe28616611f7842cb6bea2c688a88cf955f6702b87981"} Jun 13 01:04:15.207105 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.207084 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6lf\" (UniqueName: \"kubernetes.io/projected/b06c848f-1766-448b-830b-39fe18cf71d7-kube-api-access-sg6lf\") pod \"servicemesh-operator3-57f65f65fb-88ksm\" (UID: \"b06c848f-1766-448b-830b-39fe18cf71d7\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.343329 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.343296 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:15.486349 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:15.486263 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-88ksm"] Jun 13 01:04:16.211283 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:16.211248 2583 generic.go:356] "Generic (PLEG): container finished" podID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerID="04c4f4ed04c9671151d41d86e557c76909cd39350dffdbc739d6737dac368692" exitCode=0 Jun 13 01:04:16.211738 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:16.211328 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" event={"ID":"2b546a77-2f93-4b68-b95e-4dcc89fe8afd","Type":"ContainerDied","Data":"04c4f4ed04c9671151d41d86e557c76909cd39350dffdbc739d6737dac368692"} Jun 13 01:04:16.213766 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:16.213267 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" event={"ID":"b06c848f-1766-448b-830b-39fe18cf71d7","Type":"ContainerStarted","Data":"e9f7aeae3827e52470c372945549f8e29735f508b2211ce3612de58277ccd8ed"} Jun 13 01:04:17.225070 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:17.225031 2583 generic.go:356] "Generic (PLEG): container finished" podID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerID="bf4d9e64d8d6544a37e206a5846d3ce521a0dd102a5415649ed32302dc4d7266" exitCode=0 Jun 13 01:04:17.225549 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:17.225092 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" event={"ID":"2b546a77-2f93-4b68-b95e-4dcc89fe8afd","Type":"ContainerDied","Data":"bf4d9e64d8d6544a37e206a5846d3ce521a0dd102a5415649ed32302dc4d7266"} Jun 13 01:04:18.232422 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.232378 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" event={"ID":"b06c848f-1766-448b-830b-39fe18cf71d7","Type":"ContainerStarted","Data":"1a0ceb68c62123141c5ad785d7b8107d5cd166d0c603b97b603fa66b6a3888d3"} Jun 13 01:04:18.232850 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.232687 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:18.264476 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.264408 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" podStartSLOduration=1.603427086 podStartE2EDuration="4.264385518s" totalImagesPullingTime="2.660958432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:18.260611421 +0000 UTC m=+396.256523802" watchObservedRunningTime="2026-06-13 01:04:18.264385518 +0000 UTC m=+396.260297897" Jun 13 01:04:18.389519 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.389488 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:18.430268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.426911 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-bundle\") pod \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " Jun 13 01:04:18.430268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.426986 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nslln\" (UniqueName: \"kubernetes.io/projected/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-kube-api-access-nslln\") pod \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " Jun 13 01:04:18.430268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.427071 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-util\") pod \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\" (UID: \"2b546a77-2f93-4b68-b95e-4dcc89fe8afd\") " Jun 13 01:04:18.430268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.428839 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-bundle" (OuterVolumeSpecName: "bundle") pod "2b546a77-2f93-4b68-b95e-4dcc89fe8afd" (UID: "2b546a77-2f93-4b68-b95e-4dcc89fe8afd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:04:18.431579 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.431538 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-kube-api-access-nslln" (OuterVolumeSpecName: "kube-api-access-nslln") pod "2b546a77-2f93-4b68-b95e-4dcc89fe8afd" (UID: "2b546a77-2f93-4b68-b95e-4dcc89fe8afd"). InnerVolumeSpecName "kube-api-access-nslln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:04:18.437622 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.437593 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-util" (OuterVolumeSpecName: "util") pod "2b546a77-2f93-4b68-b95e-4dcc89fe8afd" (UID: "2b546a77-2f93-4b68-b95e-4dcc89fe8afd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:04:18.527755 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.527717 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:04:18.527755 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.527748 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nslln\" (UniqueName: \"kubernetes.io/projected/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-kube-api-access-nslln\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:04:18.527755 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:18.527758 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b546a77-2f93-4b68-b95e-4dcc89fe8afd-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:04:19.239446 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:19.239415 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" Jun 13 01:04:19.239446 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:19.239434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ap9fb2" event={"ID":"2b546a77-2f93-4b68-b95e-4dcc89fe8afd","Type":"ContainerDied","Data":"4c17602e684ddd32552fe28616611f7842cb6bea2c688a88cf955f6702b87981"} Jun 13 01:04:19.239902 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:19.239485 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c17602e684ddd32552fe28616611f7842cb6bea2c688a88cf955f6702b87981" Jun 13 01:04:24.873066 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:24.873030 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:24.984850 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:24.984817 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:26.231166 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231112 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs"] Jun 13 01:04:26.231523 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231450 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="extract" Jun 13 01:04:26.231523 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231462 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="extract" Jun 13 01:04:26.231523 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231482 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="pull" Jun 13 01:04:26.231523 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231487 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="pull" Jun 13 01:04:26.231523 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231500 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="util" Jun 13 01:04:26.231523 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231506 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="util" Jun 13 01:04:26.231713 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.231552 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b546a77-2f93-4b68-b95e-4dcc89fe8afd" containerName="extract" Jun 13 01:04:26.235713 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.235695 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.239344 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.239327 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4vfq4\"" Jun 13 01:04:26.240416 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.240401 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 13 01:04:26.260129 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.260105 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs"] Jun 13 01:04:26.291549 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.291517 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a28c186d-9942-42a3-8f59-e39ae66a97d9-redirect-config\") pod \"dashboard-redirect-66bcf5d7d8-bhgxs\" (UID: \"a28c186d-9942-42a3-8f59-e39ae66a97d9\") " pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.291706 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.291561 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgh57\" (UniqueName: \"kubernetes.io/projected/a28c186d-9942-42a3-8f59-e39ae66a97d9-kube-api-access-xgh57\") pod \"dashboard-redirect-66bcf5d7d8-bhgxs\" (UID: \"a28c186d-9942-42a3-8f59-e39ae66a97d9\") " pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.317866 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.317826 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:26.393027 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.392987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a28c186d-9942-42a3-8f59-e39ae66a97d9-redirect-config\") pod \"dashboard-redirect-66bcf5d7d8-bhgxs\" (UID: \"a28c186d-9942-42a3-8f59-e39ae66a97d9\") " pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.393247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.393051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgh57\" (UniqueName: \"kubernetes.io/projected/a28c186d-9942-42a3-8f59-e39ae66a97d9-kube-api-access-xgh57\") pod \"dashboard-redirect-66bcf5d7d8-bhgxs\" (UID: \"a28c186d-9942-42a3-8f59-e39ae66a97d9\") " pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.393738 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.393713 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a28c186d-9942-42a3-8f59-e39ae66a97d9-redirect-config\") pod \"dashboard-redirect-66bcf5d7d8-bhgxs\" (UID: \"a28c186d-9942-42a3-8f59-e39ae66a97d9\") " pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.404106 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.404081 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgh57\" (UniqueName: \"kubernetes.io/projected/a28c186d-9942-42a3-8f59-e39ae66a97d9-kube-api-access-xgh57\") pod \"dashboard-redirect-66bcf5d7d8-bhgxs\" (UID: \"a28c186d-9942-42a3-8f59-e39ae66a97d9\") " pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.545505 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.545427 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" Jun 13 01:04:26.684138 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:26.684101 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs"] Jun 13 01:04:26.686427 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:04:26.686400 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28c186d_9942_42a3_8f59_e39ae66a97d9.slice/crio-851381ed125953716af252024ad271b533f8ad260718f8825cd17e750fa8bbb6 WatchSource:0}: Error finding container 851381ed125953716af252024ad271b533f8ad260718f8825cd17e750fa8bbb6: Status 404 returned error can't find the container with id 851381ed125953716af252024ad271b533f8ad260718f8825cd17e750fa8bbb6 Jun 13 01:04:27.287125 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:27.287088 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" event={"ID":"a28c186d-9942-42a3-8f59-e39ae66a97d9","Type":"ContainerStarted","Data":"851381ed125953716af252024ad271b533f8ad260718f8825cd17e750fa8bbb6"} Jun 13 01:04:29.242013 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:29.241980 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-88ksm" Jun 13 01:04:29.474930 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:29.474888 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:30.308244 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:30.308206 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" event={"ID":"a28c186d-9942-42a3-8f59-e39ae66a97d9","Type":"ContainerStarted","Data":"407ea2bb3a57dcd40cf25199ae5098ece4539824848c34b78c586b9d665acce0"} Jun 13 01:04:30.344243 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:30.344193 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-66bcf5d7d8-bhgxs" podStartSLOduration=1.7189321039999998 podStartE2EDuration="4.344179037s" totalImagesPullingTime="2.625246933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:30.341409257 +0000 UTC m=+408.337321635" watchObservedRunningTime="2026-06-13 01:04:30.344179037 +0000 UTC m=+408.340091407" Jun 13 01:04:37.170286 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:37.170241 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-xpswd" Jun 13 01:04:38.172443 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:38.172413 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-c9xnv" Jun 13 01:04:39.712327 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.712278 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz"] Jun 13 01:04:39.713369 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.713344 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:39.717720 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.717700 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.721710 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.721687 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 13 01:04:39.721835 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.721730 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 13 01:04:39.721953 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.721939 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 13 01:04:39.722041 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.721972 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fxxct\"" Jun 13 01:04:39.722253 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.722231 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 13 01:04:39.739772 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.739742 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz"] Jun 13 01:04:39.813590 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813547 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.813742 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813596 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.813742 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813660 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.813742 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813679 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.813844 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813762 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.813844 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813802 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.813844 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.813829 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqqm\" (UniqueName: \"kubernetes.io/projected/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-kube-api-access-nwqqm\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.825490 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.825428 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:39.915045 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.914986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915118 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915144 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915233 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915478 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915478 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915303 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqqm\" (UniqueName: \"kubernetes.io/projected/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-kube-api-access-nwqqm\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.915942 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.915887 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.917677 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.917652 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.917812 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.917786 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.918106 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.918088 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.918212 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.918141 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.924952 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.924928 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqqm\" (UniqueName: \"kubernetes.io/projected/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-kube-api-access-nwqqm\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:39.926959 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:39.926937 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ddd70c-11b8-4a3e-86c0-a7508ac284a8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-w6tgz\" (UID: \"02ddd70c-11b8-4a3e-86c0-a7508ac284a8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:40.027464 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:40.027370 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:40.196575 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:40.196545 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz"] Jun 13 01:04:40.198565 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:04:40.198540 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ddd70c_11b8_4a3e_86c0_a7508ac284a8.slice/crio-76295c2f72f40ba3f5d50c6ea0e2eb8126a0202e09eb8830229dd33310db7afb WatchSource:0}: Error finding container 76295c2f72f40ba3f5d50c6ea0e2eb8126a0202e09eb8830229dd33310db7afb: Status 404 returned error can't find the container with id 76295c2f72f40ba3f5d50c6ea0e2eb8126a0202e09eb8830229dd33310db7afb Jun 13 01:04:40.359049 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:40.359015 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" event={"ID":"02ddd70c-11b8-4a3e-86c0-a7508ac284a8","Type":"ContainerStarted","Data":"76295c2f72f40ba3f5d50c6ea0e2eb8126a0202e09eb8830229dd33310db7afb"} Jun 13 01:04:40.395314 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:40.395278 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:42.967266 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:42.967218 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 13 01:04:42.967526 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:42.967312 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 13 01:04:43.378602 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:43.378567 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" event={"ID":"02ddd70c-11b8-4a3e-86c0-a7508ac284a8","Type":"ContainerStarted","Data":"0b20731b78328634f0ef107298296bc6b7bc981f7c29e3c2d33ef7f1ec5d03b3"} Jun 13 01:04:43.378777 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:43.378676 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:43.980839 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:43.980791 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:44.089509 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:44.089480 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:44.277403 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:44.277312 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:44.385776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:44.385743 2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-w6tgz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 13 01:04:44.385948 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:44.385798 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" podUID="02ddd70c-11b8-4a3e-86c0-a7508ac284a8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:04:44.483102 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:44.483071 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:44.709055 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:44.709016 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:47.385116 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:47.385081 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" Jun 13 01:04:47.409554 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:47.409500 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-w6tgz" podStartSLOduration=5.643474049 podStartE2EDuration="8.409467273s" totalImagesPullingTime="2.765993224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:43.403736899 +0000 UTC m=+421.399649278" watchObservedRunningTime="2026-06-13 01:04:47.409467273 +0000 UTC m=+425.405379652" Jun 13 01:04:48.738328 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:48.738276 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:51.010781 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.010746 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:51.115267 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.115230 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:51.176542 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.176514 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:51.693520 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.693491 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f67x8"] Jun 13 01:04:51.699731 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.699708 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:04:51.702757 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.702729 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 01:04:51.702933 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.702912 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xfz79\"" Jun 13 01:04:51.703000 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.702912 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 01:04:51.704305 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.704284 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f67x8"] Jun 13 01:04:51.822187 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.822129 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqdkp\" (UniqueName: \"kubernetes.io/projected/a58922dd-3153-4817-86e5-0af634c289e3-kube-api-access-jqdkp\") pod \"kuadrant-operator-catalog-f67x8\" (UID: \"a58922dd-3153-4817-86e5-0af634c289e3\") " pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:04:51.918678 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.918645 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:51.922787 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.922765 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqdkp\" (UniqueName: \"kubernetes.io/projected/a58922dd-3153-4817-86e5-0af634c289e3-kube-api-access-jqdkp\") pod \"kuadrant-operator-catalog-f67x8\" (UID: \"a58922dd-3153-4817-86e5-0af634c289e3\") " pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:04:51.932332 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:51.932310 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqdkp\" (UniqueName: \"kubernetes.io/projected/a58922dd-3153-4817-86e5-0af634c289e3-kube-api-access-jqdkp\") pod \"kuadrant-operator-catalog-f67x8\" (UID: \"a58922dd-3153-4817-86e5-0af634c289e3\") " pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:04:52.009889 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:52.009816 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:04:52.123002 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:52.122943 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:04:52.168388 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:52.168356 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f67x8"] Jun 13 01:04:52.171740 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:04:52.171700 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58922dd_3153_4817_86e5_0af634c289e3.slice/crio-6eb85c6ad8a2df25bd871275eb30c7290555522809dc8608c98344ab3808345f WatchSource:0}: Error finding container 6eb85c6ad8a2df25bd871275eb30c7290555522809dc8608c98344ab3808345f: Status 404 returned error can't find the container with id 6eb85c6ad8a2df25bd871275eb30c7290555522809dc8608c98344ab3808345f Jun 13 01:04:52.436220 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:52.436177 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" event={"ID":"a58922dd-3153-4817-86e5-0af634c289e3","Type":"ContainerStarted","Data":"6eb85c6ad8a2df25bd871275eb30c7290555522809dc8608c98344ab3808345f"} Jun 13 01:04:54.448685 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:54.448652 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" event={"ID":"a58922dd-3153-4817-86e5-0af634c289e3","Type":"ContainerStarted","Data":"751a046233670bd0001daba2a793c80ddd86aa3c19b97f5795a92c99ece21a66"} Jun 13 01:04:54.467774 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:04:54.467165 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" podStartSLOduration=1.2945624470000001 podStartE2EDuration="3.467124199s" totalImagesPullingTime="2.172561752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:04:54.466845833 +0000 UTC m=+432.462758214" watchObservedRunningTime="2026-06-13 01:04:54.467124199 +0000 UTC m=+432.463036580" Jun 13 01:05:02.010596 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:02.010494 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:05:02.010596 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:02.010578 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:05:02.033032 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:02.033005 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:05:02.508195 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:02.508165 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-f67x8" Jun 13 01:05:06.935555 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.935517 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6"] Jun 13 01:05:06.947783 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.947758 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:06.947928 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.947761 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6"] Jun 13 01:05:06.950507 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.950484 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-24j8d\"" Jun 13 01:05:06.954283 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.954261 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmlj\" (UniqueName: \"kubernetes.io/projected/18df5517-aba3-4b79-9f1b-38be2045bb6d-kube-api-access-czmlj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:06.954387 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.954327 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:06.954387 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:06.954362 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.054870 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.054830 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.055056 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.054901 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.055056 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.054934 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmlj\" (UniqueName: \"kubernetes.io/projected/18df5517-aba3-4b79-9f1b-38be2045bb6d-kube-api-access-czmlj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.055394 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.055369 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.055443 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.055396 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.064913 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.064890 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmlj\" (UniqueName: \"kubernetes.io/projected/18df5517-aba3-4b79-9f1b-38be2045bb6d-kube-api-access-czmlj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.260395 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.260307 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:07.404001 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.403975 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6"] Jun 13 01:05:07.406477 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:07.406441 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18df5517_aba3_4b79_9f1b_38be2045bb6d.slice/crio-5891fb8bdab11867a44a81c26057fc6910c545ff9db813eb14d56fe48e70369e WatchSource:0}: Error finding container 5891fb8bdab11867a44a81c26057fc6910c545ff9db813eb14d56fe48e70369e: Status 404 returned error can't find the container with id 5891fb8bdab11867a44a81c26057fc6910c545ff9db813eb14d56fe48e70369e Jun 13 01:05:07.408780 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.408759 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc"] Jun 13 01:05:07.413784 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.413762 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.423493 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.423466 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc"] Jun 13 01:05:07.457328 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.457295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsrp5\" (UniqueName: \"kubernetes.io/projected/e35b566d-df1f-48a6-8bfa-e4487866b7fe-kube-api-access-zsrp5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.457464 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.457338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.457464 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.457369 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.510713 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.510635 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" event={"ID":"18df5517-aba3-4b79-9f1b-38be2045bb6d","Type":"ContainerStarted","Data":"3b946bc8446ee4da8d3aaa2efe8e08701073870ecbdee469a4e3e231216739ac"} Jun 13 01:05:07.510713 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.510684 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" event={"ID":"18df5517-aba3-4b79-9f1b-38be2045bb6d","Type":"ContainerStarted","Data":"5891fb8bdab11867a44a81c26057fc6910c545ff9db813eb14d56fe48e70369e"} Jun 13 01:05:07.558614 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.558583 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsrp5\" (UniqueName: \"kubernetes.io/projected/e35b566d-df1f-48a6-8bfa-e4487866b7fe-kube-api-access-zsrp5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.558800 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.558625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.558800 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.558685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.559107 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.559083 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.559226 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.559115 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.569247 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.569224 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsrp5\" (UniqueName: \"kubernetes.io/projected/e35b566d-df1f-48a6-8bfa-e4487866b7fe-kube-api-access-zsrp5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.724742 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.724710 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:07.764181 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.764088 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm"] Jun 13 01:05:07.768330 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.768305 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.780891 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.780863 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm"] Jun 13 01:05:07.861099 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.861070 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.861268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.861104 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvh54\" (UniqueName: \"kubernetes.io/projected/043c2869-6a29-4e79-9ec9-1ab078c46ffa-kube-api-access-nvh54\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.861315 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.861256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.870334 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.870306 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc"] Jun 13 01:05:07.871717 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:07.871689 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35b566d_df1f_48a6_8bfa_e4487866b7fe.slice/crio-6f430b01f0d31f1d68c6e6d4f1f7091b942f1a72ad8d32ecbfcedd8ec3f40550 WatchSource:0}: Error finding container 6f430b01f0d31f1d68c6e6d4f1f7091b942f1a72ad8d32ecbfcedd8ec3f40550: Status 404 returned error can't find the container with id 6f430b01f0d31f1d68c6e6d4f1f7091b942f1a72ad8d32ecbfcedd8ec3f40550 Jun 13 01:05:07.962382 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.962347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.962824 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.962401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.962824 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.962422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvh54\" (UniqueName: \"kubernetes.io/projected/043c2869-6a29-4e79-9ec9-1ab078c46ffa-kube-api-access-nvh54\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.962824 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.962755 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.962824 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.962809 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:07.972164 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:07.972132 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvh54\" (UniqueName: \"kubernetes.io/projected/043c2869-6a29-4e79-9ec9-1ab078c46ffa-kube-api-access-nvh54\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:08.080184 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.080143 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:08.214256 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.214228 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm"] Jun 13 01:05:08.215941 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:08.215915 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043c2869_6a29_4e79_9ec9_1ab078c46ffa.slice/crio-5878b6512eea012baf77cd31e124806e98dcf0748af1d0f77a0e87be3d5c7267 WatchSource:0}: Error finding container 5878b6512eea012baf77cd31e124806e98dcf0748af1d0f77a0e87be3d5c7267: Status 404 returned error can't find the container with id 5878b6512eea012baf77cd31e124806e98dcf0748af1d0f77a0e87be3d5c7267 Jun 13 01:05:08.358857 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.358827 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd"] Jun 13 01:05:08.366331 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.363829 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.366331 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.365721 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.366331 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.365763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.366331 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.365813 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xk8p\" (UniqueName: \"kubernetes.io/projected/78fc7513-a961-4a62-af9c-42af301612fe-kube-api-access-7xk8p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.377347 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.377320 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd"] Jun 13 01:05:08.466428 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.466384 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.466428 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.466429 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.466682 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.466471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xk8p\" (UniqueName: \"kubernetes.io/projected/78fc7513-a961-4a62-af9c-42af301612fe-kube-api-access-7xk8p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.466739 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.466718 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.466789 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.466766 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.476480 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.476455 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xk8p\" (UniqueName: \"kubernetes.io/projected/78fc7513-a961-4a62-af9c-42af301612fe-kube-api-access-7xk8p\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.518059 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.518024 2583 generic.go:356] "Generic (PLEG): container finished" podID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerID="3b946bc8446ee4da8d3aaa2efe8e08701073870ecbdee469a4e3e231216739ac" exitCode=0 Jun 13 01:05:08.518367 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.518113 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" event={"ID":"18df5517-aba3-4b79-9f1b-38be2045bb6d","Type":"ContainerDied","Data":"3b946bc8446ee4da8d3aaa2efe8e08701073870ecbdee469a4e3e231216739ac"} Jun 13 01:05:08.519870 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.519844 2583 generic.go:356] "Generic (PLEG): container finished" podID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerID="fd1103741f5d9379a1bbfb69a1936d31f992b355fff93bc6653168f3951c63a7" exitCode=0 Jun 13 01:05:08.519980 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.519930 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" event={"ID":"043c2869-6a29-4e79-9ec9-1ab078c46ffa","Type":"ContainerDied","Data":"fd1103741f5d9379a1bbfb69a1936d31f992b355fff93bc6653168f3951c63a7"} Jun 13 01:05:08.520090 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.519980 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" event={"ID":"043c2869-6a29-4e79-9ec9-1ab078c46ffa","Type":"ContainerStarted","Data":"5878b6512eea012baf77cd31e124806e98dcf0748af1d0f77a0e87be3d5c7267"} Jun 13 01:05:08.521742 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.521718 2583 generic.go:356] "Generic (PLEG): container finished" podID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerID="47d45faf0e21389da18bff32c2308a78dc5367a71561e5b769526578ebeab576" exitCode=0 Jun 13 01:05:08.521882 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.521800 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" event={"ID":"e35b566d-df1f-48a6-8bfa-e4487866b7fe","Type":"ContainerDied","Data":"47d45faf0e21389da18bff32c2308a78dc5367a71561e5b769526578ebeab576"} Jun 13 01:05:08.521882 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.521848 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" event={"ID":"e35b566d-df1f-48a6-8bfa-e4487866b7fe","Type":"ContainerStarted","Data":"6f430b01f0d31f1d68c6e6d4f1f7091b942f1a72ad8d32ecbfcedd8ec3f40550"} Jun 13 01:05:08.674709 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.674618 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:08.809581 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:08.809556 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd"] Jun 13 01:05:08.811284 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:08.811257 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fc7513_a961_4a62_af9c_42af301612fe.slice/crio-1fb9f437bb217b8db9b8fa5ece2dcdcb5a6ec7a586859ac581e3fee598b98f1f WatchSource:0}: Error finding container 1fb9f437bb217b8db9b8fa5ece2dcdcb5a6ec7a586859ac581e3fee598b98f1f: Status 404 returned error can't find the container with id 1fb9f437bb217b8db9b8fa5ece2dcdcb5a6ec7a586859ac581e3fee598b98f1f Jun 13 01:05:09.528986 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:09.528953 2583 generic.go:356] "Generic (PLEG): container finished" podID="78fc7513-a961-4a62-af9c-42af301612fe" containerID="d10c9092c07783576133e3af5e2f13ad5afb959560c48b71c767d75e114d292a" exitCode=0 Jun 13 01:05:09.529398 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:09.529037 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" event={"ID":"78fc7513-a961-4a62-af9c-42af301612fe","Type":"ContainerDied","Data":"d10c9092c07783576133e3af5e2f13ad5afb959560c48b71c767d75e114d292a"} Jun 13 01:05:09.529398 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:09.529091 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" event={"ID":"78fc7513-a961-4a62-af9c-42af301612fe","Type":"ContainerStarted","Data":"1fb9f437bb217b8db9b8fa5ece2dcdcb5a6ec7a586859ac581e3fee598b98f1f"} Jun 13 01:05:10.536740 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.536651 2583 generic.go:356] "Generic (PLEG): container finished" podID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerID="7343a25fca6e704cb90fcec55f2efcd757e81547a67f1c66ec58561cbde4ac69" exitCode=0 Jun 13 01:05:10.536740 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.536713 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" event={"ID":"18df5517-aba3-4b79-9f1b-38be2045bb6d","Type":"ContainerDied","Data":"7343a25fca6e704cb90fcec55f2efcd757e81547a67f1c66ec58561cbde4ac69"} Jun 13 01:05:10.538680 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.538538 2583 generic.go:356] "Generic (PLEG): container finished" podID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerID="7fbbf379662be5baef799db1ca7e8555d337bf64162026d7fdffaf9e622b15d3" exitCode=0 Jun 13 01:05:10.538680 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.538623 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" event={"ID":"043c2869-6a29-4e79-9ec9-1ab078c46ffa","Type":"ContainerDied","Data":"7fbbf379662be5baef799db1ca7e8555d337bf64162026d7fdffaf9e622b15d3"} Jun 13 01:05:10.540562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.540541 2583 generic.go:356] "Generic (PLEG): container finished" podID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerID="4697dbfd83b251a3a8ce27ed3ad7ba17ebad0a903434239847705d5e0cad3870" exitCode=0 Jun 13 01:05:10.540652 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.540584 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" event={"ID":"e35b566d-df1f-48a6-8bfa-e4487866b7fe","Type":"ContainerDied","Data":"4697dbfd83b251a3a8ce27ed3ad7ba17ebad0a903434239847705d5e0cad3870"} Jun 13 01:05:10.542832 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.542810 2583 generic.go:356] "Generic (PLEG): container finished" podID="78fc7513-a961-4a62-af9c-42af301612fe" containerID="da5a9b05818c1a3095459c73f8c414146f5e018a14a3699cd0dae543697c48b5" exitCode=0 Jun 13 01:05:10.542926 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:10.542869 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" event={"ID":"78fc7513-a961-4a62-af9c-42af301612fe","Type":"ContainerDied","Data":"da5a9b05818c1a3095459c73f8c414146f5e018a14a3699cd0dae543697c48b5"} Jun 13 01:05:11.550490 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.550454 2583 generic.go:356] "Generic (PLEG): container finished" podID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerID="b6399d805822604db4713a5ace7385bf5a0183db151647a36fa81edff3539bfc" exitCode=0 Jun 13 01:05:11.550884 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.550538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" event={"ID":"e35b566d-df1f-48a6-8bfa-e4487866b7fe","Type":"ContainerDied","Data":"b6399d805822604db4713a5ace7385bf5a0183db151647a36fa81edff3539bfc"} Jun 13 01:05:11.552653 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.552628 2583 generic.go:356] "Generic (PLEG): container finished" podID="78fc7513-a961-4a62-af9c-42af301612fe" containerID="0f5d0e44f7d2fb2e8210561eba7194a8e49fb256d2539f8cef8a63c305bd5222" exitCode=0 Jun 13 01:05:11.552804 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.552708 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" event={"ID":"78fc7513-a961-4a62-af9c-42af301612fe","Type":"ContainerDied","Data":"0f5d0e44f7d2fb2e8210561eba7194a8e49fb256d2539f8cef8a63c305bd5222"} Jun 13 01:05:11.554740 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.554721 2583 generic.go:356] "Generic (PLEG): container finished" podID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerID="f0af91172fe20ac881adff7b912844726a01a73eb9d2e678c5f203fe44fe5bb1" exitCode=0 Jun 13 01:05:11.554852 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.554785 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" event={"ID":"18df5517-aba3-4b79-9f1b-38be2045bb6d","Type":"ContainerDied","Data":"f0af91172fe20ac881adff7b912844726a01a73eb9d2e678c5f203fe44fe5bb1"} Jun 13 01:05:11.556767 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.556747 2583 generic.go:356] "Generic (PLEG): container finished" podID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerID="84d388d5b53c0e1e242916a5125d3e43fc3963692e822302b6a386f9758ffb8a" exitCode=0 Jun 13 01:05:11.556864 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:11.556781 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" event={"ID":"043c2869-6a29-4e79-9ec9-1ab078c46ffa","Type":"ContainerDied","Data":"84d388d5b53c0e1e242916a5125d3e43fc3963692e822302b6a386f9758ffb8a"} Jun 13 01:05:12.740371 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.740344 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:12.744235 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.744211 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:12.799540 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.799497 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:12.801337 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801314 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-bundle\") pod \"78fc7513-a961-4a62-af9c-42af301612fe\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " Jun 13 01:05:12.801464 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801374 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvh54\" (UniqueName: \"kubernetes.io/projected/043c2869-6a29-4e79-9ec9-1ab078c46ffa-kube-api-access-nvh54\") pod \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " Jun 13 01:05:12.801464 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801401 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xk8p\" (UniqueName: \"kubernetes.io/projected/78fc7513-a961-4a62-af9c-42af301612fe-kube-api-access-7xk8p\") pod \"78fc7513-a961-4a62-af9c-42af301612fe\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " Jun 13 01:05:12.801464 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801438 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-util\") pod \"78fc7513-a961-4a62-af9c-42af301612fe\" (UID: \"78fc7513-a961-4a62-af9c-42af301612fe\") " Jun 13 01:05:12.801613 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801464 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-util\") pod \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " Jun 13 01:05:12.801613 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801550 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:12.801714 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801548 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-bundle\") pod \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " Jun 13 01:05:12.801775 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801752 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsrp5\" (UniqueName: \"kubernetes.io/projected/e35b566d-df1f-48a6-8bfa-e4487866b7fe-kube-api-access-zsrp5\") pod \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\" (UID: \"e35b566d-df1f-48a6-8bfa-e4487866b7fe\") " Jun 13 01:05:12.802225 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.801925 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-bundle" (OuterVolumeSpecName: "bundle") pod "78fc7513-a961-4a62-af9c-42af301612fe" (UID: "78fc7513-a961-4a62-af9c-42af301612fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.802225 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.802080 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-util\") pod \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " Jun 13 01:05:12.802225 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.802118 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-bundle\") pod \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\" (UID: \"043c2869-6a29-4e79-9ec9-1ab078c46ffa\") " Jun 13 01:05:12.802474 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.802118 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-bundle" (OuterVolumeSpecName: "bundle") pod "e35b566d-df1f-48a6-8bfa-e4487866b7fe" (UID: "e35b566d-df1f-48a6-8bfa-e4487866b7fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.802531 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.802476 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.802867 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.802847 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-bundle" (OuterVolumeSpecName: "bundle") pod "043c2869-6a29-4e79-9ec9-1ab078c46ffa" (UID: "043c2869-6a29-4e79-9ec9-1ab078c46ffa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.804459 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.804428 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043c2869-6a29-4e79-9ec9-1ab078c46ffa-kube-api-access-nvh54" (OuterVolumeSpecName: "kube-api-access-nvh54") pod "043c2869-6a29-4e79-9ec9-1ab078c46ffa" (UID: "043c2869-6a29-4e79-9ec9-1ab078c46ffa"). InnerVolumeSpecName "kube-api-access-nvh54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:05:12.804459 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.804439 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35b566d-df1f-48a6-8bfa-e4487866b7fe-kube-api-access-zsrp5" (OuterVolumeSpecName: "kube-api-access-zsrp5") pod "e35b566d-df1f-48a6-8bfa-e4487866b7fe" (UID: "e35b566d-df1f-48a6-8bfa-e4487866b7fe"). InnerVolumeSpecName "kube-api-access-zsrp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:05:12.804698 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.804683 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78fc7513-a961-4a62-af9c-42af301612fe-kube-api-access-7xk8p" (OuterVolumeSpecName: "kube-api-access-7xk8p") pod "78fc7513-a961-4a62-af9c-42af301612fe" (UID: "78fc7513-a961-4a62-af9c-42af301612fe"). InnerVolumeSpecName "kube-api-access-7xk8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:05:12.807342 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.807303 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-util" (OuterVolumeSpecName: "util") pod "e35b566d-df1f-48a6-8bfa-e4487866b7fe" (UID: "e35b566d-df1f-48a6-8bfa-e4487866b7fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.808095 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.808073 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-util" (OuterVolumeSpecName: "util") pod "78fc7513-a961-4a62-af9c-42af301612fe" (UID: "78fc7513-a961-4a62-af9c-42af301612fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.808455 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.808437 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-util" (OuterVolumeSpecName: "util") pod "043c2869-6a29-4e79-9ec9-1ab078c46ffa" (UID: "043c2869-6a29-4e79-9ec9-1ab078c46ffa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.902720 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902689 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-util\") pod \"18df5517-aba3-4b79-9f1b-38be2045bb6d\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " Jun 13 01:05:12.902910 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902742 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czmlj\" (UniqueName: \"kubernetes.io/projected/18df5517-aba3-4b79-9f1b-38be2045bb6d-kube-api-access-czmlj\") pod \"18df5517-aba3-4b79-9f1b-38be2045bb6d\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " Jun 13 01:05:12.902910 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902774 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-bundle\") pod \"18df5517-aba3-4b79-9f1b-38be2045bb6d\" (UID: \"18df5517-aba3-4b79-9f1b-38be2045bb6d\") " Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902956 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvh54\" (UniqueName: \"kubernetes.io/projected/043c2869-6a29-4e79-9ec9-1ab078c46ffa-kube-api-access-nvh54\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902972 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xk8p\" (UniqueName: \"kubernetes.io/projected/78fc7513-a961-4a62-af9c-42af301612fe-kube-api-access-7xk8p\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902985 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/78fc7513-a961-4a62-af9c-42af301612fe-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.902995 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.903002 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e35b566d-df1f-48a6-8bfa-e4487866b7fe-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.903010 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsrp5\" (UniqueName: \"kubernetes.io/projected/e35b566d-df1f-48a6-8bfa-e4487866b7fe-kube-api-access-zsrp5\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.903020 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903028 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.903029 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/043c2869-6a29-4e79-9ec9-1ab078c46ffa-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:12.903428 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.903351 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-bundle" (OuterVolumeSpecName: "bundle") pod "18df5517-aba3-4b79-9f1b-38be2045bb6d" (UID: "18df5517-aba3-4b79-9f1b-38be2045bb6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:12.904959 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.904937 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18df5517-aba3-4b79-9f1b-38be2045bb6d-kube-api-access-czmlj" (OuterVolumeSpecName: "kube-api-access-czmlj") pod "18df5517-aba3-4b79-9f1b-38be2045bb6d" (UID: "18df5517-aba3-4b79-9f1b-38be2045bb6d"). InnerVolumeSpecName "kube-api-access-czmlj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:05:12.908477 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:12.908455 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-util" (OuterVolumeSpecName: "util") pod "18df5517-aba3-4b79-9f1b-38be2045bb6d" (UID: "18df5517-aba3-4b79-9f1b-38be2045bb6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:05:13.003610 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.003576 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czmlj\" (UniqueName: \"kubernetes.io/projected/18df5517-aba3-4b79-9f1b-38be2045bb6d-kube-api-access-czmlj\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:13.003610 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.003603 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:13.003610 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.003614 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18df5517-aba3-4b79-9f1b-38be2045bb6d-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:13.569354 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.569330 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" Jun 13 01:05:13.569540 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.569369 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd" event={"ID":"78fc7513-a961-4a62-af9c-42af301612fe","Type":"ContainerDied","Data":"1fb9f437bb217b8db9b8fa5ece2dcdcb5a6ec7a586859ac581e3fee598b98f1f"} Jun 13 01:05:13.569540 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.569426 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fb9f437bb217b8db9b8fa5ece2dcdcb5a6ec7a586859ac581e3fee598b98f1f" Jun 13 01:05:13.571336 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.571318 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" Jun 13 01:05:13.571336 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.571325 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6" event={"ID":"18df5517-aba3-4b79-9f1b-38be2045bb6d","Type":"ContainerDied","Data":"5891fb8bdab11867a44a81c26057fc6910c545ff9db813eb14d56fe48e70369e"} Jun 13 01:05:13.571516 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.571362 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5891fb8bdab11867a44a81c26057fc6910c545ff9db813eb14d56fe48e70369e" Jun 13 01:05:13.573353 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.573324 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" Jun 13 01:05:13.573353 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.573345 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm" event={"ID":"043c2869-6a29-4e79-9ec9-1ab078c46ffa","Type":"ContainerDied","Data":"5878b6512eea012baf77cd31e124806e98dcf0748af1d0f77a0e87be3d5c7267"} Jun 13 01:05:13.573511 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.573383 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5878b6512eea012baf77cd31e124806e98dcf0748af1d0f77a0e87be3d5c7267" Jun 13 01:05:13.575260 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.575238 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" event={"ID":"e35b566d-df1f-48a6-8bfa-e4487866b7fe","Type":"ContainerDied","Data":"6f430b01f0d31f1d68c6e6d4f1f7091b942f1a72ad8d32ecbfcedd8ec3f40550"} Jun 13 01:05:13.575260 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.575253 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc" Jun 13 01:05:13.575407 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:13.575275 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f430b01f0d31f1d68c6e6d4f1f7091b942f1a72ad8d32ecbfcedd8ec3f40550" Jun 13 01:05:20.352252 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:20.352221 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:22.992827 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.992793 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8"] Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993117 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="util" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993127 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="util" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993138 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="util" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993143 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="util" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993167 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="pull" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993172 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="pull" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993178 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="pull" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993185 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="pull" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993194 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="extract" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993200 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="extract" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993208 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="util" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993213 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="util" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993226 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="pull" Jun 13 01:05:22.993224 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993231 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="pull" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993237 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="util" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993242 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="util" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993247 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993251 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993257 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993262 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993269 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="pull" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993273 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="pull" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993279 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993283 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993333 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18df5517-aba3-4b79-9f1b-38be2045bb6d" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993339 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="78fc7513-a961-4a62-af9c-42af301612fe" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993348 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e35b566d-df1f-48a6-8bfa-e4487866b7fe" containerName="extract" Jun 13 01:05:22.993631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.993354 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="043c2869-6a29-4e79-9ec9-1ab078c46ffa" containerName="extract" Jun 13 01:05:22.999996 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:22.999977 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:23.002992 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.002973 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hwcgw\"" Jun 13 01:05:23.007393 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.007016 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8"] Jun 13 01:05:23.090736 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.090700 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbh2w\" (UniqueName: \"kubernetes.io/projected/9e419a9d-6f7b-41a2-8a86-5903beb282a7-kube-api-access-pbh2w\") pod \"limitador-operator-controller-manager-859d7b78bd-f96v8\" (UID: \"9e419a9d-6f7b-41a2-8a86-5903beb282a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:23.191353 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.191311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbh2w\" (UniqueName: \"kubernetes.io/projected/9e419a9d-6f7b-41a2-8a86-5903beb282a7-kube-api-access-pbh2w\") pod \"limitador-operator-controller-manager-859d7b78bd-f96v8\" (UID: \"9e419a9d-6f7b-41a2-8a86-5903beb282a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:23.204503 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.204468 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbh2w\" (UniqueName: \"kubernetes.io/projected/9e419a9d-6f7b-41a2-8a86-5903beb282a7-kube-api-access-pbh2w\") pod \"limitador-operator-controller-manager-859d7b78bd-f96v8\" (UID: \"9e419a9d-6f7b-41a2-8a86-5903beb282a7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:23.310926 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.310834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:23.380018 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.379969 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:23.456799 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.456768 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8"] Jun 13 01:05:23.457961 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:23.457939 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e419a9d_6f7b_41a2_8a86_5903beb282a7.slice/crio-d0022ff7c657b67784f32c52a687d0113fb32763cf6e074e766bbe1838165d25 WatchSource:0}: Error finding container d0022ff7c657b67784f32c52a687d0113fb32763cf6e074e766bbe1838165d25: Status 404 returned error can't find the container with id d0022ff7c657b67784f32c52a687d0113fb32763cf6e074e766bbe1838165d25 Jun 13 01:05:23.496893 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.496862 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:23.629002 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:23.628963 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" event={"ID":"9e419a9d-6f7b-41a2-8a86-5903beb282a7","Type":"ContainerStarted","Data":"d0022ff7c657b67784f32c52a687d0113fb32763cf6e074e766bbe1838165d25"} Jun 13 01:05:24.004090 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:24.003980 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:24.118506 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:24.118442 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:24.653947 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:24.653919 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:24.936519 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:24.936442 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:25.641452 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:25.641412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" event={"ID":"9e419a9d-6f7b-41a2-8a86-5903beb282a7","Type":"ContainerStarted","Data":"b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839"} Jun 13 01:05:25.641905 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:25.641473 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:25.671363 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:25.671315 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" podStartSLOduration=1.820560051 podStartE2EDuration="3.671299852s" totalImagesPullingTime="1.850739801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:25.670565978 +0000 UTC m=+463.666478356" watchObservedRunningTime="2026-06-13 01:05:25.671299852 +0000 UTC m=+463.667212287" Jun 13 01:05:26.827580 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:26.827548 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:26.926629 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:26.926567 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:28.578359 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:28.578294 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:28.994420 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:28.994385 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:30.431329 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:30.431288 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:31.967819 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:31.967786 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:32.829576 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:32.829543 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:34.006078 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.006047 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:34.108268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.108226 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:34.210766 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.210732 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:34.427318 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.427281 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m"] Jun 13 01:05:34.430825 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.430804 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:34.433720 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.433694 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 13 01:05:34.433864 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.433837 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xd6mm\"" Jun 13 01:05:34.440599 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.440577 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m"] Jun 13 01:05:34.492178 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.492134 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562q7\" (UniqueName: \"kubernetes.io/projected/c5fc818c-2105-4c10-b108-1b26f6f2fa02-kube-api-access-562q7\") pod \"dns-operator-controller-manager-864dd78c4c-gw29m\" (UID: \"c5fc818c-2105-4c10-b108-1b26f6f2fa02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:34.593641 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.593595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-562q7\" (UniqueName: \"kubernetes.io/projected/c5fc818c-2105-4c10-b108-1b26f6f2fa02-kube-api-access-562q7\") pod \"dns-operator-controller-manager-864dd78c4c-gw29m\" (UID: \"c5fc818c-2105-4c10-b108-1b26f6f2fa02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:34.607559 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.607528 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-562q7\" (UniqueName: \"kubernetes.io/projected/c5fc818c-2105-4c10-b108-1b26f6f2fa02-kube-api-access-562q7\") pod \"dns-operator-controller-manager-864dd78c4c-gw29m\" (UID: \"c5fc818c-2105-4c10-b108-1b26f6f2fa02\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:34.741686 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.741605 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:34.802778 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.802740 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:34.883199 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:34.883173 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m"] Jun 13 01:05:34.884700 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:34.884675 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fc818c_2105_4c10_b108_1b26f6f2fa02.slice/crio-04136932558cd0921cde6c3a1e367b42a71238d310e796d37ee9005e5b51e5a2 WatchSource:0}: Error finding container 04136932558cd0921cde6c3a1e367b42a71238d310e796d37ee9005e5b51e5a2: Status 404 returned error can't find the container with id 04136932558cd0921cde6c3a1e367b42a71238d310e796d37ee9005e5b51e5a2 Jun 13 01:05:35.698268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:35.698232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" event={"ID":"c5fc818c-2105-4c10-b108-1b26f6f2fa02","Type":"ContainerStarted","Data":"04136932558cd0921cde6c3a1e367b42a71238d310e796d37ee9005e5b51e5a2"} Jun 13 01:05:36.150750 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:36.150717 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:36.251283 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:36.251222 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:36.649359 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:36.649311 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:37.711690 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:37.711654 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" event={"ID":"c5fc818c-2105-4c10-b108-1b26f6f2fa02","Type":"ContainerStarted","Data":"206332f4bc6da34c964bd25e02b03902e761a239a6bcc27660ea738f32e5f1be"} Jun 13 01:05:37.712138 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:37.711766 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:37.734487 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:37.734434 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" podStartSLOduration=1.2735033599999999 podStartE2EDuration="3.734418212s" totalImagesPullingTime="2.460914852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:37.732308358 +0000 UTC m=+475.728220736" watchObservedRunningTime="2026-06-13 01:05:37.734418212 +0000 UTC m=+475.730330590" Jun 13 01:05:39.082217 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:39.082135 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:39.235856 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:39.235804 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:39.565922 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:39.565892 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:39.628054 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:39.628021 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:48.278225 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:48.278192 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:48.468113 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:48.468072 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:48.630606 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:48.630569 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:48.719322 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:48.719290 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gw29m" Jun 13 01:05:49.375901 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.375869 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8"] Jun 13 01:05:49.376349 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.376080 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" containerName="manager" containerID="cri-o://b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839" gracePeriod=2 Jun 13 01:05:49.379036 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:49.379001 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f96v8\" is forbidden: User \"system:node:ip-10-0-129-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-42.ec2.internal' and this object" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.382275 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.382247 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8"] Jun 13 01:05:49.413232 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.413200 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c"] Jun 13 01:05:49.413777 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.413757 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" containerName="manager" Jun 13 01:05:49.413818 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.413783 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" containerName="manager" Jun 13 01:05:49.413911 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.413897 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" containerName="manager" Jun 13 01:05:49.417257 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.417235 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:05:49.435236 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.435208 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c"] Jun 13 01:05:49.461881 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:49.461847 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f96v8\" is forbidden: User \"system:node:ip-10-0-129-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-42.ec2.internal' and this object" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.528283 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.528251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtq6\" (UniqueName: \"kubernetes.io/projected/c405fe0f-9942-491a-8f66-61e39154c774-kube-api-access-crtq6\") pod \"limitador-operator-controller-manager-859d7b78bd-7d56c\" (UID: \"c405fe0f-9942-491a-8f66-61e39154c774\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:05:49.612124 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.612093 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.614909 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:49.614882 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f96v8\" is forbidden: User \"system:node:ip-10-0-129-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-42.ec2.internal' and this object" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.629346 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.629292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtq6\" (UniqueName: \"kubernetes.io/projected/c405fe0f-9942-491a-8f66-61e39154c774-kube-api-access-crtq6\") pod \"limitador-operator-controller-manager-859d7b78bd-7d56c\" (UID: \"c405fe0f-9942-491a-8f66-61e39154c774\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:05:49.647658 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.647636 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtq6\" (UniqueName: \"kubernetes.io/projected/c405fe0f-9942-491a-8f66-61e39154c774-kube-api-access-crtq6\") pod \"limitador-operator-controller-manager-859d7b78bd-7d56c\" (UID: \"c405fe0f-9942-491a-8f66-61e39154c774\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:05:49.730974 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.730937 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbh2w\" (UniqueName: \"kubernetes.io/projected/9e419a9d-6f7b-41a2-8a86-5903beb282a7-kube-api-access-pbh2w\") pod \"9e419a9d-6f7b-41a2-8a86-5903beb282a7\" (UID: \"9e419a9d-6f7b-41a2-8a86-5903beb282a7\") " Jun 13 01:05:49.733112 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.733086 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e419a9d-6f7b-41a2-8a86-5903beb282a7-kube-api-access-pbh2w" (OuterVolumeSpecName: "kube-api-access-pbh2w") pod "9e419a9d-6f7b-41a2-8a86-5903beb282a7" (UID: "9e419a9d-6f7b-41a2-8a86-5903beb282a7"). InnerVolumeSpecName "kube-api-access-pbh2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:05:49.749869 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.749844 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:05:49.784325 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.783766 2583 generic.go:356] "Generic (PLEG): container finished" podID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" containerID="b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839" exitCode=0 Jun 13 01:05:49.784325 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.783823 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.784325 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.783896 2583 scope.go:117] "RemoveContainer" containerID="b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839" Jun 13 01:05:49.786868 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:49.786828 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f96v8\" is forbidden: User \"system:node:ip-10-0-129-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-42.ec2.internal' and this object" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.795533 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.795515 2583 scope.go:117] "RemoveContainer" containerID="b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839" Jun 13 01:05:49.795850 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:49.795830 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839\": container with ID starting with b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839 not found: ID does not exist" containerID="b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839" Jun 13 01:05:49.795911 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.795862 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839"} err="failed to get container status \"b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839\": rpc error: code = NotFound desc = could not find container \"b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839\": container with ID starting with b6a405e438fed0b862b525f7f089235ca82a1b6648143174091a906742559839 not found: ID does not exist" Jun 13 01:05:49.797739 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:49.797714 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f96v8\" is forbidden: User \"system:node:ip-10-0-129-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-42.ec2.internal' and this object" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:49.832407 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.832377 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbh2w\" (UniqueName: \"kubernetes.io/projected/9e419a9d-6f7b-41a2-8a86-5903beb282a7-kube-api-access-pbh2w\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:05:49.903310 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:49.903279 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc405fe0f_9942_491a_8f66_61e39154c774.slice/crio-7e86c79b61b958b5f2a2ce2eefa93a974c2b791652ce581ab5fd4c702cae3532 WatchSource:0}: Error finding container 7e86c79b61b958b5f2a2ce2eefa93a974c2b791652ce581ab5fd4c702cae3532: Status 404 returned error can't find the container with id 7e86c79b61b958b5f2a2ce2eefa93a974c2b791652ce581ab5fd4c702cae3532 Jun 13 01:05:49.903455 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:49.903405 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c"] Jun 13 01:05:50.462382 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.462342 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr"] Jun 13 01:05:50.465967 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.465943 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.469354 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:05:50.469319 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f96v8\" is forbidden: User \"system:node:ip-10-0-129-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-42.ec2.internal' and this object" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f96v8" Jun 13 01:05:50.469918 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.469896 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cs8n9\"" Jun 13 01:05:50.484286 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.484251 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e419a9d-6f7b-41a2-8a86-5903beb282a7" path="/var/lib/kubelet/pods/9e419a9d-6f7b-41a2-8a86-5903beb282a7/volumes" Jun 13 01:05:50.484532 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.484516 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr"] Jun 13 01:05:50.639522 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.639492 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/02a593d3-94a9-4af2-abed-8ada656166ca-kube-api-access-l4n22\") pod \"kuadrant-operator-controller-manager-86878c769f-fb9hr\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.639699 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.639568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a593d3-94a9-4af2-abed-8ada656166ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fb9hr\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.674309 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.674279 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:50.740941 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.740861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/02a593d3-94a9-4af2-abed-8ada656166ca-kube-api-access-l4n22\") pod \"kuadrant-operator-controller-manager-86878c769f-fb9hr\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.740941 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.740906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a593d3-94a9-4af2-abed-8ada656166ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fb9hr\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.741280 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.741262 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a593d3-94a9-4af2-abed-8ada656166ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fb9hr\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.750880 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.750855 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/02a593d3-94a9-4af2-abed-8ada656166ca-kube-api-access-l4n22\") pod \"kuadrant-operator-controller-manager-86878c769f-fb9hr\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.773987 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.773951 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:50.776440 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.776423 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:50.792200 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.792164 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" event={"ID":"c405fe0f-9942-491a-8f66-61e39154c774","Type":"ContainerStarted","Data":"326229f4ae7c0bed8920fe90a7a760a1b9cb4edaf0a6d336a343f48fad6c2392"} Jun 13 01:05:50.792348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.792231 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" event={"ID":"c405fe0f-9942-491a-8f66-61e39154c774","Type":"ContainerStarted","Data":"7e86c79b61b958b5f2a2ce2eefa93a974c2b791652ce581ab5fd4c702cae3532"} Jun 13 01:05:50.792348 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.792276 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:05:50.813117 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.813057 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" podStartSLOduration=1.8129910200000001 podStartE2EDuration="1.81299102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:50.812376488 +0000 UTC m=+488.808288866" watchObservedRunningTime="2026-06-13 01:05:50.81299102 +0000 UTC m=+488.808903401" Jun 13 01:05:50.943671 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:50.943643 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr"] Jun 13 01:05:50.945562 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:05:50.945537 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a593d3_94a9_4af2_abed_8ada656166ca.slice/crio-38e57ab538b3bd2f88dd55132722f0e2f0c9750b36bb2834684551825add6d74 WatchSource:0}: Error finding container 38e57ab538b3bd2f88dd55132722f0e2f0c9750b36bb2834684551825add6d74: Status 404 returned error can't find the container with id 38e57ab538b3bd2f88dd55132722f0e2f0c9750b36bb2834684551825add6d74 Jun 13 01:05:51.802656 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:51.802615 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" event={"ID":"02a593d3-94a9-4af2-abed-8ada656166ca","Type":"ContainerStarted","Data":"38e57ab538b3bd2f88dd55132722f0e2f0c9750b36bb2834684551825add6d74"} Jun 13 01:05:54.956752 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:54.956722 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:55.057166 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:55.057113 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:57.173340 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:57.173297 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:57.238708 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:57.238660 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:05:58.847364 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:58.847332 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" event={"ID":"02a593d3-94a9-4af2-abed-8ada656166ca","Type":"ContainerStarted","Data":"09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0"} Jun 13 01:05:58.847722 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:58.847510 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:05:58.870504 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:05:58.870458 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" podStartSLOduration=1.048845877 podStartE2EDuration="8.870441964s" totalImagesPullingTime="7.821596087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:05:58.868377128 +0000 UTC m=+496.864289511" watchObservedRunningTime="2026-06-13 01:05:58.870441964 +0000 UTC m=+496.866354342" Jun 13 01:06:01.805058 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:01.805032 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7d56c" Jun 13 01:06:05.930725 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:05.930690 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:06.022717 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:06.022679 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:08.413970 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:08.413935 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:08.514720 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:08.514688 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:09.854664 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:09.854628 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:06:12.745033 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:12.744998 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:12.848322 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:12.848287 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:15.532387 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:15.532353 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:15.593959 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:15.593924 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:24.336869 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:24.336831 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:24.734832 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:24.734802 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:24.839050 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:24.839016 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:26.243798 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:26.243764 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:26.366562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:26.366526 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:27.194846 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:27.194807 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:27.294850 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:27.294814 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:27.840133 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:27.840097 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:27.949580 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:27.949545 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:28.022542 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:28.022512 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:28.661661 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:28.661631 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:28.734851 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:28.734818 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:44.314440 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:44.314405 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:53.296626 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:53.296587 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:53.396288 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:53.396252 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:53.535088 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:53.535056 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:06:54.487290 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.487251 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn"] Jun 13 01:06:54.490733 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.490716 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.493448 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.493423 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 13 01:06:54.493558 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.493493 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 13 01:06:54.493558 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.493512 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5m6kw\"" Jun 13 01:06:54.496799 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.496722 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.496907 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.496816 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhlc\" (UniqueName: \"kubernetes.io/projected/47e6fa9c-769f-4d94-abef-31fac164e491-kube-api-access-llhlc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.497002 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.496973 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.500100 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.500076 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn"] Jun 13 01:06:54.597919 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.597878 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.598083 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.597945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.598083 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.597976 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhlc\" (UniqueName: \"kubernetes.io/projected/47e6fa9c-769f-4d94-abef-31fac164e491-kube-api-access-llhlc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.598341 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.598318 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.598386 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.598325 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.608093 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.608062 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhlc\" (UniqueName: \"kubernetes.io/projected/47e6fa9c-769f-4d94-abef-31fac164e491-kube-api-access-llhlc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.801030 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.800948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:54.934779 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:54.934751 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn"] Jun 13 01:06:54.936372 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:06:54.936347 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e6fa9c_769f_4d94_abef_31fac164e491.slice/crio-0f8e684cb8fcbbb96cd0c8614bac83ecee6053e46eb8a04055142b862d968fb9 WatchSource:0}: Error finding container 0f8e684cb8fcbbb96cd0c8614bac83ecee6053e46eb8a04055142b862d968fb9: Status 404 returned error can't find the container with id 0f8e684cb8fcbbb96cd0c8614bac83ecee6053e46eb8a04055142b862d968fb9 Jun 13 01:06:55.174655 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:55.174622 2583 generic.go:356] "Generic (PLEG): container finished" podID="47e6fa9c-769f-4d94-abef-31fac164e491" containerID="0f1f86bba921446ce2847f2a10345f2487196d690df6a2883e4579e750e88a89" exitCode=0 Jun 13 01:06:55.174841 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:55.174708 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" event={"ID":"47e6fa9c-769f-4d94-abef-31fac164e491","Type":"ContainerDied","Data":"0f1f86bba921446ce2847f2a10345f2487196d690df6a2883e4579e750e88a89"} Jun 13 01:06:55.174841 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:55.174763 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" event={"ID":"47e6fa9c-769f-4d94-abef-31fac164e491","Type":"ContainerStarted","Data":"0f8e684cb8fcbbb96cd0c8614bac83ecee6053e46eb8a04055142b862d968fb9"} Jun 13 01:06:56.182104 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:56.182069 2583 generic.go:356] "Generic (PLEG): container finished" podID="47e6fa9c-769f-4d94-abef-31fac164e491" containerID="102b2a3100a577ee8b072e3b2aba4c27759566bf99244f6da5e1cdcc5eb303c1" exitCode=0 Jun 13 01:06:56.182553 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:56.182169 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" event={"ID":"47e6fa9c-769f-4d94-abef-31fac164e491","Type":"ContainerDied","Data":"102b2a3100a577ee8b072e3b2aba4c27759566bf99244f6da5e1cdcc5eb303c1"} Jun 13 01:06:57.189480 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:57.189448 2583 generic.go:356] "Generic (PLEG): container finished" podID="47e6fa9c-769f-4d94-abef-31fac164e491" containerID="f4f3bcff490797036a57ec4553115483335848f00e1bd8cb234f3024091ee804" exitCode=0 Jun 13 01:06:57.189868 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:57.189528 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" event={"ID":"47e6fa9c-769f-4d94-abef-31fac164e491","Type":"ContainerDied","Data":"f4f3bcff490797036a57ec4553115483335848f00e1bd8cb234f3024091ee804"} Jun 13 01:06:58.340091 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.340064 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:58.424525 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.424489 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-util\") pod \"47e6fa9c-769f-4d94-abef-31fac164e491\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " Jun 13 01:06:58.424748 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.424539 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llhlc\" (UniqueName: \"kubernetes.io/projected/47e6fa9c-769f-4d94-abef-31fac164e491-kube-api-access-llhlc\") pod \"47e6fa9c-769f-4d94-abef-31fac164e491\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " Jun 13 01:06:58.424748 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.424572 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-bundle\") pod \"47e6fa9c-769f-4d94-abef-31fac164e491\" (UID: \"47e6fa9c-769f-4d94-abef-31fac164e491\") " Jun 13 01:06:58.425189 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.425115 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-bundle" (OuterVolumeSpecName: "bundle") pod "47e6fa9c-769f-4d94-abef-31fac164e491" (UID: "47e6fa9c-769f-4d94-abef-31fac164e491"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:06:58.426788 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.426768 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47e6fa9c-769f-4d94-abef-31fac164e491-kube-api-access-llhlc" (OuterVolumeSpecName: "kube-api-access-llhlc") pod "47e6fa9c-769f-4d94-abef-31fac164e491" (UID: "47e6fa9c-769f-4d94-abef-31fac164e491"). InnerVolumeSpecName "kube-api-access-llhlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:06:58.430021 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.430000 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-util" (OuterVolumeSpecName: "util") pod "47e6fa9c-769f-4d94-abef-31fac164e491" (UID: "47e6fa9c-769f-4d94-abef-31fac164e491"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:06:58.525419 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.525384 2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-util\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:06:58.525419 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.525413 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llhlc\" (UniqueName: \"kubernetes.io/projected/47e6fa9c-769f-4d94-abef-31fac164e491-kube-api-access-llhlc\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:06:58.525419 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:58.525425 2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47e6fa9c-769f-4d94-abef-31fac164e491-bundle\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:06:59.202190 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:59.202136 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" Jun 13 01:06:59.202190 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:59.202175 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488xqgn" event={"ID":"47e6fa9c-769f-4d94-abef-31fac164e491","Type":"ContainerDied","Data":"0f8e684cb8fcbbb96cd0c8614bac83ecee6053e46eb8a04055142b862d968fb9"} Jun 13 01:06:59.202417 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:06:59.202216 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f8e684cb8fcbbb96cd0c8614bac83ecee6053e46eb8a04055142b862d968fb9" Jun 13 01:07:18.387855 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.387808 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:18.487369 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.487343 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:18.783187 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783082 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:07:18.783497 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783480 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="pull" Jun 13 01:07:18.783539 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783499 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="pull" Jun 13 01:07:18.783539 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783521 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="extract" Jun 13 01:07:18.783539 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783527 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="extract" Jun 13 01:07:18.783539 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783534 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="util" Jun 13 01:07:18.783539 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783539 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="util" Jun 13 01:07:18.783693 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.783593 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="47e6fa9c-769f-4d94-abef-31fac164e491" containerName="extract" Jun 13 01:07:18.787192 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.787172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:18.789967 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.789948 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 01:07:18.790088 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.790006 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:07:18.791107 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.791092 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nfm7v\"" Jun 13 01:07:18.791185 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.791103 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:07:18.795305 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.795288 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:07:18.908961 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:18.908926 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29md7\" (UniqueName: \"kubernetes.io/projected/386718ba-6bd0-4e43-bcbb-a92aed6de7c9-kube-api-access-29md7\") pod \"maas-keycloak-0\" (UID: \"386718ba-6bd0-4e43-bcbb-a92aed6de7c9\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:19.009946 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:19.009903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29md7\" (UniqueName: \"kubernetes.io/projected/386718ba-6bd0-4e43-bcbb-a92aed6de7c9-kube-api-access-29md7\") pod \"maas-keycloak-0\" (UID: \"386718ba-6bd0-4e43-bcbb-a92aed6de7c9\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:19.019238 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:19.019206 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29md7\" (UniqueName: \"kubernetes.io/projected/386718ba-6bd0-4e43-bcbb-a92aed6de7c9-kube-api-access-29md7\") pod \"maas-keycloak-0\" (UID: \"386718ba-6bd0-4e43-bcbb-a92aed6de7c9\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:19.097664 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:19.097579 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:19.237197 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:19.237173 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:07:19.238967 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:07:19.238943 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386718ba_6bd0_4e43_bcbb_a92aed6de7c9.slice/crio-9ff22ad14ae3d32851700ce47bf168e83d678d104959f1cb78af8c0d7cf5d877 WatchSource:0}: Error finding container 9ff22ad14ae3d32851700ce47bf168e83d678d104959f1cb78af8c0d7cf5d877: Status 404 returned error can't find the container with id 9ff22ad14ae3d32851700ce47bf168e83d678d104959f1cb78af8c0d7cf5d877 Jun 13 01:07:19.312824 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:19.312786 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"386718ba-6bd0-4e43-bcbb-a92aed6de7c9","Type":"ContainerStarted","Data":"9ff22ad14ae3d32851700ce47bf168e83d678d104959f1cb78af8c0d7cf5d877"} Jun 13 01:07:24.353709 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:24.353592 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"386718ba-6bd0-4e43-bcbb-a92aed6de7c9","Type":"ContainerStarted","Data":"5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33"} Jun 13 01:07:24.374107 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:24.374039 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.559330203 podStartE2EDuration="6.374016196s" totalImagesPullingTime="4.814685993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:07:24.371006862 +0000 UTC m=+582.366919241" watchObservedRunningTime="2026-06-13 01:07:24.374016196 +0000 UTC m=+582.369928575" Jun 13 01:07:25.098763 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:25.098724 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:25.100447 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:25.100411 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:26.098271 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:26.098217 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:27.098711 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:27.098650 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:28.098776 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:28.098720 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:29.098569 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:29.098526 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:29.098876 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:29.098833 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:30.098416 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:30.098368 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:31.098067 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:31.098019 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:32.098168 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:32.098104 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:33.098926 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:33.098874 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:34.098046 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:34.097994 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:35.098774 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:35.098720 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:36.098741 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:36.098685 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.43:9000/health/started\": dial tcp 10.133.0.43:9000: connect: connection refused" Jun 13 01:07:37.189875 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:37.189829 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:37.205388 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:37.205338 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:07:42.477512 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:42.477469 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:07:42.478012 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:42.477735 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:07:47.196172 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:47.196110 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:07:47.846968 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:47.846930 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:48.992210 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:48.992140 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:54.044627 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:54.044590 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:54.140016 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:54.139979 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:54.228892 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:54.228857 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:54.379214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:54.379182 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:54.608020 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:54.607984 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:57.014142 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:57.014107 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:57.115309 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:57.115280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:07:58.292812 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:07:58.292723 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:23.166830 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:23.166792 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:27.092774 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.092726 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:27.182513 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.182477 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-d7df9d9f9-mq778"] Jun 13 01:08:27.184964 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.184947 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.187800 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.187778 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 13 01:08:27.188048 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.188029 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mvhr2\"" Jun 13 01:08:27.199518 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.199489 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d7df9d9f9-mq778"] Jun 13 01:08:27.346095 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.345999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866cbe44-8043-45a3-8774-de933565426f-maas-api-tls\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.346095 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.346033 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866cbe44-8043-45a3-8774-de933565426f-openshift-service-ca\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.346352 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.346219 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqmhp\" (UniqueName: \"kubernetes.io/projected/866cbe44-8043-45a3-8774-de933565426f-kube-api-access-tqmhp\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.447430 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.447389 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqmhp\" (UniqueName: \"kubernetes.io/projected/866cbe44-8043-45a3-8774-de933565426f-kube-api-access-tqmhp\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.447617 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.447449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866cbe44-8043-45a3-8774-de933565426f-maas-api-tls\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.447617 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.447477 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866cbe44-8043-45a3-8774-de933565426f-openshift-service-ca\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.447704 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:08:27.447613 2583 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 13 01:08:27.447704 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:08:27.447675 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866cbe44-8043-45a3-8774-de933565426f-maas-api-tls podName:866cbe44-8043-45a3-8774-de933565426f nodeName:}" failed. No retries permitted until 2026-06-13 01:08:27.947659339 +0000 UTC m=+645.943571699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/866cbe44-8043-45a3-8774-de933565426f-maas-api-tls") pod "maas-api-d7df9d9f9-mq778" (UID: "866cbe44-8043-45a3-8774-de933565426f") : secret "maas-api-serving-cert" not found Jun 13 01:08:27.448185 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.448168 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/866cbe44-8043-45a3-8774-de933565426f-openshift-service-ca\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.458577 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.458552 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqmhp\" (UniqueName: \"kubernetes.io/projected/866cbe44-8043-45a3-8774-de933565426f-kube-api-access-tqmhp\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.520302 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.520257 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:27.613283 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.613250 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:27.662735 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.662630 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wjrgq"] Jun 13 01:08:27.666048 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.666024 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:27.668874 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.668849 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 01:08:27.669000 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.668932 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cc9jz\"" Jun 13 01:08:27.679549 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.679516 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wjrgq"] Jun 13 01:08:27.851257 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.851223 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h99mb\" (UniqueName: \"kubernetes.io/projected/4c82baca-b75b-40b6-ad06-a403b69259c7-kube-api-access-h99mb\") pod \"payload-processing-699b6cd6c-wjrgq\" (UID: \"4c82baca-b75b-40b6-ad06-a403b69259c7\") " pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:27.952774 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.952686 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h99mb\" (UniqueName: \"kubernetes.io/projected/4c82baca-b75b-40b6-ad06-a403b69259c7-kube-api-access-h99mb\") pod \"payload-processing-699b6cd6c-wjrgq\" (UID: \"4c82baca-b75b-40b6-ad06-a403b69259c7\") " pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:27.952930 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.952791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866cbe44-8043-45a3-8774-de933565426f-maas-api-tls\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.955533 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.955507 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/866cbe44-8043-45a3-8774-de933565426f-maas-api-tls\") pod \"maas-api-d7df9d9f9-mq778\" (UID: \"866cbe44-8043-45a3-8774-de933565426f\") " pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:27.961943 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.961913 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h99mb\" (UniqueName: \"kubernetes.io/projected/4c82baca-b75b-40b6-ad06-a403b69259c7-kube-api-access-h99mb\") pod \"payload-processing-699b6cd6c-wjrgq\" (UID: \"4c82baca-b75b-40b6-ad06-a403b69259c7\") " pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:27.964875 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.964851 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:08:27.978887 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:27.978860 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:28.097592 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:28.097562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:28.123798 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:28.123493 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-wjrgq"] Jun 13 01:08:28.127876 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:28.127852 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 01:08:28.238559 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:28.238526 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d7df9d9f9-mq778"] Jun 13 01:08:28.239445 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:08:28.239419 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866cbe44_8043_45a3_8774_de933565426f.slice/crio-da149c737a54fab4b9e8faf7495bd5f74fa169b0f6b2a39deb437db3c28ba1fc WatchSource:0}: Error finding container da149c737a54fab4b9e8faf7495bd5f74fa169b0f6b2a39deb437db3c28ba1fc: Status 404 returned error can't find the container with id da149c737a54fab4b9e8faf7495bd5f74fa169b0f6b2a39deb437db3c28ba1fc Jun 13 01:08:28.780973 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:28.780893 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" event={"ID":"4c82baca-b75b-40b6-ad06-a403b69259c7","Type":"ContainerStarted","Data":"3afcb3e4ae4be06cc13dd37d09d0bfd6cf552101755e4f68d443d9f9e2e494ca"} Jun 13 01:08:28.784295 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:28.784203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d7df9d9f9-mq778" event={"ID":"866cbe44-8043-45a3-8774-de933565426f","Type":"ContainerStarted","Data":"da149c737a54fab4b9e8faf7495bd5f74fa169b0f6b2a39deb437db3c28ba1fc"} Jun 13 01:08:31.806475 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:31.806371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" event={"ID":"4c82baca-b75b-40b6-ad06-a403b69259c7","Type":"ContainerStarted","Data":"4d4768a343b2c42ed77d7bdc71d76896bcf86c2d1e46ee69c88604b0ea375065"} Jun 13 01:08:31.806475 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:31.806440 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:31.807942 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:31.807920 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d7df9d9f9-mq778" event={"ID":"866cbe44-8043-45a3-8774-de933565426f","Type":"ContainerStarted","Data":"1bf323449635e51c707d2f94a9249d49066f2e6462ffbb20a713dd7c33b03bb4"} Jun 13 01:08:31.808030 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:31.807963 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:31.826501 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:31.826453 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" podStartSLOduration=1.589948774 podStartE2EDuration="4.826438725s" totalImagesPullingTime="3.236489951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:31.825520399 +0000 UTC m=+649.821432777" watchObservedRunningTime="2026-06-13 01:08:31.826438725 +0000 UTC m=+649.822351102" Jun 13 01:08:31.844714 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:31.844668 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-d7df9d9f9-mq778" podStartSLOduration=1.676195022 podStartE2EDuration="4.844652342s" totalImagesPullingTime="3.16845732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:31.842737485 +0000 UTC m=+649.838649862" watchObservedRunningTime="2026-06-13 01:08:31.844652342 +0000 UTC m=+649.840564721" Jun 13 01:08:37.819343 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:37.819312 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-d7df9d9f9-mq778" Jun 13 01:08:39.098204 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:39.098161 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:39.098683 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:39.098400 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" containerID="cri-o://5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33" gracePeriod=30 Jun 13 01:08:40.757514 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.757486 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:40.868340 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.868305 2583 generic.go:356] "Generic (PLEG): container finished" podID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerID="5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33" exitCode=143 Jun 13 01:08:40.868563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.868357 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:40.868563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.868393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"386718ba-6bd0-4e43-bcbb-a92aed6de7c9","Type":"ContainerDied","Data":"5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33"} Jun 13 01:08:40.868563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.868483 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"386718ba-6bd0-4e43-bcbb-a92aed6de7c9","Type":"ContainerDied","Data":"9ff22ad14ae3d32851700ce47bf168e83d678d104959f1cb78af8c0d7cf5d877"} Jun 13 01:08:40.868563 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.868513 2583 scope.go:117] "RemoveContainer" containerID="5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33" Jun 13 01:08:40.870638 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.870615 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29md7\" (UniqueName: \"kubernetes.io/projected/386718ba-6bd0-4e43-bcbb-a92aed6de7c9-kube-api-access-29md7\") pod \"386718ba-6bd0-4e43-bcbb-a92aed6de7c9\" (UID: \"386718ba-6bd0-4e43-bcbb-a92aed6de7c9\") " Jun 13 01:08:40.873108 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.873079 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386718ba-6bd0-4e43-bcbb-a92aed6de7c9-kube-api-access-29md7" (OuterVolumeSpecName: "kube-api-access-29md7") pod "386718ba-6bd0-4e43-bcbb-a92aed6de7c9" (UID: "386718ba-6bd0-4e43-bcbb-a92aed6de7c9"). InnerVolumeSpecName "kube-api-access-29md7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:08:40.878631 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.878607 2583 scope.go:117] "RemoveContainer" containerID="5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33" Jun 13 01:08:40.878975 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:08:40.878953 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33\": container with ID starting with 5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33 not found: ID does not exist" containerID="5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33" Jun 13 01:08:40.879061 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.878981 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33"} err="failed to get container status \"5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33\": rpc error: code = NotFound desc = could not find container \"5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33\": container with ID starting with 5ea83a444055717ec119ebbfa0103e5318d10bd01587ba9ca11e93f5b7e8ce33 not found: ID does not exist" Jun 13 01:08:40.972300 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:40.972258 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29md7\" (UniqueName: \"kubernetes.io/projected/386718ba-6bd0-4e43-bcbb-a92aed6de7c9-kube-api-access-29md7\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:08:41.191730 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.191696 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:41.195157 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.195121 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:41.222738 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.222704 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:41.223076 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.223064 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" Jun 13 01:08:41.223123 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.223077 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" Jun 13 01:08:41.223177 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.223162 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" containerName="keycloak" Jun 13 01:08:41.227709 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.227692 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.230872 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.230850 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 13 01:08:41.230872 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.230862 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 13 01:08:41.231105 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.230872 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nfm7v\"" Jun 13 01:08:41.231105 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.230935 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 13 01:08:41.231338 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.231317 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 13 01:08:41.234781 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.234757 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:41.275521 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.275485 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wl4\" (UniqueName: \"kubernetes.io/projected/970eca02-2c17-4045-aeee-93d199b8de2c-kube-api-access-79wl4\") pod \"maas-keycloak-0\" (UID: \"970eca02-2c17-4045-aeee-93d199b8de2c\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.275712 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.275529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/970eca02-2c17-4045-aeee-93d199b8de2c-test-realms\") pod \"maas-keycloak-0\" (UID: \"970eca02-2c17-4045-aeee-93d199b8de2c\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.376537 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.376501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wl4\" (UniqueName: \"kubernetes.io/projected/970eca02-2c17-4045-aeee-93d199b8de2c-kube-api-access-79wl4\") pod \"maas-keycloak-0\" (UID: \"970eca02-2c17-4045-aeee-93d199b8de2c\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.376720 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.376546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/970eca02-2c17-4045-aeee-93d199b8de2c-test-realms\") pod \"maas-keycloak-0\" (UID: \"970eca02-2c17-4045-aeee-93d199b8de2c\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.377280 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.377259 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/970eca02-2c17-4045-aeee-93d199b8de2c-test-realms\") pod \"maas-keycloak-0\" (UID: \"970eca02-2c17-4045-aeee-93d199b8de2c\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.385485 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.385456 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wl4\" (UniqueName: \"kubernetes.io/projected/970eca02-2c17-4045-aeee-93d199b8de2c-kube-api-access-79wl4\") pod \"maas-keycloak-0\" (UID: \"970eca02-2c17-4045-aeee-93d199b8de2c\") " pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.539581 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.539482 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:41.678461 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.678426 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 13 01:08:41.680555 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:08:41.680529 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod970eca02_2c17_4045_aeee_93d199b8de2c.slice/crio-889dee31a2d1d004951403308c712d4e7a2dbcdb6d625a84d3f98f11cb125b0d WatchSource:0}: Error finding container 889dee31a2d1d004951403308c712d4e7a2dbcdb6d625a84d3f98f11cb125b0d: Status 404 returned error can't find the container with id 889dee31a2d1d004951403308c712d4e7a2dbcdb6d625a84d3f98f11cb125b0d Jun 13 01:08:41.880030 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:41.879992 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"970eca02-2c17-4045-aeee-93d199b8de2c","Type":"ContainerStarted","Data":"889dee31a2d1d004951403308c712d4e7a2dbcdb6d625a84d3f98f11cb125b0d"} Jun 13 01:08:42.485095 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:42.485061 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="386718ba-6bd0-4e43-bcbb-a92aed6de7c9" path="/var/lib/kubelet/pods/386718ba-6bd0-4e43-bcbb-a92aed6de7c9/volumes" Jun 13 01:08:42.817024 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:42.816934 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-wjrgq" Jun 13 01:08:42.889656 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:42.889614 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"970eca02-2c17-4045-aeee-93d199b8de2c","Type":"ContainerStarted","Data":"0883a4140ef50faf5f500d545f8744ae682f845bc76450f961e2fc314b2fb73b"} Jun 13 01:08:42.912055 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:42.911985 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5853204490000001 podStartE2EDuration="1.911959338s" totalImagesPullingTime="326.638889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:08:42.909431403 +0000 UTC m=+660.905343783" watchObservedRunningTime="2026-06-13 01:08:42.911959338 +0000 UTC m=+660.907871717" Jun 13 01:08:43.540540 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:43.540493 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:43.542239 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:43.542200 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:44.541076 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:44.541023 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:45.540912 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:45.540855 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:46.540361 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:46.540314 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:47.540484 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:47.540432 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:48.540322 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:48.540264 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:49.540326 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:49.540273 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:50.540940 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:50.540890 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:51.540347 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:51.540291 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:51.540674 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:51.540556 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:52.540530 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:52.540489 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:53.540931 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:53.540882 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:54.540440 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:54.540398 2583 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 13 01:08:55.669954 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:55.669904 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 13 01:08:55.689780 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:08:55.689710 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:09:00.409564 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:00.409489 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:00.511360 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:00.511313 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:05.674731 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:05.674665 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="970eca02-2c17-4045-aeee-93d199b8de2c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 01:09:15.676381 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:15.676343 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 13 01:09:28.609050 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:28.608966 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:28.714211 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:28.714144 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:39.299024 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:39.298987 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:45.816820 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.816766 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz"] Jun 13 01:09:45.820865 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.820843 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.823587 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.823568 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 01:09:45.824695 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.824676 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 01:09:45.824813 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.824782 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 13 01:09:45.824911 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.824883 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gc8zk\"" Jun 13 01:09:45.839442 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.839414 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz"] Jun 13 01:09:45.845681 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.845658 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:45.881611 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.881581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335df312-07e1-40da-b980-529d00519e3e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.881611 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.881612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.881828 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.881644 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbd8b\" (UniqueName: \"kubernetes.io/projected/335df312-07e1-40da-b980-529d00519e3e-kube-api-access-nbd8b\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.881828 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.881790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.881828 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.881823 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.881993 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.881892 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.982553 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.982513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.982553 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.982561 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.982785 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.982607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.982888 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.982838 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335df312-07e1-40da-b980-529d00519e3e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.982888 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.982888 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.983075 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.982924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbd8b\" (UniqueName: \"kubernetes.io/projected/335df312-07e1-40da-b980-529d00519e3e-kube-api-access-nbd8b\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.983075 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.983010 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.983075 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.983027 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.983244 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.983082 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.985461 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.985426 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/335df312-07e1-40da-b980-529d00519e3e-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.985580 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.985558 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335df312-07e1-40da-b980-529d00519e3e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:45.990676 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:45.990655 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbd8b\" (UniqueName: \"kubernetes.io/projected/335df312-07e1-40da-b980-529d00519e3e-kube-api-access-nbd8b\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9njgz\" (UID: \"335df312-07e1-40da-b980-529d00519e3e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:46.131512 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:46.131476 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" Jun 13 01:09:46.270837 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:46.270799 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz"] Jun 13 01:09:46.271628 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:09:46.271598 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335df312_07e1_40da_b980_529d00519e3e.slice/crio-a1df750c01bc83fca2c18bca6e1df823387f9143342840e75a981d2214781d85 WatchSource:0}: Error finding container a1df750c01bc83fca2c18bca6e1df823387f9143342840e75a981d2214781d85: Status 404 returned error can't find the container with id a1df750c01bc83fca2c18bca6e1df823387f9143342840e75a981d2214781d85 Jun 13 01:09:46.319337 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:46.319304 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" event={"ID":"335df312-07e1-40da-b980-529d00519e3e","Type":"ContainerStarted","Data":"a1df750c01bc83fca2c18bca6e1df823387f9143342840e75a981d2214781d85"} Jun 13 01:09:50.353208 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:50.353171 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9njgz" event={"ID":"335df312-07e1-40da-b980-529d00519e3e","Type":"ContainerStarted","Data":"31f3cd7b0b86cf3fc5c844a4184d72381542c92a0d3389913f20171d1b20234d"} Jun 13 01:09:51.568587 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:51.568555 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:51.624526 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:51.624482 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:09:54.371241 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:09:54.371198 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:04.967859 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:04.967812 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:12.872517 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:12.872475 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:23.746029 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.745993 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd"] Jun 13 01:10:23.764558 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.764493 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd"] Jun 13 01:10:23.764785 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.764645 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.768128 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.768108 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 13 01:10:23.773829 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.773797 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:10:23.820214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.817025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.820214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.817225 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.820214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.817300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.820214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.817351 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/644723ac-2425-4335-b369-b9ac64783b88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.820214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.817400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdwx\" (UniqueName: \"kubernetes.io/projected/644723ac-2425-4335-b369-b9ac64783b88-kube-api-access-psdwx\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.820214 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.817442 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918162 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918123 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918327 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/644723ac-2425-4335-b369-b9ac64783b88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918327 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdwx\" (UniqueName: \"kubernetes.io/projected/644723ac-2425-4335-b369-b9ac64783b88-kube-api-access-psdwx\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918327 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918283 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918327 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918310 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918507 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918414 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918604 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918575 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918701 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918686 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.918792 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.918772 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.920588 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.920570 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/644723ac-2425-4335-b369-b9ac64783b88-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.920856 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.920835 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/644723ac-2425-4335-b369-b9ac64783b88-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:23.927450 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:23.927423 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdwx\" (UniqueName: \"kubernetes.io/projected/644723ac-2425-4335-b369-b9ac64783b88-kube-api-access-psdwx\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-9qbgd\" (UID: \"644723ac-2425-4335-b369-b9ac64783b88\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:24.075614 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:24.075514 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:24.219779 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:24.219748 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd"] Jun 13 01:10:24.222476 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:10:24.222452 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644723ac_2425_4335_b369_b9ac64783b88.slice/crio-650ddf887114bd5acb63bf62224710679b8f6c3f3dfa2f9ca277cff24195708a WatchSource:0}: Error finding container 650ddf887114bd5acb63bf62224710679b8f6c3f3dfa2f9ca277cff24195708a: Status 404 returned error can't find the container with id 650ddf887114bd5acb63bf62224710679b8f6c3f3dfa2f9ca277cff24195708a Jun 13 01:10:24.547457 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:24.547423 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" event={"ID":"644723ac-2425-4335-b369-b9ac64783b88","Type":"ContainerStarted","Data":"0efec5d2cdb52a41fe0bf5f78ad2cfef9d0ddde21f3db49120cd67335453dc8b"} Jun 13 01:10:24.547664 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:24.547466 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" event={"ID":"644723ac-2425-4335-b369-b9ac64783b88","Type":"ContainerStarted","Data":"650ddf887114bd5acb63bf62224710679b8f6c3f3dfa2f9ca277cff24195708a"} Jun 13 01:10:26.560859 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:26.560824 2583 generic.go:356] "Generic (PLEG): container finished" podID="644723ac-2425-4335-b369-b9ac64783b88" containerID="0efec5d2cdb52a41fe0bf5f78ad2cfef9d0ddde21f3db49120cd67335453dc8b" exitCode=0 Jun 13 01:10:26.561305 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:26.560899 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" event={"ID":"644723ac-2425-4335-b369-b9ac64783b88","Type":"ContainerDied","Data":"0efec5d2cdb52a41fe0bf5f78ad2cfef9d0ddde21f3db49120cd67335453dc8b"} Jun 13 01:10:28.574141 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:28.574101 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" event={"ID":"644723ac-2425-4335-b369-b9ac64783b88","Type":"ContainerStarted","Data":"cebbdefb990807b9c27fffa1b1a180845d5dd822c46e0c7f3e7ea1658aa6736c"} Jun 13 01:10:28.596445 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:28.596394 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" podStartSLOduration=3.267469976 podStartE2EDuration="5.596381553s" totalImagesPullingTime="1.052056345s" totalInitContainerRuntime="1.276855232s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:10:28.595107317 +0000 UTC m=+766.591019685" watchObservedRunningTime="2026-06-13 01:10:28.596381553 +0000 UTC m=+766.592293931" Jun 13 01:10:34.076626 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:34.076590 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:34.077236 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:34.076664 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:34.089489 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:34.089462 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:34.625603 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:34.625573 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-9qbgd" Jun 13 01:10:38.150553 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:10:38.150523 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:06.364361 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:11:06.364256 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:06.465315 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:11:06.465260 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:30.141302 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:11:30.141265 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:30.240628 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:11:30.240598 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:31.235708 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:11:31.235669 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:11:31.335208 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:11:31.335171 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:12:42.527469 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:12:42.527439 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:12:42.532647 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:12:42.532624 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:12:57.927189 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:12:57.927143 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:12:59.491658 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:12:59.491620 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:13:41.505551 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:13:41.505516 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:13:41.600794 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:13:41.600762 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:13:49.979363 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:13:49.979327 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:13:55.788803 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:13:55.788763 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:13:55.891241 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:13:55.891201 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:13:56.366404 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:13:56.366370 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:28.061595 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:28.061507 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:28.161363 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:28.161325 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:52.038562 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:52.038531 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.062054 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:58.062018 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.169268 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:58.169232 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.261753 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:58.261715 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.428032 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:58.428001 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:58.522032 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:58.521996 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:14:59.006772 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:14:59.006739 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:15.042331 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:15.042296 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:15.158030 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:15.157985 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:15.260459 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:15.260423 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:21.365122 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:21.365080 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:21.418972 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:21.418943 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:29.531074 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:29.530932 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:29.628726 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:29.628685 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:29.725847 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:29.725816 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:29.826342 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:29.826245 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:46.275495 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:46.275460 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:46.387600 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:46.387557 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:46.491446 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:46.491404 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:52.124084 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:52.124051 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:15:52.188114 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:15:52.188079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:08.357587 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:08.357534 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:08.450406 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:08.450362 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:08.578894 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:08.578858 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:14.368243 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:14.368201 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:14.429425 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:14.429387 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:14.527393 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:14.527356 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:14.624894 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:14.624815 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:14.725392 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:14.725348 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:20.395410 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:20.395373 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:16:20.494728 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:16:20.494698 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:17:42.567674 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:17:42.567648 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:17:42.576273 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:17:42.576248 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:21:21.233287 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:21:21.233258 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:22:42.610099 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:22:42.610068 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:22:42.618669 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:22:42.618640 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:23:04.493887 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.493798 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr"] Jun 13 01:23:04.494412 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.494012 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" podUID="02a593d3-94a9-4af2-abed-8ada656166ca" containerName="manager" containerID="cri-o://09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0" gracePeriod=10 Jun 13 01:23:04.751078 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.751024 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:23:04.878910 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.878855 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a593d3-94a9-4af2-abed-8ada656166ca-extensions-socket-volume\") pod \"02a593d3-94a9-4af2-abed-8ada656166ca\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " Jun 13 01:23:04.878910 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.878919 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/02a593d3-94a9-4af2-abed-8ada656166ca-kube-api-access-l4n22\") pod \"02a593d3-94a9-4af2-abed-8ada656166ca\" (UID: \"02a593d3-94a9-4af2-abed-8ada656166ca\") " Jun 13 01:23:04.879282 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.879259 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02a593d3-94a9-4af2-abed-8ada656166ca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "02a593d3-94a9-4af2-abed-8ada656166ca" (UID: "02a593d3-94a9-4af2-abed-8ada656166ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 01:23:04.881127 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.881104 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a593d3-94a9-4af2-abed-8ada656166ca-kube-api-access-l4n22" (OuterVolumeSpecName: "kube-api-access-l4n22") pod "02a593d3-94a9-4af2-abed-8ada656166ca" (UID: "02a593d3-94a9-4af2-abed-8ada656166ca"). InnerVolumeSpecName "kube-api-access-l4n22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 01:23:04.980058 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.980023 2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02a593d3-94a9-4af2-abed-8ada656166ca-extensions-socket-volume\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:23:04.980058 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:04.980050 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/02a593d3-94a9-4af2-abed-8ada656166ca-kube-api-access-l4n22\") on node \"ip-10-0-129-42.ec2.internal\" DevicePath \"\"" Jun 13 01:23:05.083307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.083227 2583 generic.go:356] "Generic (PLEG): container finished" podID="02a593d3-94a9-4af2-abed-8ada656166ca" containerID="09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0" exitCode=0 Jun 13 01:23:05.083307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.083289 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" Jun 13 01:23:05.083475 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.083313 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" event={"ID":"02a593d3-94a9-4af2-abed-8ada656166ca","Type":"ContainerDied","Data":"09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0"} Jun 13 01:23:05.083475 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.083365 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr" event={"ID":"02a593d3-94a9-4af2-abed-8ada656166ca","Type":"ContainerDied","Data":"38e57ab538b3bd2f88dd55132722f0e2f0c9750b36bb2834684551825add6d74"} Jun 13 01:23:05.083475 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.083389 2583 scope.go:117] "RemoveContainer" containerID="09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0" Jun 13 01:23:05.093972 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.093955 2583 scope.go:117] "RemoveContainer" containerID="09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0" Jun 13 01:23:05.094238 ip-10-0-129-42 kubenswrapper[2583]: E0613 01:23:05.094221 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0\": container with ID starting with 09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0 not found: ID does not exist" containerID="09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0" Jun 13 01:23:05.094311 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.094247 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0"} err="failed to get container status \"09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0\": rpc error: code = NotFound desc = could not find container \"09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0\": container with ID starting with 09be2403d699e88b43cf161d82eefa31d67624b1b76c87de4b086ddd462bc4f0 not found: ID does not exist" Jun 13 01:23:05.107678 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.107647 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr"] Jun 13 01:23:05.110134 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:05.110114 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fb9hr"] Jun 13 01:23:06.482856 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:06.482823 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a593d3-94a9-4af2-abed-8ada656166ca" path="/var/lib/kubelet/pods/02a593d3-94a9-4af2-abed-8ada656166ca/volumes" Jun 13 01:23:43.496380 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:23:43.496348 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:24:05.657222 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.657181 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt"] Jun 13 01:24:05.657699 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.657603 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a593d3-94a9-4af2-abed-8ada656166ca" containerName="manager" Jun 13 01:24:05.657699 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.657617 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a593d3-94a9-4af2-abed-8ada656166ca" containerName="manager" Jun 13 01:24:05.657699 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.657696 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a593d3-94a9-4af2-abed-8ada656166ca" containerName="manager" Jun 13 01:24:05.661856 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.661838 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.665881 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.665863 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cs8n9\"" Jun 13 01:24:05.674253 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.674226 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt"] Jun 13 01:24:05.833307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.833262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7zf\" (UniqueName: \"kubernetes.io/projected/97eae80d-965c-4e5e-9d28-f9c5c515c27d-kube-api-access-5h7zf\") pod \"kuadrant-operator-controller-manager-86878c769f-8xbxt\" (UID: \"97eae80d-965c-4e5e-9d28-f9c5c515c27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.833307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.833307 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eae80d-965c-4e5e-9d28-f9c5c515c27d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xbxt\" (UID: \"97eae80d-965c-4e5e-9d28-f9c5c515c27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.934080 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.933988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7zf\" (UniqueName: \"kubernetes.io/projected/97eae80d-965c-4e5e-9d28-f9c5c515c27d-kube-api-access-5h7zf\") pod \"kuadrant-operator-controller-manager-86878c769f-8xbxt\" (UID: \"97eae80d-965c-4e5e-9d28-f9c5c515c27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.934080 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.934030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eae80d-965c-4e5e-9d28-f9c5c515c27d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xbxt\" (UID: \"97eae80d-965c-4e5e-9d28-f9c5c515c27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.934481 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.934462 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97eae80d-965c-4e5e-9d28-f9c5c515c27d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xbxt\" (UID: \"97eae80d-965c-4e5e-9d28-f9c5c515c27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.943327 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.943301 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7zf\" (UniqueName: \"kubernetes.io/projected/97eae80d-965c-4e5e-9d28-f9c5c515c27d-kube-api-access-5h7zf\") pod \"kuadrant-operator-controller-manager-86878c769f-8xbxt\" (UID: \"97eae80d-965c-4e5e-9d28-f9c5c515c27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:05.972200 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:05.972172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:06.137469 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:06.137443 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt"] Jun 13 01:24:06.138525 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:24:06.138498 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eae80d_965c_4e5e_9d28_f9c5c515c27d.slice/crio-7c25fecf7fbccc4957c3ce37a78ef94a8901227fdb19d6e58e6184d6b3cba7ba WatchSource:0}: Error finding container 7c25fecf7fbccc4957c3ce37a78ef94a8901227fdb19d6e58e6184d6b3cba7ba: Status 404 returned error can't find the container with id 7c25fecf7fbccc4957c3ce37a78ef94a8901227fdb19d6e58e6184d6b3cba7ba Jun 13 01:24:06.440405 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:06.440370 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" event={"ID":"97eae80d-965c-4e5e-9d28-f9c5c515c27d","Type":"ContainerStarted","Data":"f614e43175e78ad87b9646988a913590d171639871346171023405a382308d04"} Jun 13 01:24:06.440594 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:06.440425 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:06.440594 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:06.440443 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" event={"ID":"97eae80d-965c-4e5e-9d28-f9c5c515c27d","Type":"ContainerStarted","Data":"7c25fecf7fbccc4957c3ce37a78ef94a8901227fdb19d6e58e6184d6b3cba7ba"} Jun 13 01:24:06.461463 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:06.461374 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" podStartSLOduration=1.461360362 podStartE2EDuration="1.461360362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 01:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:24:06.460122515 +0000 UTC m=+1584.456034894" watchObservedRunningTime="2026-06-13 01:24:06.461360362 +0000 UTC m=+1584.457272740" Jun 13 01:24:10.803079 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:10.803011 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:24:10.904328 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:10.904290 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:24:17.449694 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:17.449657 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xbxt" Jun 13 01:24:45.088273 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:24:45.088187 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:27:21.092336 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:27:21.092299 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:27:22.173115 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:27:22.173079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:27:42.656405 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:27:42.656367 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:27:42.662108 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:27:42.662088 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:32:42.707280 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:32:42.707251 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:32:42.713598 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:32:42.713579 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9pt_313f6d01-b629-4a89-81dd-bb068943c9f2/ovn-acl-logging/0.log" Jun 13 01:33:16.071750 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:16.071693 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:17.128250 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:17.128216 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:32.579663 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:32.579572 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66bcf5d7d8-bhgxs_a28c186d-9942-42a3-8f59-e39ae66a97d9/nginx/0.log" Jun 13 01:33:32.694797 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:32.694743 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-xpswd_ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9/manager/0.log" Jun 13 01:33:32.822568 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:32.822538 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-c9xnv_52af57b3-4de5-4f96-a346-c20aec1538c9/manager/0.log" Jun 13 01:33:32.949474 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:32.949440 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d7df9d9f9-mq778_866cbe44-8043-45a3-8774-de933565426f/maas-api/0.log" Jun 13 01:33:33.518328 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:33.518301 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4857f_d77ee9f5-cfb0-4167-8c1c-543c9e5b8724/manager/0.log" Jun 13 01:33:33.763603 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:33.763571 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9cbf4b47-vnztv_43e5399e-5c2d-4272-b6bd-21845af1dd7e/copy-manifests/0.log" Jun 13 01:33:33.781909 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:33.781834 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9cbf4b47-vnztv_43e5399e-5c2d-4272-b6bd-21845af1dd7e/manager/0.log" Jun 13 01:33:34.763095 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:34.763060 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm_043c2869-6a29-4e79-9ec9-1ab078c46ffa/util/0.log" Jun 13 01:33:34.770399 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:34.770369 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm_043c2869-6a29-4e79-9ec9-1ab078c46ffa/pull/0.log" Jun 13 01:33:34.777194 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:34.777165 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm_043c2869-6a29-4e79-9ec9-1ab078c46ffa/extract/0.log" Jun 13 01:33:34.890346 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:34.890298 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd_78fc7513-a961-4a62-af9c-42af301612fe/util/0.log" Jun 13 01:33:34.896935 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:34.896912 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd_78fc7513-a961-4a62-af9c-42af301612fe/pull/0.log" Jun 13 01:33:34.902977 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:34.902955 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd_78fc7513-a961-4a62-af9c-42af301612fe/extract/0.log" Jun 13 01:33:35.011716 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.011689 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6_18df5517-aba3-4b79-9f1b-38be2045bb6d/util/0.log" Jun 13 01:33:35.018546 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.018436 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6_18df5517-aba3-4b79-9f1b-38be2045bb6d/pull/0.log" Jun 13 01:33:35.024665 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.024643 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6_18df5517-aba3-4b79-9f1b-38be2045bb6d/extract/0.log" Jun 13 01:33:35.140445 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.140417 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc_e35b566d-df1f-48a6-8bfa-e4487866b7fe/extract/0.log" Jun 13 01:33:35.146868 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.146842 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc_e35b566d-df1f-48a6-8bfa-e4487866b7fe/util/0.log" Jun 13 01:33:35.155414 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.155381 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc_e35b566d-df1f-48a6-8bfa-e4487866b7fe/pull/0.log" Jun 13 01:33:35.503245 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.503215 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gw29m_c5fc818c-2105-4c10-b108-1b26f6f2fa02/manager/0.log" Jun 13 01:33:35.726907 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.726862 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f67x8_a58922dd-3153-4817-86e5-0af634c289e3/registry-server/0.log" Jun 13 01:33:35.855519 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:35.855412 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8xbxt_97eae80d-965c-4e5e-9d28-f9c5c515c27d/manager/0.log" Jun 13 01:33:36.093462 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:36.093429 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7d56c_c405fe0f-9942-491a-8f66-61e39154c774/manager/0.log" Jun 13 01:33:36.562205 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:36.562132 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-w6tgz_02ddd70c-11b8-4a3e-86c0-a7508ac284a8/discovery/0.log" Jun 13 01:33:36.672081 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:36.672033 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfb695fcc-qh5x7_6be7f4d8-edc8-434b-87ee-ae7be7cd15ea/kube-auth-proxy/0.log" Jun 13 01:33:37.134719 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:37.134684 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wjrgq_4c82baca-b75b-40b6-ad06-a403b69259c7/payload-processing/0.log" Jun 13 01:33:37.718336 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:37.718312 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9njgz_335df312-07e1-40da-b980-529d00519e3e/storage-initializer/0.log" Jun 13 01:33:38.170657 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:38.170620 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9qbgd_644723ac-2425-4335-b369-b9ac64783b88/storage-initializer/0.log" Jun 13 01:33:38.177900 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:38.177868 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-9qbgd_644723ac-2425-4335-b369-b9ac64783b88/main/0.log" Jun 13 01:33:42.317754 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:42.317715 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:42.418340 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:42.418293 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" limit=1024 Jun 13 01:33:45.303764 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:45.303723 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vpq9m_12d1746b-3561-4720-868a-541f21891b97/global-pull-secret-syncer/0.log" Jun 13 01:33:45.356968 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:45.356936 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6stgw_89ae70cd-14ab-4357-9fa2-2353fc19fdc0/konnectivity-agent/0.log" Jun 13 01:33:45.436311 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:45.436283 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-42.ec2.internal_a552396380661cf3c3f2936a8001308d/haproxy/0.log" Jun 13 01:33:49.077800 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:49.077765 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-88ksm_b06c848f-1766-448b-830b-39fe18cf71d7/sail-operator/0.log" Jun 13 01:33:50.016124 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.016080 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm_043c2869-6a29-4e79-9ec9-1ab078c46ffa/extract/0.log" Jun 13 01:33:50.041941 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.041915 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm_043c2869-6a29-4e79-9ec9-1ab078c46ffa/util/0.log" Jun 13 01:33:50.071215 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.071166 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pp2zm_043c2869-6a29-4e79-9ec9-1ab078c46ffa/pull/0.log" Jun 13 01:33:50.104441 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.104415 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd_78fc7513-a961-4a62-af9c-42af301612fe/extract/0.log" Jun 13 01:33:50.127324 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.127291 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd_78fc7513-a961-4a62-af9c-42af301612fe/util/0.log" Jun 13 01:33:50.157121 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.157087 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0l7trd_78fc7513-a961-4a62-af9c-42af301612fe/pull/0.log" Jun 13 01:33:50.187706 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.187676 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6_18df5517-aba3-4b79-9f1b-38be2045bb6d/extract/0.log" Jun 13 01:33:50.209873 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.209844 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6_18df5517-aba3-4b79-9f1b-38be2045bb6d/util/0.log" Jun 13 01:33:50.232554 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.232516 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jk5l6_18df5517-aba3-4b79-9f1b-38be2045bb6d/pull/0.log" Jun 13 01:33:50.258862 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.258835 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc_e35b566d-df1f-48a6-8bfa-e4487866b7fe/extract/0.log" Jun 13 01:33:50.278826 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.278736 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc_e35b566d-df1f-48a6-8bfa-e4487866b7fe/util/0.log" Jun 13 01:33:50.300761 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.300739 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xrhmc_e35b566d-df1f-48a6-8bfa-e4487866b7fe/pull/0.log" Jun 13 01:33:50.676596 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.676565 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gw29m_c5fc818c-2105-4c10-b108-1b26f6f2fa02/manager/0.log" Jun 13 01:33:50.750762 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.750728 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-f67x8_a58922dd-3153-4817-86e5-0af634c289e3/registry-server/0.log" Jun 13 01:33:50.852610 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.852572 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8xbxt_97eae80d-965c-4e5e-9d28-f9c5c515c27d/manager/0.log" Jun 13 01:33:50.984976 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:50.984877 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7d56c_c405fe0f-9942-491a-8f66-61e39154c774/manager/0.log" Jun 13 01:33:52.633607 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.633576 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/alertmanager/0.log" Jun 13 01:33:52.667621 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.667595 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/config-reloader/0.log" Jun 13 01:33:52.697582 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.697553 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/kube-rbac-proxy-web/0.log" Jun 13 01:33:52.732044 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.732023 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/kube-rbac-proxy/0.log" Jun 13 01:33:52.763840 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.763813 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/kube-rbac-proxy-metric/0.log" Jun 13 01:33:52.801209 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.801185 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/prom-label-proxy/0.log" Jun 13 01:33:52.843704 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:52.843676 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c87a62b7-f0a0-461c-8085-86d6fe299580/init-config-reloader/0.log" Jun 13 01:33:53.099445 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.099367 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68b5674c87-6scsp_389be8f9-628c-4948-aa5b-2e293da9dddb/metrics-server/0.log" Jun 13 01:33:53.417691 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.417659 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m52ff_7910bbbb-3678-4369-893d-9b8b37ddebd2/node-exporter/0.log" Jun 13 01:33:53.445848 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.445827 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m52ff_7910bbbb-3678-4369-893d-9b8b37ddebd2/kube-rbac-proxy/0.log" Jun 13 01:33:53.471819 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.471795 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m52ff_7910bbbb-3678-4369-893d-9b8b37ddebd2/init-textfile/0.log" Jun 13 01:33:53.936334 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.936300 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-rkfc5_2879f971-3db3-4cf4-855d-e3c2ebcc7983/prometheus-operator/0.log" Jun 13 01:33:53.958323 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.958285 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-rkfc5_2879f971-3db3-4cf4-855d-e3c2ebcc7983/kube-rbac-proxy/0.log" Jun 13 01:33:53.982455 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:53.982422 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-n9mkh_b20aabc9-466c-40b1-9ed4-32ed7218b63f/prometheus-operator-admission-webhook/0.log" Jun 13 01:33:54.029212 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:54.029178 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bfb666bc7-7bsjz_c7d97bcd-229d-4d27-8a40-b5cd7fccfff6/telemeter-client/0.log" Jun 13 01:33:54.050868 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:54.050836 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bfb666bc7-7bsjz_c7d97bcd-229d-4d27-8a40-b5cd7fccfff6/reload/0.log" Jun 13 01:33:54.072624 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:54.072599 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bfb666bc7-7bsjz_c7d97bcd-229d-4d27-8a40-b5cd7fccfff6/kube-rbac-proxy/0.log" Jun 13 01:33:56.910746 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.910714 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc"] Jun 13 01:33:56.914557 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.914539 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:56.917000 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.916983 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gb42z\"/\"default-dockercfg-qzdl7\"" Jun 13 01:33:56.917126 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.916983 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gb42z\"/\"kube-root-ca.crt\"" Jun 13 01:33:56.918194 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.918139 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gb42z\"/\"openshift-service-ca.crt\"" Jun 13 01:33:56.921803 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.921744 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc"] Jun 13 01:33:56.998097 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.998059 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656nh\" (UniqueName: \"kubernetes.io/projected/2b56f4e0-f364-49b9-afee-5feda84be86e-kube-api-access-656nh\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:56.998307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.998105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-proc\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:56.998307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.998204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-sys\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:56.998307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.998237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-podres\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:56.998307 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:56.998277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-lib-modules\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.098893 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.098856 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-lib-modules\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.098945 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656nh\" (UniqueName: \"kubernetes.io/projected/2b56f4e0-f364-49b9-afee-5feda84be86e-kube-api-access-656nh\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.098973 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-proc\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.099003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-sys\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.099029 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-podres\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.099039 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-lib-modules\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.099102 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-proc\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.099137 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-podres\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.099424 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.099208 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b56f4e0-f364-49b9-afee-5feda84be86e-sys\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.108006 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.107981 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-656nh\" (UniqueName: \"kubernetes.io/projected/2b56f4e0-f364-49b9-afee-5feda84be86e-kube-api-access-656nh\") pod \"perf-node-gather-daemonset-t9vvc\" (UID: \"2b56f4e0-f364-49b9-afee-5feda84be86e\") " pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.225436 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.225340 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.367405 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.367381 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc"] Jun 13 01:33:57.369495 ip-10-0-129-42 kubenswrapper[2583]: W0613 01:33:57.369467 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b56f4e0_f364_49b9_afee_5feda84be86e.slice/crio-b11cc806f307f4cbd011a94dbde6ae70f8cd7c4dbb43d95fa88754a5991ed4c9 WatchSource:0}: Error finding container b11cc806f307f4cbd011a94dbde6ae70f8cd7c4dbb43d95fa88754a5991ed4c9: Status 404 returned error can't find the container with id b11cc806f307f4cbd011a94dbde6ae70f8cd7c4dbb43d95fa88754a5991ed4c9 Jun 13 01:33:57.904704 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.904663 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" event={"ID":"2b56f4e0-f364-49b9-afee-5feda84be86e","Type":"ContainerStarted","Data":"0ff06537e106d83f94e82aebfb68a58147702cb151cec26015c12ffd557a5212"} Jun 13 01:33:57.904896 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.904757 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" event={"ID":"2b56f4e0-f364-49b9-afee-5feda84be86e","Type":"ContainerStarted","Data":"b11cc806f307f4cbd011a94dbde6ae70f8cd7c4dbb43d95fa88754a5991ed4c9"} Jun 13 01:33:57.904896 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.904781 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:33:57.923985 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:57.923929 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" podStartSLOduration=1.9239150729999999 podStartE2EDuration="1.923915073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 01:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 01:33:57.920653811 +0000 UTC m=+2175.916566189" watchObservedRunningTime="2026-06-13 01:33:57.923915073 +0000 UTC m=+2175.919827451" Jun 13 01:33:58.736446 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:58.736411 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hwtns_51fd3448-2691-40cb-857c-86346334c688/dns/0.log" Jun 13 01:33:58.756943 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:58.756905 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hwtns_51fd3448-2691-40cb-857c-86346334c688/kube-rbac-proxy/0.log" Jun 13 01:33:58.779842 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:58.779814 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5m8l8_4e31718b-a295-4dcd-9a26-e6966941a147/dns-node-resolver/0.log" Jun 13 01:33:59.454489 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:59.454459 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67bccd7596-d8hds_6215b405-5036-4f1a-8350-064b173bf048/registry/0.log" Jun 13 01:33:59.535746 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:33:59.535708 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zfz9z_59a9ac00-1da7-4a4d-bf04-24ddf0ef6d7f/node-ca/0.log" Jun 13 01:34:00.560101 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:00.560064 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-w6tgz_02ddd70c-11b8-4a3e-86c0-a7508ac284a8/discovery/0.log" Jun 13 01:34:00.581983 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:00.581948 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfb695fcc-qh5x7_6be7f4d8-edc8-434b-87ee-ae7be7cd15ea/kube-auth-proxy/0.log" Jun 13 01:34:00.786591 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:00.786554 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wjrgq_4c82baca-b75b-40b6-ad06-a403b69259c7/payload-processing/0.log" Jun 13 01:34:01.440309 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:01.440284 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxxdn_e36cda4d-62a4-491a-8d7b-5fae94685235/serve-healthcheck-canary/0.log" Jun 13 01:34:01.954962 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:01.954932 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nxmv_9f16cb0b-0269-4cd2-92fd-1a18f0d59520/kube-rbac-proxy/0.log" Jun 13 01:34:01.975019 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:01.974995 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nxmv_9f16cb0b-0269-4cd2-92fd-1a18f0d59520/exporter/0.log" Jun 13 01:34:01.996205 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:01.996172 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nxmv_9f16cb0b-0269-4cd2-92fd-1a18f0d59520/extractor/0.log" Jun 13 01:34:03.921458 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:03.921429 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gb42z/perf-node-gather-daemonset-t9vvc" Jun 13 01:34:04.395137 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:04.395109 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66bcf5d7d8-bhgxs_a28c186d-9942-42a3-8f59-e39ae66a97d9/nginx/0.log" Jun 13 01:34:04.422060 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:04.422035 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-xpswd_ed2407b2-824f-4f1d-8a3f-c9b32b2de9a9/manager/0.log" Jun 13 01:34:04.530925 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:04.530895 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-c9xnv_52af57b3-4de5-4f96-a346-c20aec1538c9/manager/0.log" Jun 13 01:34:04.579796 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:04.579760 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d7df9d9f9-mq778_866cbe44-8043-45a3-8774-de933565426f/maas-api/0.log" Jun 13 01:34:04.811929 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:04.811847 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-4857f_d77ee9f5-cfb0-4167-8c1c-543c9e5b8724/manager/0.log" Jun 13 01:34:05.012696 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:05.012655 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9cbf4b47-vnztv_43e5399e-5c2d-4272-b6bd-21845af1dd7e/manager/0.log" Jun 13 01:34:05.028618 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:05.028595 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c9cbf4b47-vnztv_43e5399e-5c2d-4272-b6bd-21845af1dd7e/copy-manifests/0.log" Jun 13 01:34:06.954382 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:06.954351 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tmkr5_92b68873-e80c-40c9-9de4-8e9e233b7723/openshift-lws-operator/0.log" Jun 13 01:34:11.841896 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:11.841867 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-w6tgz_02ddd70c-11b8-4a3e-86c0-a7508ac284a8/discovery/0.log" Jun 13 01:34:11.851070 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:11.851040 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfb695fcc-qh5x7_6be7f4d8-edc8-434b-87ee-ae7be7cd15ea/kube-auth-proxy/0.log" Jun 13 01:34:12.018337 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:12.018307 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wjrgq_4c82baca-b75b-40b6-ad06-a403b69259c7/payload-processing/0.log" Jun 13 01:34:13.237169 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.237131 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-w6tgz_02ddd70c-11b8-4a3e-86c0-a7508ac284a8/discovery/0.log" Jun 13 01:34:13.248215 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.248192 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfb695fcc-qh5x7_6be7f4d8-edc8-434b-87ee-ae7be7cd15ea/kube-auth-proxy/0.log" Jun 13 01:34:13.418131 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.418093 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-wjrgq_4c82baca-b75b-40b6-ad06-a403b69259c7/payload-processing/0.log" Jun 13 01:34:13.736903 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.736874 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6kfrl_ed275d27-bea7-4a0e-b232-65e3bee1c108/kube-multus/0.log" Jun 13 01:34:13.793997 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.793968 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/kube-multus-additional-cni-plugins/0.log" Jun 13 01:34:13.814722 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.814694 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/egress-router-binary-copy/0.log" Jun 13 01:34:13.834833 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.834803 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/cni-plugins/0.log" Jun 13 01:34:13.855683 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.855665 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/bond-cni-plugin/0.log" Jun 13 01:34:13.876384 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.876364 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/routeoverride-cni/0.log" Jun 13 01:34:13.896810 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.896783 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/whereabouts-cni-bincopy/0.log" Jun 13 01:34:13.919680 ip-10-0-129-42 kubenswrapper[2583]: I0613 01:34:13.919658 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nttmg_ed806a51-9d7b-457b-95e2-0556a8ee8cc2/whereabouts-cni/0.log"